2017-05-07 08:04:49 -04:00
Contributions are much appreciated.
Please open a pull request or add an issue to discuss what you intend to work on.
If the pull requests passes the CI and conforms to the existing style of specs, it will be merged.
### File organization
Spec are grouped in 5 separate top-level groups:
* `command_line` : for the ruby executable command-line flags (`-v`, `-e` , etc)
* `language` : for the language keywords and syntax constructs (`if`, `def` , `A::B` , etc)
2020-12-20 11:16:26 -05:00
* `core` : for the core methods (`Integer#+`, `String#upcase` , no need to require anything)
2017-05-07 08:04:49 -04:00
* `library` : for the standard libraries methods (`CSV.new`, `YAML.parse` , need to require the stdlib)
* `optional/capi` : for functions available to the Ruby C-extension API
The exact file for methods is decided by the `#owner` of a method, for instance for `#group_by` :
2022-04-18 00:53:43 -04:00
2017-05-07 08:04:49 -04:00
```ruby
> [].method(:group_by)
=> #< Method: Array ( Enumerable ) # group_by >
> [].method(:group_by).owner
=> Enumerable
```
2022-04-18 00:53:43 -04:00
2017-05-07 08:04:49 -04:00
Which should therefore be specified in `core/enumerable/group_by_spec.rb` .
### MkSpec - a tool to generate the spec structure
If you want to create new specs, you should use `mkspec` , part of [MSpec ](http://github.com/ruby/mspec ).
$ ../mspec/bin/mkspec -h
#### Creating files for unspecified modules or classes
For instance, to create specs for `forwardable` :
$ ../mspec/bin/mkspec -b library -rforwardable -c Forwardable
Specify `core` or `library` as the `base` .
#### Finding unspecified core methods
This is very easy, just run the command below in your `spec` directory.
`ruby` must be a recent version of MRI.
$ ruby --disable-gem ../mspec/bin/mkspec
You might also want to search for:
it "needs to be reviewed for spec completeness"
which indicates the file was generated but the method unspecified.
2017-10-28 11:15:48 -04:00
### Matchers and expectations
Here is a list of frequently-used matchers, which should be enough for most specs.
There are a few extra specific matchers used in the couple specs that need it.
2020-02-28 13:07:17 -05:00
#### Comparison matchers
2017-10-28 11:15:48 -04:00
```ruby
(1 + 2).should == 3 # Calls #==
(1 + 2).should_not == 5
2020-05-31 12:22:49 -04:00
File.should.equal?(File) # Calls #equal ? (tests identity)
(1 + 2).should.eql?(3) # Calls #eql ? (Hash equality)
2017-10-28 11:15:48 -04:00
1.should < 2
2.should < = 2
3.should >= 3
4.should > 3
"Hello".should =~ /l{2}/ # Calls #=~ (Regexp match)
2020-02-28 13:07:17 -05:00
```
2017-10-28 11:15:48 -04:00
2020-02-28 13:07:17 -05:00
#### Predicate matchers
```ruby
2020-05-31 12:22:49 -04:00
[].should.empty?
[1,2,3].should.include?(2)
"hello".should.start_with?("h")
"hello".should.end_with?("o")
2017-10-28 11:15:48 -04:00
(0.1 + 0.2).should be_close(0.3, TOLERANCE) # (0.2-0.1).abs < TOLERANCE
2020-05-31 12:22:49 -04:00
(0.0/0.0).should.nan?
2017-10-28 11:15:48 -04:00
(1.0/0.0).should be_positive_infinity
(-1.0/0.0).should be_negative_infinity
3.14.should be_an_instance_of(Float) # Calls #instance_of ?
3.14.should be_kind_of(Numeric) # Calls #is_a ?
Numeric.should be_ancestor_of(Float) # Float.ancestors.include?(Numeric)
2020-05-31 12:22:49 -04:00
3.14.should.respond_to?(:to_i)
2020-12-20 11:16:26 -05:00
Integer.should have_instance_method(:+)
2017-10-28 11:15:48 -04:00
Array.should have_method(:new)
2020-02-28 13:07:17 -05:00
```
Also `have_constant` , `have_private_instance_method` , `have_singleton_method` , etc.
2017-10-28 11:15:48 -04:00
2020-02-28 13:07:17 -05:00
#### Exception matchers
```ruby
2017-10-28 11:15:48 -04:00
-> {
raise "oops"
}.should raise_error(RuntimeError, /oops/)
2019-11-30 15:26:52 -05:00
-> {
raise "oops"
}.should raise_error(RuntimeError) { |e|
# Custom checks on the Exception object
2020-05-31 12:22:49 -04:00
e.message.should.include?("oops")
2019-11-30 15:26:52 -05:00
e.cause.should == nil
}
2020-02-28 13:07:17 -05:00
```
##### should_not raise_error
2019-11-30 15:26:52 -05:00
2020-02-28 13:07:17 -05:00
**To avoid!** Instead, use an expectation testing what the code in the lambda does.
If an exception is raised, it will fail the example anyway.
```ruby
2017-10-28 11:15:48 -04:00
-> { ... }.should_not raise_error
2020-02-28 13:07:17 -05:00
```
#### Warning matcher
2017-10-28 11:15:48 -04:00
2020-02-28 13:07:17 -05:00
```ruby
2017-10-28 11:15:48 -04:00
-> {
2020-12-27 11:35:32 -05:00
Fixnum
}.should complain(/constant ::Fixnum is deprecated/) # Expect a warning
2017-10-28 11:15:48 -04:00
```
2017-05-07 08:04:49 -04:00
### Guards
Different guards are available as defined by mspec.
2017-10-28 11:15:48 -04:00
Here is a list of the most commonly-used guards:
2020-02-28 13:07:17 -05:00
#### Version guards
2017-10-28 11:15:48 -04:00
```ruby
2020-07-27 15:41:08 -04:00
ruby_version_is ""..."2.6" do
2020-02-08 05:43:27 -05:00
# Specs for RUBY_VERSION < 2.6
2017-10-28 11:15:48 -04:00
end
2020-07-27 15:41:08 -04:00
ruby_version_is "2.6" do
2020-02-08 05:43:27 -05:00
# Specs for RUBY_VERSION >= 2.6
2017-10-28 11:15:48 -04:00
end
2020-02-28 13:07:17 -05:00
```
2017-10-28 11:15:48 -04:00
2020-02-28 13:07:17 -05:00
#### Platform guards
```ruby
2017-10-28 11:15:48 -04:00
platform_is :windows do
# Specs only valid on Windows
end
platform_is_not :windows do
# Specs valid on platforms other than Windows
end
platform_is :linux, :darwin do # OR
end
platform_is_not :linux, :darwin do # Not Linux and not Darwin
end
platform_is wordsize: 64 do
# 64-bit platform
end
big_endian do
# Big-endian platform
end
2020-02-28 13:07:17 -05:00
```
#### Guard for bug
2022-08-29 09:36:29 -04:00
In case there is a bug in MRI and the fix will be backported to previous versions.
If it is not backported or not likely, use `ruby_version_is` instead.
2020-02-28 13:07:17 -05:00
First, file a bug at https://bugs.ruby-lang.org/.
2022-08-29 09:36:29 -04:00
The problem is `ruby_bug` would make non-MRI implementations fail this spec while MRI itself does not pass it, so it should only be used if the bug is/will be fixed and backported.
2017-10-28 11:15:48 -04:00
2020-02-28 13:07:17 -05:00
```ruby
2022-04-25 08:53:54 -04:00
ruby_bug '#13669', ''...'3.2' do
2017-10-28 11:15:48 -04:00
it "works like this" do
# Specify the expected behavior here, not the bug
end
end
2020-02-28 13:07:17 -05:00
```
2017-10-28 11:15:48 -04:00
2020-02-28 13:07:17 -05:00
#### Combining guards
2017-10-28 11:15:48 -04:00
2020-02-28 13:07:17 -05:00
```ruby
2020-02-08 05:43:27 -05:00
guard -> { platform_is :windows and ruby_version_is ""..."2.6" } do
# Windows and RUBY_VERSION < 2.6
2017-10-28 11:15:48 -04:00
end
2020-02-08 05:43:27 -05:00
guard_not -> { platform_is :windows and ruby_version_is ""..."2.6" } do
2017-10-28 11:15:48 -04:00
# The opposite
end
2020-02-28 13:07:17 -05:00
```
2017-10-28 11:15:48 -04:00
2020-02-28 13:07:17 -05:00
#### Custom guard
```ruby
2017-10-28 11:15:48 -04:00
max_uint = (1 < < 32 ) - 1
guard -> { max_uint < = fixnum_max } do
end
```
2018-02-27 15:21:25 -05:00
Custom guards are better than a simple `if` as they allow [mspec commands ](https://github.com/ruby/mspec/issues/30#issuecomment-312487779 ) to work properly.
2020-02-28 13:07:17 -05:00
#### Implementation-specific behaviors
2017-05-07 08:04:49 -04:00
In general, the usage of guards should be minimized as possible.
There are no guards to define implementation-specific behavior because
the Ruby Spec Suite defines common behavior and not implementation details.
Use the implementation test suite for these.
If an implementation does not support some feature, simply tag the related specs as failing instead.
2018-01-29 11:08:16 -05:00
### Shared Specs
2019-04-27 12:53:23 -04:00
Often throughout Ruby, identical functionality is used by different methods and modules. In order
2022-04-18 00:53:43 -04:00
to avoid duplication of specs, we have shared specs that are re-used in other specs. The use is a
2018-01-29 11:08:16 -05:00
bit tricky however, so let's go over it.
Commonly, if a shared spec is only reused within its own module, the shared spec will live within a
2019-04-27 12:53:23 -04:00
shared directory inside that module's directory. For example, the `core/hash/shared/key.rb` spec is
2018-01-29 11:08:16 -05:00
only used by `Hash` specs, and so it lives inside `core/hash/shared/` .
When a shared spec is used across multiple modules or classes, it lives within the `shared/` directory.
2019-04-27 12:53:23 -04:00
An example of this is the `shared/file/socket.rb` which is used by `core/file/socket_spec.rb` ,
2018-01-29 11:08:16 -05:00
`core/filetest/socket_spec.rb` , and `core/file/state/socket_spec.rb` and so it lives in the root `shared/` .
Defining a shared spec involves adding a `shared: true` option to the top-level `describe` block. This
2022-04-18 00:53:43 -04:00
will signal not to run the specs directly by the runner. Shared specs have access to two instance
2018-01-29 11:08:16 -05:00
variables from the implementor spec: `@method` and `@object` , which the implementor spec will pass in.
Here's an example of a snippet of a shared spec and two specs which integrates it:
2019-05-28 16:41:48 -04:00
```ruby
2018-01-29 11:08:16 -05:00
# core/hash/shared/key.rb
describe :hash_key_p, shared: true do
it "returns true if the key's matching value was false" do
{ xyz: false }.send(@method, :xyz).should == true
end
end
# core/hash/key_spec.rb
describe "Hash#key?" do
it_behaves_like :hash_key_p, :key?
end
# core/hash/include_spec.rb
describe "Hash#include?" do
it_behaves_like :hash_key_p, :include?
end
```
In the example, the first `describe` defines the shared spec `:hash_key_p` , which defines a spec that
2022-04-18 00:53:43 -04:00
calls the `@method` method with an expectation. In the implementor spec, we use `it_behaves_like` to
integrate the shared spec. `it_behaves_like` takes 3 parameters: the key of the shared spec, a method,
and an object. These last two parameters are accessible via `@method` and `@object` in the shared spec.
2018-01-29 11:08:16 -05:00
Sometimes, shared specs require more context from the implementor class than a simple object. We can address
2022-04-18 00:53:43 -04:00
this by passing a lambda as the method, which will have the scope of the implementor. Here's an example of
2018-01-29 11:08:16 -05:00
how this is used currently:
2019-05-28 16:41:48 -04:00
```ruby
2018-01-29 11:08:16 -05:00
describe :kernel_sprintf, shared: true do
it "raises TypeError exception if cannot convert to Integer" do
-> { @method .call("%b", Object.new) }.should raise_error(TypeError)
end
end
describe "Kernel#sprintf" do
it_behaves_like :kernel_sprintf, -> (format, *args) {
sprintf(format, *args)
}
end
describe "Kernel.sprintf" do
it_behaves_like :kernel_sprintf, -> (format, *args) {
Kernel.sprintf(format, *args)
}
end
```
In the above example, the method being passed is a lambda that triggers the specific conditions of the shared spec.
2017-05-07 08:04:49 -04:00
### Style
2018-01-29 11:08:16 -05:00
Do not leave any trailing space and follow the existing style.