1
0
Fork 0
mirror of https://github.com/ruby/ruby.git synced 2022-11-09 12:17:21 -05:00
ruby--ruby/test/ruby
Eileen M. Uchitelle 473ee328c5
Add ability to trace exit locations in yjit (#5970)
When running with `--yjit-stats` turned on, yjit can inform the user
what the most common exits are. While this is useful information it
doesn't tell you the source location of the code that exited or what the
code that exited looks like. This change intends to fix that.

To use the feature, run yjit with the `--yjit-trace-exits` option,
which will record the backtrace for every exit that occurs. This functionality
requires the stats feature to be turned on. Calling `--yjit-trace-exits`
will automatically set the `--yjit-stats` option.

Users must call `RubyVM::YJIT.dump_exit_locations(filename)` which will
Marshal dump the contents of `RubyVM::YJIT.exit_locations` into a file
based on the passed filename.

*Example usage:*

Given the following script, we write to a file called
`concat_array.dump` the results of `RubyVM::YJIT.exit_locations`.

```ruby
def concat_array
  ["t", "r", *x = "u", "e"].join
end

1000.times do
  concat_array
end

RubyVM::YJIT.dump_exit_locations("concat_array.dump")
```

When we run the file with this branch and the appropriate flags the
stacktrace will be recorded. Note Stackprof needs to be installed or you
need to point to the library directly.

```
./ruby --yjit --yjit-call-threshold=1 --yjit-trace-exits -I/Users/eileencodes/open_source/stackprof/lib test.rb
```

We can then read the dump file with Stackprof:

```
./ruby -I/Users/eileencodes/open_source/stackprof/lib/ /Users/eileencodes/open_source/stackprof/bin/stackprof --text concat_array.dump
```

Results will look similar to the following:

```
==================================
  Mode: ()
  Samples: 1817 (0.00% miss rate)
  GC: 0 (0.00%)
==================================
     TOTAL    (pct)     SAMPLES    (pct)     FRAME
      1001  (55.1%)        1001  (55.1%)     concatarray
       335  (18.4%)         335  (18.4%)     invokeblock
       178   (9.8%)         178   (9.8%)     send
       140   (7.7%)         140   (7.7%)     opt_getinlinecache
       ...etc...
```

Simply inspecting the `concatarray` method will give `SOURCE
UNAVAILABLE` because the source is insns.def.

```
./ruby -I/Users/eileencodes/open_source/stackprof/lib/ /Users/eileencodes/open_source/stackprof/bin/stackprof --text concat_array.dump --method concatarray
```

Result:

```
concatarray (nonexistent.def:1)
  samples:  1001 self (55.1%)  /   1001 total (55.1%)
  callers:
    1000  (   99.9%)  Object#concat_array
       1  (    0.1%)  Gem.suffixes
  callees (0 total):
  code:
        SOURCE UNAVAILABLE
```

However if we go deeper to the callee we can see the exact
source of the `concatarray` exit.

```
./ruby -I/Users/eileencodes/open_source/stackprof/lib/ /Users/eileencodes/open_source/stackprof/bin/stackprof --text concat_array.dump --method Object#concat_array
```

```
Object#concat_array (/Users/eileencodes/open_source/rust_ruby/test.rb:1)
  samples:     0 self (0.0%)  /   1000 total (55.0%)
  callers:
    1000  (  100.0%)  block in <main>
  callees (1000 total):
    1000  (  100.0%)  concatarray
  code:
                                  |     1  | def concat_array
 1000   (55.0%)                   |     2  |   ["t", "r", *x = "u", "e"].join
                                  |     3  | end
```

The `--walk` option is recommended for this feature as it make it
easier to traverse the tree of exits.

*Goals of this feature:*

This feature is meant to give more information when working on YJIT.
The idea is that if we know what code is exiting we can decide what
areas to prioritize when fixing exits. In some cases this means adding
prioritizing avoiding certain exits in yjit. In more complex cases it
might mean changing the Ruby code to be more performant when run with
yjit. Ultimately the more information we have about what code is exiting
AND why, the better we can make yjit.

*Known limitations:*

* Due to tracing exits, running this on large codebases like Rails
can be quite slow.
* On complex methods it can still be difficult to pinpoint the exact cause of
an exit.
* Stackprof is a requirement to to view the backtrace information from
the dump file.

Co-authored-by: Aaron Patterson <tenderlove@ruby-lang.org>

Co-authored-by: Aaron Patterson <tenderlove@ruby-lang.org>
2022-06-09 12:59:39 -04:00
..
enc Avoid defining the same test class in multiple files 2022-04-22 15:00:16 -07:00
allpairs.rb
beginmainend.rb
bug-11928.rb
bug-13526.rb
lbtest.rb
marshaltestlib.rb [WIP] add error_squiggle gem 2021-06-29 23:45:49 +09:00
sentence.rb
test_alias.rb Fix visibility of alias of zsuper methods 2022-03-10 08:35:26 -08:00
test_argf.rb Use omit instead of skip: test/ruby/**/*.rb 2022-01-04 17:25:30 +09:00
test_arithmetic_sequence.rb
test_arity.rb Make a dedecated assertion to clarify failed assertions 2022-03-19 14:33:04 +09:00
test_array.rb Add missing write barriers to Array#replace 2022-04-28 11:31:22 -04:00
test_assignment.rb test/ruby/test_assignment.rb: Prevent a warning 2022-01-19 13:15:37 +09:00
test_ast.rb pend some tests while using to_binary 2022-01-31 03:47:03 +09:00
test_autoload.rb Fix Module#const_source_location for autoload constants with direct requires 2022-06-06 11:12:55 -07:00
test_backtrace.rb Add Thread.each_caller_location 2022-02-17 08:54:07 -08:00
test_basicinstructions.rb
test_beginendblock.rb
test_bignum.rb Fix the condition when a new buffer is needed without GMP 2022-06-02 10:29:53 +09:00
test_call.rb
test_case.rb Avoid improper optimization of case statements mixed integer/rational/complex 2021-05-12 19:30:05 -07:00
test_class.rb Remove Class#descendants 2021-12-20 11:02:15 -08:00
test_clone.rb
test_comparable.rb
test_complex.rb
test_complex2.rb Use omit instead of skip: test/ruby/**/*.rb 2022-01-04 17:25:30 +09:00
test_complexrational.rb Use omit instead of skip: test/ruby/**/*.rb 2022-01-04 17:25:30 +09:00
test_condition.rb
test_const.rb
test_continuation.rb
test_default_gems.rb Use omit instead of skip: test/ruby/**/*.rb 2022-01-04 17:25:30 +09:00
test_defined.rb Add more tests for defined? with method calls 2021-03-29 07:45:15 -07:00
test_dir.rb Use omit instead of skip: test/ruby/**/*.rb 2022-01-04 17:25:30 +09:00
test_dir_m17n.rb
test_econv.rb Fix some typos by spell checker 2021-04-26 10:07:41 +09:00
test_encoding.rb Fix a failure 2021-02-16 18:17:09 +09:00
test_enum.rb Raise ArgumentError when calling Enumberable#inject without block or arguments 2022-03-23 07:55:49 -07:00
test_enumerator.rb Use capture_output instead of capture_io 2021-09-13 21:14:42 +09:00
test_env.rb ENV ivars should not be accessible from ractors 2021-12-17 15:46:50 +09:00
test_eval.rb Lazily create singletons on instance_{exec,eval} (#5146) 2021-12-02 15:53:39 -08:00
test_exception.rb Revert "error.c: Let Exception#inspect inspect its message" 2022-06-07 11:52:44 +09:00
test_fiber.rb rb_fiber_terminate must not return [Bug #18497] 2022-01-19 19:57:16 +09:00
test_file.rb Use omit instead of skip: test/ruby/**/*.rb 2022-01-04 17:25:30 +09:00
test_file_exhaustive.rb Skip failing test with freebsd 2022-05-30 18:40:31 +09:00
test_fixnum.rb
test_flip.rb
test_float.rb Fix dtoa buffer overrun 2022-04-12 21:30:49 +09:00
test_fnmatch.rb
test_frozen_error.rb
test_gc.rb Add key force_major_gc_count to GC.stat_heap 2022-06-08 10:03:00 -04:00
test_gc_compact.rb Move GC.verify_compaction_references [Bug #18779] 2022-06-02 15:32:00 +09:00
test_hash.rb st.c: Do not clear entries_bound when calling Hash#shift for empty hash 2022-02-10 00:14:27 +09:00
test_ifunless.rb
test_inlinecache.rb Avoid defining the same test class in multiple files 2022-04-22 15:00:16 -07:00
test_insns_leaf.rb [Bug #17880] Set leaf false on opt_setinlinecache (#4565) 2021-06-14 17:34:57 -07:00
test_integer.rb Don't call + and < in Integer.times for !FIXNUM 2021-12-01 16:21:50 -08:00
test_integer_comb.rb
test_io.rb Stop ignoring 4th positional argument to IO.#{foreach,readlines} 2022-06-09 08:22:06 -07:00
test_io_buffer.rb Fix the order of assert_eqaul and remove unused variables 2022-05-10 10:15:27 +09:00
test_io_m17n.rb
test_iseq.rb Use omit instead of skip: test/ruby/**/*.rb 2022-01-04 17:25:30 +09:00
test_iterator.rb
test_key_error.rb
test_keyword.rb test/ruby/test_keyword.rb: Prevent warning: assigned but unused variable 2022-04-11 10:05:16 +09:00
test_lambda.rb test/ruby/test_lambda.rb: Remove "warning: assigned but unused variable" 2021-04-04 15:26:09 +09:00
test_lazy_enumerator.rb Fix lazy enumerator with index size 2021-05-27 14:17:32 -07:00
test_literal.rb Use to_s and puts in tests 2021-12-16 15:12:12 +09:00
test_m17n.rb Use omit instead of skip: test/ruby/**/*.rb 2022-01-04 17:25:30 +09:00
test_m17n_comb.rb Add test for String#casecmp? 2021-01-24 15:57:13 +09:00
test_marshal.rb test/ruby/test_marshal.rb: Prevent "assigned but unused variable" warning 2021-10-25 20:43:42 +09:00
test_math.rb Add domain check macros 2021-07-04 22:15:59 +09:00
test_memory_view.rb
test_metaclass.rb
test_method.rb Make define_singleton_method always define a public method 2022-03-29 12:10:13 -07:00
test_method_cache.rb invalidate negative cache any time. 2021-02-19 16:54:31 +09:00
test_mixed_unicode_escapes.rb
test_mjit.rb Fix MJIT's ISEQ_BODY macro usage at 5f10bd634f 2022-06-08 22:39:18 -07:00
test_mjit_debug.rb Rename test_jit to test_mjit 2022-05-20 21:32:55 -07:00
test_module.rb Add Module#undefined_instance_methods 2022-06-06 09:57:32 -07:00
test_name_error.rb Prevent "warning: ambiguity between regexp and two divisions" 2021-06-30 13:41:18 +09:00
test_nomethod_error.rb [WIP] add error_squiggle gem 2021-06-29 23:45:49 +09:00
test_not.rb
test_numeric.rb Use Rational for Float#round with ndigits > 14 2021-08-06 15:03:51 -07:00
test_object.rb [WIP] add error_squiggle gem 2021-06-29 23:45:49 +09:00
test_objectspace.rb Fix typos 2021-11-02 19:17:37 +09:00
test_optimization.rb Use omit instead of skip: test/ruby/**/*.rb 2022-01-04 17:25:30 +09:00
test_pack.rb Add a test for bug 18343 2021-11-16 19:28:45 -08:00
test_parse.rb Private local variables should shadow outer variables [Bug #18629] 2022-04-21 16:04:36 +09:00
test_path.rb
test_pattern_matching.rb Find pattern is no longer experimental [Feature #18585] 2022-02-19 18:45:49 +09:00
test_pipe.rb
test_primitive.rb
test_proc.rb Raise RuntimeError if Kernel#binding is called from a non-Ruby frame 2022-04-06 19:14:03 -07:00
test_process.rb Use omit instead of skip: test/ruby/**/*.rb 2022-01-04 17:25:30 +09:00
test_rand.rb Remove deprecated Random::DEFAULT [Feature #17351] 2022-01-01 18:55:52 +09:00
test_random_formatter.rb [ruby/securerandom] Use String#unpack1 2021-12-14 11:59:22 +09:00
test_range.rb Fix Range#cover? returning true for beginless ranges of different types 2022-06-06 09:59:22 -07:00
test_rational.rb test_cdhash: refactor change class 2021-05-12 10:30:46 +09:00
test_rational2.rb
test_readpartial.rb
test_refinement.rb Remove Refinement#{extend_object,append_features,prepend_features} 2022-01-05 10:59:03 -08:00
test_regexp.rb Ignore invalid escapes in regexp comments 2022-06-06 13:50:03 -07:00
test_require.rb Skip failing test with freebsd 2022-05-31 11:40:38 +09:00
test_require_lib.rb Use omit instead of skip: test/ruby/**/*.rb 2022-01-04 17:25:30 +09:00
test_rubyoptions.rb Rename test_jit to test_mjit 2022-05-20 21:32:55 -07:00
test_rubyvm.rb Finer-grained constant cache invalidation (take 2) 2022-04-01 14:48:22 -04:00
test_rubyvm_mjit.rb Make the test class naming consistent 2022-05-20 21:34:47 -07:00
test_settracefunc.rb Fix use-after-free with interacting TracePoints 2022-05-30 13:54:22 -04:00
test_signal.rb Do not create core file if it is intentional abort 2022-01-19 23:17:14 +09:00
test_sleep.rb
test_sprintf.rb [Feature #18290] Remove tests that test use of rb_gc_force_recycle 2021-11-08 15:39:53 -05:00
test_sprintf_comb.rb
test_stack.rb
test_string.rb Add String#bytesplice 2022-03-18 11:51:03 +09:00
test_stringchar.rb
test_struct.rb A positional Hash is not keyword arguments [Bug #18632] 2022-03-17 20:53:41 +09:00
test_super.rb Add tests for cme NULL crash 2021-11-17 13:20:31 -05:00
test_symbol.rb
test_syntax.rb Fix using anonymous block in method accepting explicit keywords 2022-04-05 07:35:25 -07:00
test_system.rb
test_thread.rb Skip failing test with freebsd 2022-05-30 10:53:45 +09:00
test_thread_cv.rb Reap rarely leaked threads 2021-10-14 22:57:45 +09:00
test_thread_queue.rb Also skip failing test with freebsd 12 2022-05-30 14:28:32 +09:00
test_threadgroup.rb
test_time.rb Decouple GC slot sizes from RVALUE 2022-02-02 09:52:04 -05:00
test_time_tz.rb Use omit instead of skip: test/ruby/**/*.rb 2022-01-04 17:25:30 +09:00
test_trace.rb
test_transcode.rb - add regression tests for U+6E7F (湿) in ISO-2022-JP 2021-07-01 17:33:43 +09:00
test_undef.rb Lazily create singletons on instance_{exec,eval} (#5146) 2021-12-02 15:53:39 -08:00
test_unicode_escape.rb
test_variable.rb Remove cvar overtaken classes at end of test methods 2021-03-10 12:09:45 -08:00
test_vm_dump.rb Use omit instead of skip: test/ruby/**/*.rb 2022-01-04 17:25:30 +09:00
test_weakmap.rb Weakmap failure is still pending 2022-01-16 22:43:04 +09:00
test_whileuntil.rb
test_yield.rb
test_yjit.rb Rename test_jit to test_mjit 2022-05-20 21:32:55 -07:00
test_yjit_exit_locations.rb Add ability to trace exit locations in yjit (#5970) 2022-06-09 12:59:39 -04:00
ut_eof.rb