139 Commits

Author SHA1 Message Date
Naoto Ono
d9bff41637 Rename a variable name 2024-07-19 16:39:21 +09:00
Naoto Ono
09dd9a0457 Launchable: Aggregate test results based on file level 2024-07-19 16:39:21 +09:00
Nobuyoshi Nakada
690b56440b
Use File.write instead of Kernel#open 2024-07-09 13:01:44 +09:00
Naoto Ono
8ede84aa95 Move the file location of launchable.rb 2024-07-08 10:15:04 +09:00
Naoto Ono
5b78925455 Integrate Launchable into make btest 2024-07-08 10:15:04 +09:00
Koichi Sasada
30a8dbc861 maximum showing line number on btest failure
Some tests in btest uses long src for btest and it is harmful to
check the results. This patch introducing the limitation how many
lines of code is shown on failure.
2024-07-01 12:11:28 +09:00
Koichi Sasada
448efa90af respect RUBY_TEST_TIMEOUT_SCALE
GC benchmarks will spend long time with assertions so we need
to respect `RUBY_TEST_SUBPROCESS_TIMEOUT_SCALE` environment variable.

@nobu pointed out that now `RUBY_TEST_TIMEOUT_SCALE` is primary
(and `RUBY_TEST_SUBPROCESS_TIMEOUT_SCALE` was obsolete so check both
and will remove it later.
2024-06-10 13:32:14 +09:00
Matt Valentine-House
c90cb4d743 Fix pathes => paths typo in bootstrap test runner 2024-06-04 20:34:19 +01:00
Nobuyoshi Nakada
937cb1176d
Fix regexps for abbreviated options 2024-04-28 00:06:24 +09:00
Nobuyoshi Nakada
a0b4f0bcc9
Timeout scale in bootstraptest 2024-04-28 00:03:09 +09:00
Nobuyoshi Nakada
602193ded7
Timeout in bootstraptest 2024-04-28 00:02:33 +09:00
Alan Wu
478b4ef9de
Fix nil error with KNOWNBUGS.rb
Previously, `make test-knownbugs` crashed with `NoMethodError` due to
the failed regex match if there is a test case in KNOWNBUGS.rb.

The note about 1.8 compatibility is probably bogus as we require a way
more recent BASERUBY now.
2024-04-08 12:31:33 -04:00
Jean Boussier
91bf7eb274 Refactor frozen_string_literal check during compilation
In preparation for https://bugs.ruby-lang.org/issues/20205.

The `frozen_string_literal` compilation option will no longer
be a boolean but a tri-state: `on/off/default`.
2024-03-15 15:52:33 +01:00
Jean Boussier
09d8c99cdc Ensure test suite is compatible with --frozen-string-literal
As preparation for https://bugs.ruby-lang.org/issues/20205
making sure the test suite is compatible with frozen string
literals is making things easier.
2024-03-14 17:56:15 +01:00
Peter Zhu
7ac74f5c77 Revert "Skip a failing test for Prism"
This reverts commit 557b69e83b27dafea435719fc3afc2e67e155962.
2024-01-23 15:23:48 -05:00
Takashi Kokubun
557b69e83b Skip a failing test for Prism
This should be reverted once https://github.com/ruby/prism/issues/2249
is closed.
2024-01-23 11:00:05 -08:00
Takashi Kokubun
2918e43dee Skip a flaky Ractor test for YJIT
`[BUG] pthread_mutex_lock: Invalid argument (EINVAL)` doesn't seem like
a fault of YJIT?

https://github.com/ruby/ruby/actions/runs/7614455181/job/20736754975
https://github.com/ruby/ruby/actions/runs/7615316673/job/20739572487
2024-01-22 10:31:21 -08:00
Takashi Kokubun
78b27ce62a RJIT: Streamline RJIT enablement check
in bootstrap tests so that `make btest-bruby` skips the right tests.
2023-12-21 14:32:03 -08:00
Koichi Sasada
9b4cb69a88 support skip in bootstraptest 2023-12-16 01:00:01 +09:00
Takashi Kokubun
7f696b8859 Remove a warning in bootstraptest/runner.rb
../bootstraptest/runner.rb:121: warning: assigned but unused variable - e
2023-03-19 21:02:21 -07:00
Takashi Kokubun
2e875549a9 s/MJIT/RJIT/ 2023-03-06 23:44:01 -08:00
Nobuyoshi Nakada
b02b8e7756
Let other test runners follow the change of GNU make 4.4 jobserver 2022-11-07 10:08:30 +09:00
Nobuyoshi Nakada
88c12a2937
Indent folded bootstraptest dots 2022-10-01 18:53:41 +09:00
Nobuyoshi Nakada
942066713b
bootstraptest/runner: run in parallel if in parallel build 2022-09-29 14:09:25 +09:00
Nobuyoshi Nakada
09bce061af bootstraptest/runner: manage sub processes with the job server 2022-09-28 23:18:55 +09:00
Nobuyoshi Nakada
fc54dbe8b4 bootstraptest/runner: fold dots by window size 2022-09-28 23:18:55 +09:00
Nobuyoshi Nakada
12e5e5b573
Fix the option name in the error message [ci skip] 2022-09-19 14:15:13 +09:00
Nobuyoshi Nakada
c8b414b334
Reuse -v option result as target_platform
Backticks method invokes `/bin/sh` when the command contains
quotes, and `sh` clears some environment variables set in
runruby.rb to search the built shared library.
2022-02-17 20:12:38 +09:00
Koichi Sasada
fdf0f8d814 btest-ruby OPTS=-v should disable quiet
`make btest-ruby` is run with -q (quiet) option and -v should
remove -q option.
2022-02-17 18:58:37 +09:00
Koichi Sasada
603ab70961 support concurrent btest execution
* `-j` option for concurrent test with threads
  * `-jN` uses N threads
  * `-j` uses nproc/2 threads
* Introduce `BT` struct to manage configurations
* Introduce `Assertion` to manage all assertions
* Remove all toplevel instance variables
* Show elapsed seconds at last

```
$ time make btest
...
real    0m37.319s
user    0m26.221s
sys     0m16.534s

$ time make btest TESTOPTS=-j
...
real    0m11.812s
user    0m36.667s
sys     0m21.872s
```
2022-02-06 03:05:47 +09:00
Koichi Sasada
e953d68657 refactoring btest output
don't duplicate the message, but prepare `out` var to choose
stdout/err.
2022-01-26 09:56:27 +09:00
Koichi Sasada
5e3a320218 respect --quiet option for btest
Do not print anymore except errors.
2022-01-21 17:38:11 +09:00
Yuta Saito
dd99ee1f7d [wasm] bootstraptest, basictest: disable backquote literal tests
WASI doesn't support spawning a new process for now.
2022-01-19 11:19:06 +09:00
Takashi Kokubun
1a63468831
Prepare for removing RubyVM::JIT (#5262) 2021-12-13 23:07:46 -08:00
Takashi Kokubun
e1fee7f949
Rename RubyVM::MJIT to RubyVM::JIT
because the name "MJIT" is an internal code name, it's inconsistent with
--jit while they are related to each other, and I want to discourage future
JIT implementation-specific (e.g. MJIT-specific) APIs by this rename.

[Feature #17490]
2021-01-13 22:46:51 -08:00
Takashi Kokubun
aacd2295d0
Debug the command used for gdb dump
It's not working
http://ci.rvm.jp/results/trunk-mjit@phosphorus-docker/3288206. I'm
debugging why.
2020-12-13 23:35:29 -08:00
Takashi Kokubun
8d83334a69
@ruby is the target Ruby in bootstraptest 2020-12-13 23:33:59 -08:00
Takashi Kokubun
246d7e4f1d
Dump a backtrace with gdb
Because Ruby often fails to dump a C backtrace.
2020-12-12 18:46:24 -08:00
Takashi Kokubun
4439b78336
Save a core file from bootstraptest 2020-12-10 21:36:48 -08:00
Benoit Daloze
b4ec4a41c2 Guard all accesses to RubyVM::MJIT with defined?(RubyVM::MJIT) &&
* Otherwise those tests, etc cannot run on alternative Ruby implementations.
2020-12-04 16:45:54 +01:00
Koichi Sasada
ed22bf47cc display stderr output even if core dump files
On btest, stderr messages are not displayed if core files are
generated. There is no reason to skip it, so this patch display
stderr and check core files.
2020-07-29 18:45:39 +09:00
Nobuyoshi Nakada
c2428b8bf6
Erase only on tty 2019-07-29 23:05:41 +09:00
Nobuyoshi Nakada
f47254d216
colors file has been moved from test to tool 2019-07-02 09:19:38 +09:00
Nobuyoshi Nakada
7f4f40ab31
bootstraptest/runner.rb (show_limit): defer messages unless verbose and a tty 2019-07-01 17:09:08 +09:00
Nobuyoshi Nakada
fe03bbaf34
bootstraptest/runner.rb (show_limit): show dots only when printing to a tty 2019-07-01 10:16:47 +09:00
git
cbe06cd350 * remove trailing spaces, expand tabs. 2019-06-19 17:39:58 +09:00
Samuel Williams
69195fd9b2 Show thread and fiber limits as part of bootstrap tests. 2019-06-19 20:39:10 +12:00
ko1
07298ea209 support btest on older ruby.
* bootstraptest/runner.rb (assert_normal_exit): check MJIT first
  to support btest with ruby ~2.5. btest (bootstraptest) should be
  enable to run with stable ruby interpreter because modified ruby
  may not able to run runner.rb and we need to know why (this is why
  we introduce btest).


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@66842 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2019-01-17 01:36:21 +00:00
shyouhei
bc64df876e delete emacs mode lines [ci skip]
These settings are now covered by .dir-locals.el.


git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@66584 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2018-12-27 06:12:09 +00:00
k0kubun
03bf85f28d bootstraptest/runner.rb: increase timeout for --jit-wait
because test_io.rb:33 randomly fails
http://ci.rvm.jp/results/trunk-mjit-wait@silicon-docker/1519055

checking MJIT.enabled? on driver might not make sense for target, but as
long as the CI is -DMJIT_FORCE_ENABLE, I believe it works for now.

git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@66344 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
2018-12-12 00:38:49 +00:00