benchmark 2016/05 続き

nashorn 8のotとnashorn 9のデフォルトではotがデフォルトで有効かどうかの差しかないのか調べるためにそれらを試す。
chakracoreは久しぶりに触ったので初期の頃のch.exeだとrelease buildで実行しようとするとdebugかtest云々というメッセージが出てくるだけで実行できなかったので(恐らく最適化が有効になっているはずなので)あらためてrelease buildを試す。

というわけで以下の組み合わせで試す。

  • nashorn 8でotアリとナシ
  • nashorn 9
  • chakracore debug buildとrelease build

ウォームアップ後の性能を見たかったのでbenchmarkはone shot版ではなくgameboyとBox2Dがない複数回試す版です。
このため、gameboyとBox2Dが極めて遅いnashornではこっちの方が結果が良くなっています。


結果としてはchakracoreは予想通り。
nashorn 9に関してはnashorn 8 + ot + alphaと言った感じ。色々変わっているのでhistory追わないと判らない。

nashorn 1.8.0_91-b14 (ot: false)

Run 1 out of 10:
Richards: 1024
DeltaBlue: 212
Crypto: 1373
RayTrace: 768
EarleyBoyer: 629
RegExp: 442
Splay: 953
SplayLatency: 1120
NavierStokes: 722
----
Score (version 9): 715

Run 2 out of 10:
Richards: 7173
DeltaBlue: 3934
Crypto: 3033
RayTrace: 10952
EarleyBoyer: 3551
RegExp: 475
Splay: 1524
SplayLatency: 762
NavierStokes: 1582
----
Score (version 9): 2425

Run 3 out of 10:
Richards: 5740
DeltaBlue: 7656
Crypto: 3841
RayTrace: 12802
EarleyBoyer: 5954
RegExp: 1036
Splay: 2363
SplayLatency: 1112
NavierStokes: 2206
----
Score (version 9): 3493

Run 4 out of 10:
Richards: 5052
DeltaBlue: 7802
Crypto: 2746
RayTrace: 12802
EarleyBoyer: 6308
RegExp: 1093
Splay: 4132
SplayLatency: 1299
NavierStokes: 2230
----
Score (version 9): 3648

Run 5 out of 10:
Richards: 5030
DeltaBlue: 7802
Crypto: 4256
RayTrace: 12654
EarleyBoyer: 5822
RegExp: 845
Splay: 2086
SplayLatency: 795
NavierStokes: 2192
----
Score (version 9): 3226

Run 6 out of 10:
Richards: 5094
DeltaBlue: 7809
Crypto: 4210
RayTrace: 12358
EarleyBoyer: 7355
RegExp: 1085
Splay: 3087
SplayLatency: 1067
NavierStokes: 2189
----
Score (version 9): 3664

Run 7 out of 10:
Richards: 5076
DeltaBlue: 7789
Crypto: 4407
RayTrace: 12259
EarleyBoyer: 7166
RegExp: 1068
Splay: 3577
SplayLatency: 1387
NavierStokes: 2226
----
Score (version 9): 3838

Run 8 out of 10:
Richards: 5083
DeltaBlue: 7802
Crypto: 4445
RayTrace: 12654
EarleyBoyer: 7555
RegExp: 1085
Splay: 3438
SplayLatency: 1371
NavierStokes: 2268
----
Score (version 9): 3871

Run 9 out of 10:
Richards: 5027
DeltaBlue: 7769
Crypto: 4439
RayTrace: 12654
EarleyBoyer: 8101
RegExp: 1093
Splay: 3333
SplayLatency: 1300
NavierStokes: 2247
----
Score (version 9): 3858

Run 10 out of 10:
Richards: 5112
DeltaBlue: 7828
Crypto: 4448
RayTrace: 12802
EarleyBoyer: 8394
RegExp: 1106
Splay: 3321
SplayLatency: 1361
NavierStokes: 2301
----
Score (version 9): 3923

nashorn 1.8.0_91-b14 (ot: true)

Run 1 out of 10:
Richards: 2694
DeltaBlue: 199
Crypto: 3056
RayTrace: 763
EarleyBoyer: 672
RegExp: 245
Splay: 674
SplayLatency: 715
NavierStokes: 9133
----
Score (version 9): 989

Run 2 out of 10:
Richards: 11438
DeltaBlue: 3359
Crypto: 1264
RayTrace: 1887
EarleyBoyer: 1236
RegExp: 362
Splay: 1116
SplayLatency: 826
NavierStokes: 1375
----
Score (version 9): 1551

Run 3 out of 10:
Richards: 13895
DeltaBlue: 4066
Crypto: 7369
RayTrace: 7770
EarleyBoyer: 1028
RegExp: 815
Splay: 2478
SplayLatency: 986
NavierStokes: 9943
----
Score (version 9): 3431

Run 4 out of 10:
Richards: 13934
DeltaBlue: 8166
Crypto: 10464
RayTrace: 13690
EarleyBoyer: 1168
RegExp: 876
Splay: 3553
SplayLatency: 1170
NavierStokes: 7018
----
Score (version 9): 4284

Run 5 out of 10:
Richards: 13552
DeltaBlue: 7848
Crypto: 13044
RayTrace: 13468
EarleyBoyer: 1172
RegExp: 729
Splay: 1365
SplayLatency: 644
NavierStokes: 6826
----
Score (version 9): 3577

Run 6 out of 10:
Richards: 13676
DeltaBlue: 7842
Crypto: 13108
RayTrace: 13468
EarleyBoyer: 1186
RegExp: 696
Splay: 1826
SplayLatency: 877
NavierStokes: 7123
----
Score (version 9): 3832

Run 7 out of 10:
Richards: 13344
DeltaBlue: 7425
Crypto: 13232
RayTrace: 13394
EarleyBoyer: 1168
RegExp: 654
Splay: 2663
SplayLatency: 1050
NavierStokes: 7011
----
Score (version 9): 4001

Run 8 out of 10:
Richards: 13605
DeltaBlue: 7941
Crypto: 13251
RayTrace: 12876
EarleyBoyer: 1186
RegExp: 1069
Splay: 3245
SplayLatency: 1357
NavierStokes: 9943
----
Score (version 9): 4653

Run 9 out of 10:
Richards: 14033
DeltaBlue: 8225
Crypto: 13263
RayTrace: 13394
EarleyBoyer: 1186
RegExp: 1048
Splay: 3402
SplayLatency: 1365
NavierStokes: 9943
----
Score (version 9): 4726

Run 10 out of 10:
Richards: 14025
DeltaBlue: 8271
Crypto: 13318
RayTrace: 13428
EarleyBoyer: 1188
RegExp: 1076
Splay: 3300
SplayLatency: 1333
NavierStokes: 10091
----
Score (version 9): 4727

nashorn 9-ea+111

Run 1 out of 10:
Richards: 3430
DeltaBlue: 307
Crypto: 3260
RayTrace: 699
EarleyBoyer: 559
RegExp: 493
Splay: 1183
SplayLatency: 1399
NavierStokes: 8914
----
Score (version 9): 1288

Run 2 out of 10:
Richards: 11971
DeltaBlue: 4073
Crypto: 3655
RayTrace: 5180
EarleyBoyer: 1525
RegExp: 476
Splay: 807
SplayLatency: 1643
NavierStokes: 1183
----
Score (version 9): 2166

Run 3 out of 10:
Richards: 13397
DeltaBlue: 4655
Crypto: 2496
RayTrace: 16946
EarleyBoyer: 6168
RegExp: 780
Splay: 782
SplayLatency: 2101
NavierStokes: 6872
----
Score (version 9): 3740

Run 4 out of 10:
Richards: 12861
DeltaBlue: 8708
Crypto: 9525
RayTrace: 16502
EarleyBoyer: 5777
RegExp: 787
Splay: 1684
SplayLatency: 1134
NavierStokes: 10091
----
Score (version 9): 4871

Run 5 out of 10:
Richards: 13464
DeltaBlue: 9217
Crypto: 14326
RayTrace: 17464
EarleyBoyer: 6582
RegExp: 957
Splay: 2179
SplayLatency: 2348
NavierStokes: 10240
----
Score (version 9): 6011

Run 6 out of 10:
Richards: 13065
DeltaBlue: 9276
Crypto: 14393
RayTrace: 17390
EarleyBoyer: 7254
RegExp: 987
Splay: 2828
SplayLatency: 1390
NavierStokes: 10388
----
Score (version 9): 5915

Run 7 out of 10:
Richards: 13032
DeltaBlue: 8331
Crypto: 14420
RayTrace: 16280
EarleyBoyer: 8795
RegExp: 1001
Splay: 2893
SplayLatency: 1410
NavierStokes: 10388
----
Score (version 9): 5961

Run 8 out of 10:
Richards: 13517
DeltaBlue: 8734
Crypto: 14420
RayTrace: 16280
EarleyBoyer: 8463
RegExp: 1014
Splay: 2974
SplayLatency: 951
NavierStokes: 10388
----
Score (version 9): 5761

Run 9 out of 10:
Richards: 13503
DeltaBlue: 8648
Crypto: 14423
RayTrace: 16788
EarleyBoyer: 8663
RegExp: 993
Splay: 901
SplayLatency: 925
NavierStokes: 10240
----
Score (version 9): 5034

Run 10 out of 10:
Richards: 13431
DeltaBlue: 8475
Crypto: 14402
RayTrace: 17168
EarleyBoyer: 8992
RegExp: 1021
Splay: 3092
SplayLatency: 2284
NavierStokes: 10388
----
Score (version 9): 6436

ChakraCore (a65f0debfd5c6d9097a7ed70afc3350511e262da) (debug build)

Run 1 out of 10:
Richards: 18590
DeltaBlue: 1223
Crypto: 14067
RayTrace: 1562
EarleyBoyer: 1482
RegExp: 220
Splay: 737
SplayLatency: 3279
NavierStokes: 32022
----
Score (version 9): 2855

Run 2 out of 10:
Richards: 15310
DeltaBlue: 1499
Crypto: 13385
RayTrace: 1505
EarleyBoyer: 1595
RegExp: 257
Splay: 695
SplayLatency: 3608
NavierStokes: 31312
----
Score (version 9): 2908

Run 3 out of 10:
Richards: 15875
DeltaBlue: 1584
Crypto: 13403
RayTrace: 1558
EarleyBoyer: 1600
RegExp: 261
Splay: 438
SplayLatency: 2603
NavierStokes: 31515
----
Score (version 9): 2710

Run 4 out of 10:
Richards: 14640
DeltaBlue: 1593
Crypto: 13599
RayTrace: 1558
EarleyBoyer: 1613
RegExp: 266
Splay: 404
SplayLatency: 2475
NavierStokes: 31281
----
Score (version 9): 2658

Run 5 out of 10:
Richards: 14611
DeltaBlue: 1365
Crypto: 13803
RayTrace: 1556
EarleyBoyer: 1603
RegExp: 265
Splay: 384
SplayLatency: 2359
NavierStokes: 31578
----
Score (version 9): 2588

Run 6 out of 10:
Richards: 14590
DeltaBlue: 1369
Crypto: 13794
RayTrace: 1557
EarleyBoyer: 1602
RegExp: 261
Splay: 420
SplayLatency: 2696
NavierStokes: 31726
----
Score (version 9): 2650

Run 7 out of 10:
Richards: 14965
DeltaBlue: 1587
Crypto: 13687
RayTrace: 1557
EarleyBoyer: 1610
RegExp: 266
Splay: 301
SplayLatency: 2120
NavierStokes: 31546
----
Score (version 9): 2537

Run 8 out of 10:
Richards: 15046
DeltaBlue: 1565
Crypto: 13550
RayTrace: 1556
EarleyBoyer: 1595
RegExp: 265
Splay: 429
SplayLatency: 2748
NavierStokes: 31631
----
Score (version 9): 2709

Run 9 out of 10:
Richards: 15042
DeltaBlue: 1562
Crypto: 13683
RayTrace: 1555
EarleyBoyer: 1607
RegExp: 265
Splay: 379
SplayLatency: 2343
NavierStokes: 31546
----
Score (version 9): 2628

Run 10 out of 10:
Richards: 14590
DeltaBlue: 1362
Crypto: 13791
RayTrace: 1554
EarleyBoyer: 1605
RegExp: 265
Splay: 428
SplayLatency: 2707
NavierStokes: 31609
----
Score (version 9): 2659

ChakraCore (a65f0debfd5c6d9097a7ed70afc3350511e262da) (release build)

Run 1 out of 10:
Richards: 25001
DeltaBlue: 23690
Crypto: 27702
RayTrace: 47424
EarleyBoyer: 37538
RegExp: 4459
Splay: 21783
SplayLatency: 31011
NavierStokes: 32171
----
Score (version 9): 24185

Run 2 out of 10:
Richards: 22766
DeltaBlue: 22044
Crypto: 27450
RayTrace: 47803
EarleyBoyer: 36530
RegExp: 4334
Splay: 11229
SplayLatency: 28263
NavierStokes: 32287
----
Score (version 9): 21703

Run 3 out of 10:
Richards: 22713
DeltaBlue: 21925
Crypto: 27369
RayTrace: 47581
EarleyBoyer: 36747
RegExp: 4334
Splay: 11637
SplayLatency: 28063
NavierStokes: 32319
----
Score (version 9): 21752

Run 4 out of 10:
Richards: 19564
DeltaBlue: 22024
Crypto: 27474
RayTrace: 47682
EarleyBoyer: 37548
RegExp: 4591
Splay: 12745
SplayLatency: 25463
NavierStokes: 32319
----
Score (version 9): 21593

Run 5 out of 10:
Richards: 19663
DeltaBlue: 21640
Crypto: 27497
RayTrace: 47581
EarleyBoyer: 37611
RegExp: 4428
Splay: 12827
SplayLatency: 27963
NavierStokes: 32287
----
Score (version 9): 21716

Run 6 out of 10:
Richards: 19522
DeltaBlue: 22011
Crypto: 27467
RayTrace: 47433
EarleyBoyer: 36460
RegExp: 4295
Splay: 10230
SplayLatency: 17468
NavierStokes: 32287
----
Score (version 9): 19973

Run 7 out of 10:
Richards: 19649
DeltaBlue: 21826
Crypto: 27388
RayTrace: 47534
EarleyBoyer: 37216
RegExp: 4295
Splay: 12340
SplayLatency: 19995
NavierStokes: 32319
----
Score (version 9): 20745

Run 8 out of 10:
Richards: 19596
DeltaBlue: 21892
Crypto: 27448
RayTrace: 47433
EarleyBoyer: 37290
RegExp: 4334
Splay: 12517
SplayLatency: 24519
NavierStokes: 32171
----
Score (version 9): 21270

Run 9 out of 10:
Richards: 19522
DeltaBlue: 21621
Crypto: 27477
RayTrace: 47433
EarleyBoyer: 36699
RegExp: 4321
Splay: 10855
SplayLatency: 21278
NavierStokes: 32319
----
Score (version 9): 20541

Run 10 out of 10:
Richards: 19296
DeltaBlue: 18209
Crypto: 23096
RayTrace: 40107
EarleyBoyer: 35178
RegExp: 4398
Splay: 12729
SplayLatency: 27431
NavierStokes: 32171
----
Score (version 9): 20222

JavaScript-C37.0

Run 1 out of 10:
Richards: 31747
DeltaBlue: 42097
Crypto: 28015
RayTrace: 80881
EarleyBoyer: 37723
RegExp: 2912
Splay: 21391
SplayLatency: 22253
NavierStokes: 30596
----
Score (version 9): 25673

Run 2 out of 10:
Richards: 30935
DeltaBlue: 38785
Crypto: 28412
RayTrace: 57645
EarleyBoyer: 36158
RegExp: 2895
Splay: 20324
SplayLatency: 23114
NavierStokes: 32351
----
Score (version 9): 24453

Run 3 out of 10:
Richards: 31076
DeltaBlue: 39082
Crypto: 27872
RayTrace: 58385
EarleyBoyer: 35932
RegExp: 2927
Splay: 20193
SplayLatency: 22837
NavierStokes: 32435
----
Score (version 9): 24439

Run 4 out of 10:
Richards: 31034
DeltaBlue: 39902
Crypto: 27661
RayTrace: 58681
EarleyBoyer: 35624
RegExp: 2892
Splay: 20136
SplayLatency: 23017
NavierStokes: 32351
----
Score (version 9): 24435

Run 5 out of 10:
Richards: 30925
DeltaBlue: 38441
Crypto: 27609
RayTrace: 53226
EarleyBoyer: 35495
RegExp: 2886
Splay: 20112
SplayLatency: 22573
NavierStokes: 32370
----
Score (version 9): 23988

Run 6 out of 10:
Richards: 30932
DeltaBlue: 39506
Crypto: 27595
RayTrace: 53427
EarleyBoyer: 35505
RegExp: 2915
Splay: 20071
SplayLatency: 22418
NavierStokes: 32435
----
Score (version 9): 24079

Run 7 out of 10:
Richards: 30967
DeltaBlue: 39347
Crypto: 27609
RayTrace: 53279
EarleyBoyer: 35461
RegExp: 2852
Splay: 20177
SplayLatency: 22746
NavierStokes: 29147
----
Score (version 9): 23773

Run 8 out of 10:
Richards: 31680
DeltaBlue: 39393
Crypto: 27823
RayTrace: 51873
EarleyBoyer: 35703
RegExp: 2830
Splay: 19993
SplayLatency: 22431
NavierStokes: 29176
----
Score (version 9): 23725

Run 9 out of 10:
Richards: 6806
DeltaBlue: 38725
Crypto: 27321
RayTrace: 51429
EarleyBoyer: 35552
RegExp: 2844
Splay: 19987
SplayLatency: 22731
NavierStokes: 29147
----
Score (version 9): 19929

Run 10 out of 10:
Richards: 6799
DeltaBlue: 38646
Crypto: 27791
RayTrace: 52561
EarleyBoyer: 35853
RegExp: 2892
Splay: 20128
SplayLatency: 22735
NavierStokes: 32319
----
Score (version 9): 20312

benchmark 2016/05

  • cpu: Pentium G3420
  • mem: 4 Giga byte
  • OS: win 10 Pro

上記の環境でmem消費 50%の状態を作り出しテストを実行。

ただし、OctaneのGameboyとBox2dの二つが複数回実行に対応するにはコードの変更が必要だったためOctaneだけは実行は一回のみとした。
つまり、rhinoのbenchmarkのようにn回実行して頭のm回を無視するような計測方法ではない。

このような測定のためすべてをスクリプトで書いてゲームループを長時間回すような用途よりアプリケーションに組み込んで利用したり、シェルスクリプトの代わりとして利用した場合の状況に近い。

また、rhinoがtyped arrayに対応したのでGameboyとBox2dを対象に含めたが、1.7R4では実行できたcode-loadが1.7.8-SNAPSHOTでは例外が投げられ実行できなかったのでこれを対象外とした。

sun-spiderに関しては以前と変わらず。ただし、nashornには少し前からバグがあるのでsun-spiderの一部が正しく実行できない。

さらにjava9でのrhinoの計測はjava8より結果が安定しないので対象外とした。java7に関してはシステムにインストールされていないため対象外とした。

以上。


流石にrhinoやnashornでも1G程度しかmemを食わないので倍の2Gも空いていたら影響はない模様。

しかし、octaneがone shotなのでスループット重視の最適化に頼りきっているnashornが性能を発揮できないらしい。gameboyやbox2dに関してはrhinoのインタプリタモードより結果が悪い始末。
ChakraCoreは元々最適化されたnashorn程度の性能しかないが、ウォームアップなしでもある程度の結果が出ている。

ChakraCoreとSpiderMonkeyが古いのは手元にそれしかないため。

Octane v2.0

ChakraCore (a65f0debfd5c6d9097a7ed70afc3350511e262da)

Richards: 18735
DeltaBlue: 1527
Crypto: 14943
RayTrace: 1600
EarleyBoyer: 1484
RegExp: 192
Splay: 835
SplayLatency: 3471
NavierStokes: 31609
Gameboy: 4461
Box2D: 1081
----
Score (version 9): 2810

JavaScript-C37.0

Richards: 30882
DeltaBlue: 41806
Crypto: 28188
RayTrace: 84581
EarleyBoyer: 37746
RegExp: 2944
Splay: 20585
SplayLatency: 16524
NavierStokes: 32222
Gameboy: 63254
Box2D: 51560
----
Score (version 9): 29006

JDK-1.8.0_91-b14 + rhino1.7.8-SNAPSHOT -opt 0 (compile mode; no optimize)

Richards: 385
DeltaBlue: 807
Crypto: 779
RayTrace: 874
EarleyBoyer: 1103
RegExp: 289
Splay: 1015
SplayLatency: 533
NavierStokes: 927
Gameboy: 1354
Box2D: 786
----
Score (version 9): 739

JDK-1.8.0_91-b14 + rhino1.7.8-SNAPSHOT -opt 2 (compile mode; opt level 2)

Richards: 522
DeltaBlue: 668
Crypto: 595
RayTrace: 881
EarleyBoyer: 1107
RegExp: 295
Splay: 903
SplayLatency: 524
NavierStokes: 1137
Gameboy: 1880
Box2D: 815
----
Score (version 9): 761

JDK-1.8.0_91-b14 + rhino1.7.8-SNAPSHOT -opt -1 (interpreter mode)

Richards: 64.1
DeltaBlue: 124
Crypto: 89.1
RayTrace: 332
EarleyBoyer: 326
RegExp: 185
Splay: 570
SplayLatency: 478
NavierStokes: 156
Gameboy: 660
Box2D: 464
----
Score (version 9): 244

nashorn 1.8.0_91-b14

Richards: 137
DeltaBlue: 308
Crypto: 1228
RayTrace: 356
EarleyBoyer: 652
RegExp: 547
Splay: 2129
SplayLatency: 812
NavierStokes: 2392
Gameboy: 395
Box2D: 149
----
Score (version 9): 557

nashorn 9-ea+111

Richards: 2621
DeltaBlue: 221
Crypto: 2957
RayTrace: 752
EarleyBoyer: 551
RegExp: 337
Splay: 742
SplayLatency: 1283
NavierStokes: 5361
Gameboy: 508
Box2D: 168
----
Score (version 9): 814

sunspider-0.9.1

ChakraCore (a65f0debfd5c6d9097a7ed70afc3350511e262da)

--------------------------------------------
Total:                  3219.7ms +-  0.7%
--------------------------------------------
  3d:                    569.7ms +-  2.7%
    cube:                251.7ms +- 11.5%
    morph:               116.1ms +- 36.1%
    raytrace:            201.9ms +-  4.0%
  access:                252.4ms +-  3.7%
    binary-trees:        113.1ms +-  4.8%
    fannkuch:             67.4ms +- 11.2%
    nbody:                50.7ms +- 17.1%
    nsieve:               21.1ms +-  5.3%
  bitops:                 46.4ms +- 24.1%
    3bit-bits-in-byte:     6.9ms +-  9.3%
    bits-in-byte:         10.4ms +-  4.7%
    bitwise-and:           6.9ms +-  5.1%
    nsieve-bits:          22.3ms +- 47.7%
  controlflow:            78.1ms +-  1.1%
    recursive:            78.1ms +-  1.1%
  crypto:                373.1ms +-  4.2%
    aes:                 185.4ms +-  7.4%
    md5:                 131.6ms +-  7.7%
    sha1:                 56.1ms +-  3.7%
  date:                  404.7ms +-  3.6%
    format-tofte:        156.9ms +-  5.8%
    format-xparb:        247.9ms +-  2.6%
  math:                   90.4ms +- 14.7%
    cordic:               17.4ms +-  2.8%
    partial-sums:         46.4ms +- 28.5%
    spectral-norm:        26.6ms +- 31.6%
  regexp:                 91.9ms +-  0.4%
    dna:                  91.9ms +-  0.4%
  string:               1312.9ms +-  1.2%
    base64:               84.9ms +-  0.8%
    fasta:               369.7ms +-  4.8%
    tagcloud:            255.4ms +-  4.7%
    unpack-code:         400.7ms +-  3.1%
    validate-input:      202.1ms +- 10.0%

JavaScript-C37.0

--------------------------------------------
Total:                   161.3ms +-  4.2%
--------------------------------------------
  3d:                     25.7ms +-  6.8%
    cube:                  8.4ms +-  5.9%
    morph:                 4.3ms +- 10.5%
    raytrace:             13.0ms +- 13.0%
  access:                 14.3ms +- 18.6%
    binary-trees:          2.7ms +- 25.8%
    fannkuch:              5.4ms +-  9.1%
    nbody:                 2.9ms +- 12.3%
    nsieve:                3.3ms +- 84.1%
  bitops:                  8.6ms +- 32.9%
    3bit-bits-in-byte:     1.6ms +- 143.8%
    bits-in-byte:          2.1ms +- 46.2%
    bitwise-and:           2.0ms +-  0.0%
    nsieve-bits:           2.9ms +- 12.3%
  controlflow:             2.0ms +-  0.0%
    recursive:             2.0ms +-  0.0%
  crypto:                 14.3ms +-  4.9%
    aes:                   6.9ms +-  5.1%
    md5:                   4.3ms +- 10.5%
    sha1:                  3.1ms +- 11.1%
  date:                   16.0ms +-  5.8%
    format-tofte:          6.6ms +-  7.5%
    format-xparb:          9.4ms +-  5.2%
  math:                   11.7ms +-  9.9%
    cordic:                2.1ms +- 16.3%
    partial-sums:          8.3ms +-  5.5%
    spectral-norm:         1.3ms +- 35.1%
  regexp:                  9.4ms +- 37.1%
    dna:                   9.4ms +- 37.1%
  string:                 59.3ms +-  4.4%
    base64:                5.3ms +-  8.5%
    fasta:                 5.9ms +- 10.9%
    tagcloud:             15.7ms +-  6.6%
    unpack-code:          24.9ms +-  3.4%
    validate-input:        7.6ms +-  6.5%

JDK-1.8.0_91-b14 + rhino1.7.8-SNAPSHOT -opt 0 (compile mode; no optimize)

--------------------------------------------
Total:                  1051.1ms +-  2.8%
--------------------------------------------
  3d:                    109.3ms +- 18.7%
    cube:                 20.0ms +- 34.9%
    morph:                53.6ms +- 14.2%
    raytrace:             35.7ms +- 50.5%
  access:                154.0ms +-  3.5%
    binary-trees:         20.0ms +- 34.9%
    fannkuch:             62.7ms +-  0.7%
    nbody:                29.0ms +- 18.3%
    nsieve:               42.3ms +- 16.9%
  bitops:                178.4ms +-  4.2%
    3bit-bits-in-byte:    19.9ms +- 35.6%
    bits-in-byte:         47.0ms +-  0.0%
    bitwise-and:          62.6ms +-  0.8%
    nsieve-bits:          49.0ms +- 10.9%
  controlflow:            11.1ms +- 63.4%
    recursive:            11.1ms +- 63.4%
  crypto:                 58.1ms +- 18.7%
    aes:                  24.7ms +- 30.6%
    md5:                  22.1ms +- 34.7%
    sha1:                 11.3ms +- 63.3%
  date:                   91.4ms +- 19.2%
    format-tofte:         40.1ms +- 28.1%
    format-xparb:         51.3ms +- 21.3%
  math:                   82.7ms +-  8.6%
    cordic:               29.0ms +- 18.3%
    partial-sums:         44.7ms +- 12.5%
    spectral-norm:         9.0ms +- 86.7%
  regexp:                149.4ms +-  5.1%
    dna:                 149.4ms +-  5.1%
  string:                216.6ms +-  7.2%
    base64:               35.6ms +- 19.5%
    fasta:                31.1ms +-  1.1%
    tagcloud:             62.9ms +- 13.2%
    unpack-code:          51.1ms +- 13.4%
    validate-input:       35.9ms +- 19.7%

JDK-1.8.0_91-b14 + rhino1.7.8-SNAPSHOT -opt 2 (compile mode; opt level 2)

--------------------------------------------
Total:                  1005.0ms +-  3.5%
--------------------------------------------
  3d:                    125.1ms +-  6.6%
    cube:                 44.6ms +- 22.9%
    morph:                46.9ms +-  0.7%
    raytrace:             33.7ms +- 16.1%
  access:                 96.0ms +- 18.0%
    binary-trees:         10.9ms +- 63.3%
    fannkuch:             44.9ms +- 11.7%
    nbody:                31.3ms +-  1.4%
    nsieve:                9.0ms +- 86.7%
  bitops:                149.6ms +-  9.5%
    3bit-bits-in-byte:    18.1ms +- 31.2%
    bits-in-byte:         38.0ms +- 19.8%
    bitwise-and:          62.1ms +-  0.6%
    nsieve-bits:          31.3ms +- 26.5%
  controlflow:             2.3ms +- 245.0%
    recursive:             2.3ms +- 245.0%
  crypto:                 47.0ms +-  0.0%
    aes:                  20.0ms +- 36.5%
    md5:                  15.9ms +-  2.2%
    sha1:                 11.1ms +- 63.4%
  date:                  104.9ms +- 22.2%
    format-tofte:         49.0ms +- 40.0%
    format-xparb:         55.9ms +- 20.9%
  math:                  107.1ms +-  9.2%
    cordic:               24.7ms +- 30.6%
    partial-sums:         55.6ms +- 13.4%
    spectral-norm:        26.9ms +- 25.6%
  regexp:                147.3ms +-  5.3%
    dna:                 147.3ms +-  5.3%
  string:                225.7ms +-  8.2%
    base64:               35.7ms +- 20.0%
    fasta:                40.3ms +- 18.6%
    tagcloud:             58.1ms +- 12.1%
    unpack-code:          58.0ms +- 12.0%
    validate-input:       33.6ms +- 16.4%

JDK-1.8.0_91-b14 + rhino1.7.8-SNAPSHOT -opt -1 (interpreter mode)

--------------------------------------------
Total:                  3223.3ms +-  0.4%
--------------------------------------------
  3d:                    404.0ms +-  1.4%
    cube:                138.6ms +-  4.0%
    morph:               145.0ms +-  5.0%
    raytrace:            120.4ms +-  6.0%
  access:                669.7ms +-  1.5%
    binary-trees:         55.9ms +- 14.3%
    fannkuch:            343.7ms +-  2.4%
    nbody:               149.6ms +-  5.2%
    nsieve:              120.6ms +-  5.8%
  bitops:                694.3ms +-  1.1%
    3bit-bits-in-byte:   118.4ms +-  6.4%
    bits-in-byte:        194.1ms +-  4.0%
    bitwise-and:         189.7ms +-  3.1%
    nsieve-bits:         192.0ms +-  3.6%
  controlflow:            64.9ms +-  8.3%
    recursive:            64.9ms +-  8.3%
  crypto:                247.7ms +-  2.3%
    aes:                 104.9ms +-  6.9%
    md5:                  64.4ms +-  8.6%
    sha1:                 78.4ms +-  0.6%
  date:                  151.9ms +-  4.9%
    format-tofte:         93.6ms +-  0.5%
    format-xparb:         58.3ms +- 12.8%
  math:                  394.7ms +-  1.9%
    cordic:              189.6ms +-  3.1%
    partial-sums:        127.1ms +-  4.1%
    spectral-norm:        78.0ms +-  0.0%
  regexp:                154.6ms +-  3.6%
    dna:                 154.6ms +-  3.6%
  string:                441.6ms +-  2.5%
    base64:               95.4ms +-  5.8%
    fasta:               114.1ms +-  6.0%
    tagcloud:             93.7ms +-  8.9%
    unpack-code:          69.3ms +- 11.3%
    validate-input:       69.0ms +- 11.3%

nashorn 1.8.0_91-b14

以下により測定不能

3bit-bits-in-byte:     0.0ms +-  NaN%
bits-in-byte:          0.0ms +-  NaN%

nashorn 9-ea+111

以下により測定不能

3bit-bits-in-byte:     0.0ms +-  NaN%
bits-in-byte:          0.0ms +-  NaN%
recursive:             0.0ms +-  NaN%