Supermicro SuperServer SYS-681E-TR 1158127 SPECjbb2015-MultiJVM max-jOPS
809747 SPECjbb2015-MultiJVM critical-jOPS
Tested by: Supermicro Test Sponsor: Supermicro Test location: San Jose, California Test date: Dec 19, 2023
SPEC license #: 001176 Hardware Availability: Jan-2023 Software Availability: Oct-2023 Publication: Fri Jan 26 09:12:15 EST 2024
Benchmark Results Summary
 
Overall Throughput RT curve
Overall SUT (System Under Test) Description
VendorSupermicro
Vendor URLhttps://www.supermicro.com
System SourceSingle Supplier
System DesignationServer Rack
Total Systems1
All SUT Systems IdenticalYES
Total Nodes1
All Nodes IdenticalYES
Nodes Per System1
Total Chips8
Total Cores480
Total Threads960
Total Memory Amount (GB)2048
Total OS Images1
SW EnvironmentNon-virtual
 
Hardware hw_1
NameSuperServer SYS-681E-TR
VendorSupermicro
Vendor URLhttps://www.supermicro.com
AvailableOct-2023
ModelX13OEI-CPU
Form Factor6U
CPU NameIntel Xeon Platinum 8490H
CPU Characteristics60 Core, 1.90 GHz, 112.5 MB L3 Cache (Turbo Boost Technology up to 3.50 GHz)
Number of Systems1
Nodes Per System1
Chips Per System8
Cores Per System480
Cores Per Chip60
Threads Per System960
Threads Per Core120
Version1.0b 10/16/2023
CPU Frequency (MHz)1900
Primary Cache32 KB(I) + 48 KB(D) per core
Secondary Cache2 MB (I+D) per core
Tertiary Cache112.5 MB (I+D) on chip per chip
Other CacheNone
Disk1 x 480 GB M.2 NVMe SSD
File Systemxfs
Memory Amount (GB)2048
# and size of DIMM(s)32 x 64 GB
Memory DetailsMicron 64 GB 4Gbx4 PC5-4800 MTC40F2046S1RC48BA1
# and type of Network Interface Cards (NICs)2 x 10 Gbit NICs
Power Supply Quantity and Rating (W)4 x PWS-2K63A-1R
Other HardwareNone
Cabinet/Housing/EnclosureNone
Shared DescriptionNone
Shared CommentNone
Notes
  • NA: The test sponsor attests, as of date of publication, that CVE-2017-5754 (Meltdown) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5753 (Spectre variant 1) is mitigated in the system as tested and documented.
  • Yes: The test sponsor attests, as of date of publication, that CVE-2017-5715 (Spectre variant 2) is mitigated in the system as tested and documented.
Other Hardware network_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Operating System os_1
NameUbuntu 22.04.3 LTS server-amd64
VendorUbuntu
Vendor URLhttps://ubuntu.com/
Version5.15.0-89-generic
AvailableAug-2023
Bitness64
NotesNone
Java Virtual Machine jvm_1
NameOracle Java SE 17.0.9
VendorOracle
Vendor URLhttp://www.oracle.com/
VersionJava HotSpot 64-bit Server VM, version 17.0.9
AvailableOct-2023
Bitness64
Notesnote
Other Software other_1
NameNone
VendorNone
Vendor URLNone
VersionNone
AvailableNone
BitnessNone
NotesNone
Hardware
OS Images os_Image_1(1)
Hardware Description hw_1
Number of Systems 1
SW Environment non-virtual
Tuning

BIOS Settings:

  • Intel HT Technology=Enable
  • Hardware Prefetcher=Enabled
  • Turbo Mode=Enable
  • SNC=AUTO
  • Power Performance Tuning=BIOS Controls EPB
  • ENERGY_PERF_BIAS_CFG mode=Maximum Performance

Notes None
OS Image os_Image_1
JVM Instances jvm_Ctr_1(1), jvm_Backend_1(16), jvm_TxInjector_1(16)
OS Image Description os_1
Tuning

  • cpupower -c all frequency-set -g performance
  • tuned-adm profile throughput-performance

  • ulimit -n 1024000
  • UserTasksMax=970000
  • DefaultTasksMax=970000
  • echo always > /sys/kernel/mm/transparent_hugepage/defrag
  • echo always > /sys/kernel/mm/transparent_hugepage/enabled
  • echo 10 > /proc/sys/vm/swappiness
  • echo 10 > /proc/sys/vm/dirty_background_ratio
  • echo 40 > /proc/sys/vm/dirty_ratio
  • echo 1500 > /proc/sys/vm/dirty_writeback_centisecs
  • echo 10000 > /proc/sys/vm/dirty_expire_centisecs

Notes None
JVM Instance jvm_Ctr_1
Parts of Benchmark Controller
JVM Instance Description jvm_1
Command Line

-Xms2g -Xmx2g -Xmn1536m -XX:+UseParallelGC -XX:ParallelGCThreads=2 -XX:CICompilerCount=4

Tuning

Used numactl to interleave memory on all CPUs

  • numactl --interleave=all

Notes None
JVM Instance jvm_Backend_1
Parts of Benchmark Backend
JVM Instance Description jvm_1
Command Line

-Xms240g -Xmx240g -Xmn220g -server -XX:MetaspaceSize=512m -XX:AllocatePrefetchInstr=2 -XX:-UsePerfData -XX:-UseAdaptiveSizePolicy -XX:+AlwaysPreTouch -XX:+UseParallelGC -XX:SurvivorRatio=100 -XX:TargetSurvivorRatio=95 -XX:ParallelGCThreads=60 -XX:MaxTenuringThreshold=15 -XX:InitialCodeCacheSize=25m -XX:InlineSmallCode=10k -XX:MaxGCPauseMillis=200 -XX:+UseCompressedOops -XX:ObjectAlignmentInBytes=32 -XX:+UseTransparentHugePages -XX:TLABAllocationWeight=55 -XX:ThreadStackSize=512 -XX:CompileThresholdScaling=120 -XX:UseAVX=0

Tuning

Used numactl to affinitize one Backend JVM to one NUMA node

    • Group1: numactl --cpunodebind=0 --localalloc
    • Group2:numactl --cpunodebind=1 --localalloc
    • Group3:numactl --cpunodebind=2 --localalloc
    • Group4:numactl --cpunodebind=3 --localalloc
    • Group5:numactl --cpunodebind=4 --localalloc
    • Group6:numactl --cpunodebind=5 --localalloc
    • Group7:numactl --cpunodebind=6 --localalloc
    • Group8:numactl --cpunodebind=7 --localalloc
    • Group9:numactl --cpunodebind=8 --localalloc
    • Group10:numactl --cpunodebind=9 --localalloc
    • Group11:numactl --cpunodebind=10 --localalloc
    • Group12:numactl --cpunodebind=11 --localalloc
    • Group13:numactl --cpunodebind=12 --localalloc
    • Group14:numactl --cpunodebind=13 --localalloc
    • Group15:numactl --cpunodebind=14 --localalloc
    • Group15:numactl --cpunodebind=15 --localalloc

Notes None
JVM Instance jvm_TxInjector_1
Parts of Benchmark TxInjector
JVM Instance Description jvm_1
Command Line

-Xms2g -Xmx2g -Xmn1536m -XX:+UseParallelGC -XX:ParallelGCThreads=2 -XX:CICompilerCount=4

Tuning

Used numactl to affinitize 1 Injector JVM to one NUMA node

    • Group1: numactl --cpunodebind=0 --localalloc
    • Group2:numactl --cpunodebind=1 --localalloc
    • Group3:numactl --cpunodebind=2 --localalloc
    • Group4:numactl --cpunodebind=3 --localalloc
    • Group5:numactl --cpunodebind=4 --localalloc
    • Group6:numactl --cpunodebind=5 --localalloc
    • Group7:numactl --cpunodebind=6 --localalloc
    • Group8:numactl --cpunodebind=7 --localalloc
    • Group9:numactl --cpunodebind=8 --localalloc
    • Group10:numactl --cpunodebind=9 --localalloc
    • Group11:numactl --cpunodebind=10 --localalloc
    • Group12:numactl --cpunodebind=11 --localalloc
    • Group13:numactl --cpunodebind=12 --localalloc
    • Group14:numactl --cpunodebind=13 --localalloc
    • Group15:numactl --cpunodebind=14 --localalloc
    • Group15:numactl --cpunodebind=15 --localalloc

Notes None
max-jOPS = jOPS passed before the First Failure
Pass/Fail Pass Pass Fail Fail Fail
jOPS 1144502 1158127 1171752 1185377 1199002
critical-jOPS = Geomean ( jOPS @ 10000; 25000; 50000; 75000; 100000; SLAs )
Response time percentile is 99-th
SLA (us) 10000 25000 50000 75000 100000 Geomean
jOPS 742563 797063 824313 837938 851563 809747
  Percentile
  10-th 50-th 90-th 95-th 99-th 100-th
500us 13625 / 27250 - / 13625 - / 13625 - / 13625 - / 13625 - / 13625
1000us 708501 / 722126 27250 / 40875 - / 13625 - / 13625 - / 13625 - / 13625
5000us 1076377 / 1090002 803876 / 817501 749376 / 763001 708501 / 694876 463251 / 422376 - / 13625
10000us 1158127 / - 912876 / 926501 776626 / 790251 776626 / 790251 735751 / 749376 122625 / 13625
25000us 1158127 / - 1008251 / 1021876 858376 / 872001 844751 / 858376 790251 / 803876 163500 / 27250
50000us 1158127 / - 1021876 / 1035501 885626 / 899251 858376 / 872001 817501 / 831126 163500 / 27250
75000us 1158127 / - 1035501 / 1049127 899251 / 912876 872001 / 885626 831126 / 844751 545001 / 136250
100000us 1158127 / - 1035501 / 1049127 912876 / 926501 885626 / 899251 844751 / 858376 694876 / 149875
200000us 1158127 / - 1076377 / 1090002 940126 / 953751 912876 / 926501 872001 / 885626 790251 / 803876
500000us 1158127 / - 1117252 / 1130877 981001 / 994626 967376 / 981001 912876 / 926501 872001 / 885626
1000000us 1158127 / - 1144502 / 1158127 1008251 / 1021876 994626 / 1008251 981001 / 994626 912876 / 926501
Probes jOPS / Total jOPS
Request Mix Accuracy
Note
(Actual % in the Mix - Expected % in the Mix) must be within:
'Main Tx' limit of +/-5.0% for the requests whose expected % in the mix is >= 10.0%
'Minor Tx' limit of +/-1.0% for the requests whose expected % in the mix is < 10.0%
There were no non-critical failures in Response Time curve building
Delay between status pings
IR/PR Accuracy
This section lists properties only set by user
Property Name Default Controller Group1.Backend.beJVM Group1.TxInjector.txiJVM1 Group10.Backend.beJVM Group10.TxInjector.txiJVM1 Group11.Backend.beJVM Group11.TxInjector.txiJVM1 Group12.Backend.beJVM Group12.TxInjector.txiJVM1 Group13.Backend.beJVM Group13.TxInjector.txiJVM1 Group14.Backend.beJVM Group14.TxInjector.txiJVM1 Group15.Backend.beJVM Group15.TxInjector.txiJVM1 Group16.Backend.beJVM Group16.TxInjector.txiJVM1 Group2.Backend.beJVM Group2.TxInjector.txiJVM1 Group3.Backend.beJVM Group3.TxInjector.txiJVM1 Group4.Backend.beJVM Group4.TxInjector.txiJVM1 Group5.Backend.beJVM Group5.TxInjector.txiJVM1 Group6.Backend.beJVM Group6.TxInjector.txiJVM1 Group7.Backend.beJVM Group7.TxInjector.txiJVM1 Group8.Backend.beJVM Group8.TxInjector.txiJVM1 Group9.Backend.beJVM Group9.TxInjector.txiJVM1
specjbb.comm.connect.client.pool.size 256 232 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150
specjbb.comm.connect.selector.runner.count 0 16 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
specjbb.comm.connect.timeouts.connect 60000 600000
specjbb.comm.connect.timeouts.read 60000 600000
specjbb.comm.connect.timeouts.write 60000 600000
specjbb.comm.connect.worker.pool.max 256 81 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150 150
specjbb.comm.connect.worker.pool.min 1 24 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4
specjbb.controller.handshake.period 5000 20000
specjbb.controller.handshake.timeout 600000 900000
specjbb.controller.host localhost localhost
specjbb.controller.port 24000 24000
specjbb.controller.type HBIR_RT HBIR_RT
specjbb.customerDriver.threads 64 {=75, probe=69, saturate=85}
specjbb.forkjoin.workers 960 {Tier1=96, Tier2=1, Tier3=15}
specjbb.group.count 1 16
specjbb.heartbeat.period 10000 2000
specjbb.heartbeat.threshold 100000 9000000
specjbb.mapreducer.pool.size 960 64
specjbb.txi.pergroup.count 1 1
View table in csv format
 
Level: COMPLIANCE
Check Agent Result
Check properties on compliance All PASSED
 
Level: CORRECTNESS
Check Agent Result
Compare SM and HQ Inventory All PASSED
High-bound (max attempted) is 1362502 IR
High-bound (settled) is 1261565 IR