Skip to content
‹ All benchmarks

Nonlinear polynomial evaluation

N = 65,536 · Scale 250· Degree-twelve power polynomial

ScalingThroughput
Log Y

Workload performance

Complete workload

Entry depth 0
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionNVIDIA GeForce RTX 4060 TiNVIDIA RTX A6000 · 300 WNVIDIA H100 NVL · 400 WAMD Ryzen Threadripper PRO 7975WX 32-Cores
Throughput (tasks/s)010203040124816Batch sizeNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 34NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 33.3NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 28.7NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 23.4NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 22.1NVIDIA GeForce RTX 4060 Ti · 5.51NVIDIA GeForce RTX 4060 Ti · 4.26NVIDIA GeForce RTX 4060 Ti · 4.08NVIDIA GeForce RTX 4060 Ti · 4.1NVIDIA GeForce RTX 4060 Ti · 4.12NVIDIA RTX A6000 · 300 W · 7.53NVIDIA RTX A6000 · 300 W · 7.69NVIDIA RTX A6000 · 300 W · 7.78NVIDIA RTX A6000 · 300 W · 7.82NVIDIA RTX A6000 · 300 W · 7.84NVIDIA H100 NVL · 400 W · 23.1NVIDIA H100 NVL · 400 W · 21.1NVIDIA H100 NVL · 400 W · 21.5NVIDIA H100 NVL · 400 W · 21.8NVIDIA H100 NVL · 400 W · 21.9AMD Ryzen Threadripper PRO 7975WX 32-Cores · 1.09AMD Ryzen Threadripper PRO 7975WX 32-Cores · 1.32AMD Ryzen Threadripper PRO 7975WX 32-Cores · 1.43AMD Ryzen Threadripper PRO 7975WX 32-Cores · 1.22AMD Ryzen Threadripper PRO 7975WX 32-Cores · 0.771

Operations

7 operations

Multiply (CT × CT)

Entry depth 0 · Distinct inputs · no relinearization or rescale
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionNVIDIA GeForce RTX 4060 TiNVIDIA RTX A6000 · 300 WNVIDIA H100 NVL · 400 WAMD Ryzen Threadripper PRO 7975WX 32-Cores
Throughput (tasks/s)08,75017,50026,30035,000124816Batch sizeNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 29,700NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 15,600NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 13,900NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 14,200NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 14,300NVIDIA GeForce RTX 4060 Ti · 2,200NVIDIA GeForce RTX 4060 Ti · 2,310NVIDIA GeForce RTX 4060 Ti · 2,370NVIDIA GeForce RTX 4060 Ti · 2,400NVIDIA GeForce RTX 4060 Ti · 2,430NVIDIA RTX A6000 · 300 W · 5,940NVIDIA RTX A6000 · 300 W · 6,250NVIDIA RTX A6000 · 300 W · 6,410NVIDIA RTX A6000 · 300 W · 6,490NVIDIA RTX A6000 · 300 W · 6,530NVIDIA H100 NVL · 400 W · 20,000NVIDIA H100 NVL · 400 W · 23,700NVIDIA H100 NVL · 400 W · 24,400NVIDIA H100 NVL · 400 W · 24,600NVIDIA H100 NVL · 400 W · 24,700AMD Ryzen Threadripper PRO 7975WX 32-Cores · 942AMD Ryzen Threadripper PRO 7975WX 32-Cores · 457AMD Ryzen Threadripper PRO 7975WX 32-Cores · 516AMD Ryzen Threadripper PRO 7975WX 32-Cores · 491AMD Ryzen Threadripper PRO 7975WX 32-Cores · 408

Square (CT)

Entry depth 0 · Same input · no relinearization or rescale
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionNVIDIA GeForce RTX 4060 TiNVIDIA RTX A6000 · 300 WNVIDIA H100 NVL · 400 WAMD Ryzen Threadripper PRO 7975WX 32-Cores
Throughput (tasks/s)08,75017,50026,30035,000124816Batch sizeNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 29,900NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 26,300NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 18,500NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 19,000NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 19,400NVIDIA GeForce RTX 4060 Ti · 3,000NVIDIA GeForce RTX 4060 Ti · 3,160NVIDIA GeForce RTX 4060 Ti · 3,300NVIDIA GeForce RTX 4060 Ti · 3,340NVIDIA GeForce RTX 4060 Ti · 3,350NVIDIA RTX A6000 · 300 W · 8,060NVIDIA RTX A6000 · 300 W · 8,580NVIDIA RTX A6000 · 300 W · 8,890NVIDIA RTX A6000 · 300 W · 9,090NVIDIA RTX A6000 · 300 W · 9,180NVIDIA H100 NVL · 400 W · 20,400NVIDIA H100 NVL · 400 W · 24,700NVIDIA H100 NVL · 400 W · 26,800NVIDIA H100 NVL · 400 W · 27,900NVIDIA H100 NVL · 400 W · 27,900AMD Ryzen Threadripper PRO 7975WX 32-Cores · 949AMD Ryzen Threadripper PRO 7975WX 32-Cores · 427AMD Ryzen Threadripper PRO 7975WX 32-Cores · 455AMD Ryzen Threadripper PRO 7975WX 32-Cores · 475AMD Ryzen Threadripper PRO 7975WX 32-Cores · 413

Multiply scalar & rescale

Entry depth 0 · Scalar −0.3 · one rescale
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionNVIDIA GeForce RTX 4060 TiNVIDIA RTX A6000 · 300 WNVIDIA H100 NVL · 400 WAMD Ryzen Threadripper PRO 7975WX 32-Cores
Throughput (tasks/s)01,2502,5003,7505,000124816Batch sizeNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 4,430NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 4,170NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 4,110NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 3,100NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 2,930NVIDIA GeForce RTX 4060 Ti · 639NVIDIA GeForce RTX 4060 Ti · 486NVIDIA GeForce RTX 4060 Ti · 489NVIDIA GeForce RTX 4060 Ti · 491NVIDIA GeForce RTX 4060 Ti · 493NVIDIA RTX A6000 · 300 W · 942NVIDIA RTX A6000 · 300 W · 966NVIDIA RTX A6000 · 300 W · 973NVIDIA RTX A6000 · 300 W · 975NVIDIA RTX A6000 · 300 W · 979NVIDIA H100 NVL · 400 W · 2,720NVIDIA H100 NVL · 400 W · 2,890NVIDIA H100 NVL · 400 W · 3,020NVIDIA H100 NVL · 400 W · 2,970NVIDIA H100 NVL · 400 W · 2,850AMD Ryzen Threadripper PRO 7975WX 32-Cores · 123AMD Ryzen Threadripper PRO 7975WX 32-Cores · 98AMD Ryzen Threadripper PRO 7975WX 32-Cores · 73.7AMD Ryzen Threadripper PRO 7975WX 32-Cores · 71.4AMD Ryzen Threadripper PRO 7975WX 32-Cores · 73.6

Add (CT + CT)

Entry depth 0 · Same depth and scale
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionNVIDIA GeForce RTX 4060 TiNVIDIA RTX A6000 · 300 WNVIDIA H100 NVL · 400 WAMD Ryzen Threadripper PRO 7975WX 32-Cores
Throughput (tasks/s)012,50025,00037,50050,000124816Batch sizeNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 40,400NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 19,700NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 16,600NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 16,900NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 17,100NVIDIA GeForce RTX 4060 Ti · 2,620NVIDIA GeForce RTX 4060 Ti · 2,730NVIDIA GeForce RTX 4060 Ti · 2,810NVIDIA GeForce RTX 4060 Ti · 2,920NVIDIA GeForce RTX 4060 Ti · 2,960NVIDIA RTX A6000 · 300 W · 6,890NVIDIA RTX A6000 · 300 W · 7,280NVIDIA RTX A6000 · 300 W · 7,510NVIDIA RTX A6000 · 300 W · 7,630NVIDIA RTX A6000 · 300 W · 7,670NVIDIA H100 NVL · 400 W · 24,800NVIDIA H100 NVL · 400 W · 30,600NVIDIA H100 NVL · 400 W · 34,700NVIDIA H100 NVL · 400 W · 37,200NVIDIA H100 NVL · 400 W · 38,200AMD Ryzen Threadripper PRO 7975WX 32-Cores · 5,690AMD Ryzen Threadripper PRO 7975WX 32-Cores · 3,630AMD Ryzen Threadripper PRO 7975WX 32-Cores · 797AMD Ryzen Threadripper PRO 7975WX 32-Cores · 863AMD Ryzen Threadripper PRO 7975WX 32-Cores · 927

Relinearize

Entry depth 0 · 3 → 2 components · no rescale
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionNVIDIA GeForce RTX 4060 TiNVIDIA RTX A6000 · 300 WNVIDIA H100 NVL · 400 WAMD Ryzen Threadripper PRO 7975WX 32-Cores
Throughput (tasks/s)0225450675900124816Batch sizeNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 781NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 770NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 676NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 558NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 498NVIDIA GeForce RTX 4060 Ti · 121NVIDIA GeForce RTX 4060 Ti · 106NVIDIA GeForce RTX 4060 Ti · 97.6NVIDIA GeForce RTX 4060 Ti · 97.4NVIDIA GeForce RTX 4060 Ti · 97.4NVIDIA RTX A6000 · 300 W · 174NVIDIA RTX A6000 · 300 W · 178NVIDIA RTX A6000 · 300 W · 180NVIDIA RTX A6000 · 300 W · 181NVIDIA RTX A6000 · 300 W · 182NVIDIA H100 NVL · 400 W · 519NVIDIA H100 NVL · 400 W · 528NVIDIA H100 NVL · 400 W · 514NVIDIA H100 NVL · 400 W · 516NVIDIA H100 NVL · 400 W · 498AMD Ryzen Threadripper PRO 7975WX 32-Cores · 24.6AMD Ryzen Threadripper PRO 7975WX 32-Cores · 20.7AMD Ryzen Threadripper PRO 7975WX 32-Cores · 18.1AMD Ryzen Threadripper PRO 7975WX 32-Cores · 17.7AMD Ryzen Threadripper PRO 7975WX 32-Cores · 15.8

Rescale (2 components)

Entry depth 0 · One Q depth group
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionNVIDIA GeForce RTX 4060 TiNVIDIA RTX A6000 · 300 WNVIDIA H100 NVL · 400 WAMD Ryzen Threadripper PRO 7975WX 32-Cores
Throughput (tasks/s)01,5003,0004,5006,000124816Batch sizeNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 4,790NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 5,190NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 4,840NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 3,530NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 3,300NVIDIA GeForce RTX 4060 Ti · 799NVIDIA GeForce RTX 4060 Ti · 578NVIDIA GeForce RTX 4060 Ti · 586NVIDIA GeForce RTX 4060 Ti · 590NVIDIA GeForce RTX 4060 Ti · 594NVIDIA RTX A6000 · 300 W · 1,070NVIDIA RTX A6000 · 300 W · 1,100NVIDIA RTX A6000 · 300 W · 1,110NVIDIA RTX A6000 · 300 W · 1,110NVIDIA RTX A6000 · 300 W · 1,120NVIDIA H100 NVL · 400 W · 2,900NVIDIA H100 NVL · 400 W · 3,110NVIDIA H100 NVL · 400 W · 3,250NVIDIA H100 NVL · 400 W · 3,170NVIDIA H100 NVL · 400 W · 3,090AMD Ryzen Threadripper PRO 7975WX 32-Cores · 143AMD Ryzen Threadripper PRO 7975WX 32-Cores · 170AMD Ryzen Threadripper PRO 7975WX 32-Cores · 88.5AMD Ryzen Threadripper PRO 7975WX 32-Cores · 76.9AMD Ryzen Threadripper PRO 7975WX 32-Cores · 93.8

Advance depth

Entry depth 0 · Multiply by one & rescale
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionNVIDIA GeForce RTX 4060 TiNVIDIA RTX A6000 · 300 WNVIDIA H100 NVL · 400 WAMD Ryzen Threadripper PRO 7975WX 32-Cores
Throughput (tasks/s)01,3802,7504,1305,500124816Batch sizeNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 4,500NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 4,200NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 4,110NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 3,100NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 2,960NVIDIA GeForce RTX 4060 Ti · 639NVIDIA GeForce RTX 4060 Ti · 486NVIDIA GeForce RTX 4060 Ti · 489NVIDIA GeForce RTX 4060 Ti · 491NVIDIA GeForce RTX 4060 Ti · 494NVIDIA RTX A6000 · 300 W · 943NVIDIA RTX A6000 · 300 W · 968NVIDIA RTX A6000 · 300 W · 973NVIDIA RTX A6000 · 300 W · 976NVIDIA RTX A6000 · 300 W · 979NVIDIA H100 NVL · 400 W · 2,730NVIDIA H100 NVL · 400 W · 2,890NVIDIA H100 NVL · 400 W · 3,020NVIDIA H100 NVL · 400 W · 2,950NVIDIA H100 NVL · 400 W · 2,860AMD Ryzen Threadripper PRO 7975WX 32-Cores · 124AMD Ryzen Threadripper PRO 7975WX 32-Cores · 97.5AMD Ryzen Threadripper PRO 7975WX 32-Cores · 73.9AMD Ryzen Threadripper PRO 7975WX 32-Cores · 72.9AMD Ryzen Threadripper PRO 7975WX 32-Cores · 76.4

Measurement conditions

ConfigurationN = 65,536 · scale 250
PolynomialDegree twelve · same coefficients across methods
ExecutionEager · prepared inputs and keys
PlatformsNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition / NVIDIA GeForce RTX 4060 Ti / NVIDIA RTX A6000 · 300 W / NVIDIA H100 NVL · 400 W / AMD Ryzen Threadripper PRO 7975WX 32-Cores