FHElium

Appearance

‹ All benchmarks

PT × CT matrix multiplication

N = 65,536 · Scale 250· Plaintext matrix × encrypted matrix

ScalingThroughput
Log Y

Workload performance

HoistingOn

Complete workload

64 × 64 · Entry depth 0
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionNVIDIA GeForce RTX 4060 TiNVIDIA RTX A6000 · 300 WNVIDIA H100 NVL · 400 WAMD Ryzen Threadripper PRO 7975WX 32-Cores
Throughput (tasks/s)015304560124816Batch sizeNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 49.8NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 49.1NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 42.1NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 38.1NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 35.9NVIDIA GeForce RTX 4060 Ti · 8.07NVIDIA GeForce RTX 4060 Ti · 7.09NVIDIA GeForce RTX 4060 Ti · 6.73NVIDIA GeForce RTX 4060 Ti · 6.71NVIDIA RTX A6000 · 300 W · 13.2NVIDIA RTX A6000 · 300 W · 13.5NVIDIA RTX A6000 · 300 W · 13.6NVIDIA RTX A6000 · 300 W · 13.7NVIDIA RTX A6000 · 300 W · 13.7NVIDIA H100 NVL · 400 W · 39.9NVIDIA H100 NVL · 400 W · 38.3NVIDIA H100 NVL · 400 W · 38.5NVIDIA H100 NVL · 400 W · 38.8NVIDIA H100 NVL · 400 W · 39AMD Ryzen Threadripper PRO 7975WX 32-Cores · 1.67AMD Ryzen Threadripper PRO 7975WX 32-Cores · 1.12AMD Ryzen Threadripper PRO 7975WX 32-Cores · 0.738AMD Ryzen Threadripper PRO 7975WX 32-Cores · 0.825AMD Ryzen Threadripper PRO 7975WX 32-Cores · 0.835

Operations

5 operations

Rotate (1 offset)

Entry depth 0 · Shift +1
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionNVIDIA GeForce RTX 4060 TiNVIDIA RTX A6000 · 300 WNVIDIA H100 NVL · 400 WAMD Ryzen Threadripper PRO 7975WX 32-Cores
Throughput (tasks/s)0225450675900124816Batch sizeNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 775NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 758NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 661NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 549NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 488NVIDIA GeForce RTX 4060 Ti · 116NVIDIA GeForce RTX 4060 Ti · 103NVIDIA GeForce RTX 4060 Ti · 94.9NVIDIA GeForce RTX 4060 Ti · 94.8NVIDIA GeForce RTX 4060 Ti · 94.9NVIDIA RTX A6000 · 300 W · 173NVIDIA RTX A6000 · 300 W · 176NVIDIA RTX A6000 · 300 W · 179NVIDIA RTX A6000 · 300 W · 180NVIDIA RTX A6000 · 300 W · 180NVIDIA H100 NVL · 400 W · 513NVIDIA H100 NVL · 400 W · 533NVIDIA H100 NVL · 400 W · 531NVIDIA H100 NVL · 400 W · 536NVIDIA H100 NVL · 400 W · 507AMD Ryzen Threadripper PRO 7975WX 32-Cores · 24.1AMD Ryzen Threadripper PRO 7975WX 32-Cores · 22.1AMD Ryzen Threadripper PRO 7975WX 32-Cores · 17.2AMD Ryzen Threadripper PRO 7975WX 32-Cores · 17AMD Ryzen Threadripper PRO 7975WX 32-Cores · 16.6

Rotate-many (7 offsets)

HoistingOn
Entry depth 0 · Shifts +1…+7 · one input
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionNVIDIA GeForce RTX 4060 TiNVIDIA RTX A6000 · 300 WNVIDIA H100 NVL · 400 WAMD Ryzen Threadripper PRO 7975WX 32-Cores
Throughput (tasks/s)062.5125188250124816Batch sizeNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 203NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 181NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 139NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 127NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 122NVIDIA GeForce RTX 4060 Ti · 24.7NVIDIA GeForce RTX 4060 Ti · 22NVIDIA GeForce RTX 4060 Ti · 21.5NVIDIA GeForce RTX 4060 Ti · 21.3NVIDIA GeForce RTX 4060 Ti · 21.3NVIDIA RTX A6000 · 300 W · 45.7NVIDIA RTX A6000 · 300 W · 46.1NVIDIA RTX A6000 · 300 W · 46.5NVIDIA RTX A6000 · 300 W · 46.8NVIDIA RTX A6000 · 300 W · 46.9NVIDIA H100 NVL · 400 W · 151NVIDIA H100 NVL · 400 W · 151NVIDIA H100 NVL · 400 W · 144NVIDIA H100 NVL · 400 W · 147NVIDIA H100 NVL · 400 W · 147AMD Ryzen Threadripper PRO 7975WX 32-Cores · 6.47AMD Ryzen Threadripper PRO 7975WX 32-Cores · 4.97AMD Ryzen Threadripper PRO 7975WX 32-Cores · 4.59AMD Ryzen Threadripper PRO 7975WX 32-Cores · 4.36AMD Ryzen Threadripper PRO 7975WX 32-Cores · 4.03

Multiply (PT × CT)

Entry depth 0 · No rescale
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionNVIDIA GeForce RTX 4060 TiNVIDIA RTX A6000 · 300 WNVIDIA H100 NVL · 400 WAMD Ryzen Threadripper PRO 7975WX 32-Cores
Throughput (tasks/s)011,30022,50033,80045,000124816Batch sizeNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 38,500NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 13,200NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 10,100NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 10,100NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 10,100NVIDIA GeForce RTX 4060 Ti · 2,660NVIDIA GeForce RTX 4060 Ti · 1,680NVIDIA GeForce RTX 4060 Ti · 1,700NVIDIA GeForce RTX 4060 Ti · 1,720NVIDIA GeForce RTX 4060 Ti · 1,710NVIDIA RTX A6000 · 300 W · 6,960NVIDIA RTX A6000 · 300 W · 4,390NVIDIA RTX A6000 · 300 W · 4,500NVIDIA RTX A6000 · 300 W · 4,560NVIDIA RTX A6000 · 300 W · 4,610NVIDIA H100 NVL · 400 W · 25,700NVIDIA H100 NVL · 400 W · 18,600NVIDIA H100 NVL · 400 W · 20,200NVIDIA H100 NVL · 400 W · 20,800NVIDIA H100 NVL · 400 W · 21,000AMD Ryzen Threadripper PRO 7975WX 32-Cores · 3,860AMD Ryzen Threadripper PRO 7975WX 32-Cores · 2,140AMD Ryzen Threadripper PRO 7975WX 32-Cores · 267AMD Ryzen Threadripper PRO 7975WX 32-Cores · 248AMD Ryzen Threadripper PRO 7975WX 32-Cores · 251

Sum products (8 PT × CT terms)

Entry depth 0 · Sum of eight products · no rescale
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionNVIDIA GeForce RTX 4060 TiNVIDIA RTX A6000 · 300 WNVIDIA H100 NVL · 400 WAMD Ryzen Threadripper PRO 7975WX 32-Cores
Throughput (tasks/s)02,0004,0006,0008,000124816Batch sizeNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 6,020NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 5,480NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 5,170NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 5,140NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 5,040NVIDIA GeForce RTX 4060 Ti · 870NVIDIA GeForce RTX 4060 Ti · 892NVIDIA GeForce RTX 4060 Ti · 903NVIDIA GeForce RTX 4060 Ti · 908NVIDIA GeForce RTX 4060 Ti · 910NVIDIA RTX A6000 · 300 W · 2,270NVIDIA RTX A6000 · 300 W · 2,320NVIDIA RTX A6000 · 300 W · 2,350NVIDIA RTX A6000 · 300 W · 2,370NVIDIA RTX A6000 · 300 W · 2,380NVIDIA H100 NVL · 400 W · 6,120NVIDIA H100 NVL · 400 W · 6,580NVIDIA H100 NVL · 400 W · 6,690NVIDIA H100 NVL · 400 W · 6,670NVIDIA H100 NVL · 400 W · 6,130AMD Ryzen Threadripper PRO 7975WX 32-Cores · 277AMD Ryzen Threadripper PRO 7975WX 32-Cores · 20.1AMD Ryzen Threadripper PRO 7975WX 32-Cores · 13.5AMD Ryzen Threadripper PRO 7975WX 32-Cores · 14.9AMD Ryzen Threadripper PRO 7975WX 32-Cores · 18.3

Rescale (2 components)

Entry depth 0 · One Q depth group
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionNVIDIA GeForce RTX 4060 TiNVIDIA RTX A6000 · 300 WNVIDIA H100 NVL · 400 WAMD Ryzen Threadripper PRO 7975WX 32-Cores
Throughput (tasks/s)01,5003,0004,5006,000124816Batch sizeNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 4,790NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 5,190NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 4,840NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 3,530NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · 3,300NVIDIA GeForce RTX 4060 Ti · 799NVIDIA GeForce RTX 4060 Ti · 578NVIDIA GeForce RTX 4060 Ti · 586NVIDIA GeForce RTX 4060 Ti · 590NVIDIA GeForce RTX 4060 Ti · 594NVIDIA RTX A6000 · 300 W · 1,070NVIDIA RTX A6000 · 300 W · 1,100NVIDIA RTX A6000 · 300 W · 1,110NVIDIA RTX A6000 · 300 W · 1,110NVIDIA RTX A6000 · 300 W · 1,120NVIDIA H100 NVL · 400 W · 2,900NVIDIA H100 NVL · 400 W · 3,110NVIDIA H100 NVL · 400 W · 3,250NVIDIA H100 NVL · 400 W · 3,170NVIDIA H100 NVL · 400 W · 3,090AMD Ryzen Threadripper PRO 7975WX 32-Cores · 143AMD Ryzen Threadripper PRO 7975WX 32-Cores · 170AMD Ryzen Threadripper PRO 7975WX 32-Cores · 88.5AMD Ryzen Threadripper PRO 7975WX 32-Cores · 76.9AMD Ryzen Threadripper PRO 7975WX 32-Cores · 93.8

Measurement conditions

ConfigurationN = 65,536 · scale 250
ExecutionEager · prepared inputs and keys
PlatformsNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition / NVIDIA GeForce RTX 4060 Ti / NVIDIA RTX A6000 · 300 W / NVIDIA H100 NVL · 400 W / AMD Ryzen Threadripper PRO 7975WX 32-Cores