Servery (SuperMicro)

GPU Architecture NVIDIA Ada Lovelace architecture GPU Memory 48GB GDDR6 with ECC Memory Bandwidth 864GB/s Interconnect Interface PCIe Gen4 x16: 64GB/s bidirectional NVIDIA Ada Lovelace Architecture-Based CUDA® Cores 18,176 NVIDIA...

Peak FP64 5.2TF Peak FP64 Tensor Core 10.3 TF Peak FP32 10.3 TF TF32 Tensor Core 82 TF | 165 TF* BFLOAT16 Tensor Core 165 TF | 330 TF* Peak FP16 Tensor Core 165 TF | 330 TF* Peak INT8 Tensor Core 330 TOPS | 661 TOPS* Peak INT4 Tensor Core 661...

GPU architecture NVIDIA Ampere architecture GPU memory 48 GB GDDR6 with ECC Memory bandwidth 696 GB/s Interconnect interface NVIDIA® NVLink® 112.5 GB/s (bidirectional)3 PCIe Gen4: 64GB/s NVIDIA Ampere architecture- based CUDA...

Supermicro NVIDIA H100 80GB PCIe 5.0 x16 Passive...