Technical Specifications
NVIDIA L40
GPU Architecture NVIDIA Ada Lovelace architecture
GPU Memory 48GB GDDR6 with ECC
Memory Bandwidth 864GB/s
Interconnect Interface PCIe Gen4x16: 64GB/s bi-directional
RT Core performance TFLOPS 209
FP32 TFLOPS 90.5
TF32 Tensor Core TFLOPS 90.5 | 181**
BFLOAT16 Tensor Core TFLOPS 181.05 | 362.1**
FP16 Tensor Core 181.05 | 362.1**
FP8 Tensor Core 362 | 724**
Peak INT8 Tensor TOPS
Peak INT4 Tensor TOPS
362 | 724**
724 | 1448**
Form Factor 4.4” (H) x 10.5” (L) – dual slot
Display Ports 4 x DisplayPort 1.4a
Max Power Consumption 300W
Power Connector 16-pin
Thermal Passive
Virtual GPU (vGPU) software support Yes
vGPU Profiles Supported See Virtual GPU Licensing Guide1
NVENC I NVDEC 3x l 3x (Includes AV1 Encode & Decode)
Secure Boot with Root of Trust Yes
NEBS Ready Level 3
MIG Support No
NVLink Support No
NVIDIA L40
GPU Architecture NVIDIA Ada Lovelace architecture
GPU Memory 48GB GDDR6 with ECC
Memory Bandwidth 864GB/s
Interconnect Interface PCIe Gen4x16: 64GB/s bi-directional
RT Core performance TFLOPS 209
FP32 TFLOPS 90.5
TF32 Tensor Core TFLOPS 90.5 | 181**
BFLOAT16 Tensor Core TFLOPS 181.05 | 362.1**
FP16 Tensor Core 181.05 | 362.1**
FP8 Tensor Core 362 | 724**
Peak INT8 Tensor TOPS
Peak INT4 Tensor TOPS
362 | 724**
724 | 1448**
Form Factor 4.4” (H) x 10.5” (L) – dual slot
Display Ports 4 x DisplayPort 1.4a
Max Power Consumption 300W
Power Connector 16-pin
Thermal Passive
Virtual GPU (vGPU) software support Yes
vGPU Profiles Supported See Virtual GPU Licensing Guide1
NVENC I NVDEC 3x l 3x (Includes AV1 Encode & Decode)
Secure Boot with Root of Trust Yes
NEBS Ready Level 3
MIG Support No
NVLink Support No
Reviews
There are no reviews yet.