2 NVIDIA L40S | Taknet

NVIDIA

NVIDIA L40S

Key Features

Accelerate Next-Generation Workloads

Generative AI
Large language model (LLM) training and inference
NVIDIA Omniverse™ Enterprise
Rendering and 3D graphics
Streaming and video content

Unparalleled AI and graphics performance for the data center.

Generative AI is fueling transformative change, unlocking a new frontier of opportunities for enterprises across every industry. To transform with AI, enterprises need more compute resources, greater scale, and a broad set of capabilities to meet the demands of an ever-increasing set of diverse and complex workloads. The NVIDIA L40S GPU is the most powerful universal GPU for the data center, delivering end-to-end acceleration for the next generation of AI-enabled applications—from generative AI and model training and inference to 3D graphics, rendering, and video applications.

Powered by NVIDIA Ada Lovelace Architecture

NVIDIA CUDA Cores

Double-speed processing for single-precision floating point (FP32) operations provides significant performance improvements for graphics and simulation workflows, such as complex 3D computer-aided design (CAD) and computer-aided engineering (CAE), on the desktop.

Third-Generation RT Cores

With up to 2X the throughput over the previous generation, third-generation RT Cores deliver massive speedups for workloads like photorealistic rendering of movie content, architectural design evaluations, and virtual prototyping of product designs. This technology also accelerates the rendering of ray-traced motion blur with greater visual accuracy.

Fourth-Generation Tensor Cores

Fourth-generation Tensor Cores provide faster AI compute performance, delivering more than 2X the performance of the previous generation. These new Tensor Cores support acceleration of the FP8 precision data type and provide independent floating-point and integer data paths to speed up execution of mixed floating point and integer calculations.

48 Gigabytes (GB) of GPU Memory

With 48GB GDDR6 memory, the RTX 6000 gives data scientists, engineers, and creative professionals the large memory necessary to work with massive datasets and workloads like rendering, data science, and simulation.

Virtualization-Ready

Support for NVIDIA RTX Virtual Workstation (vWS) software allows a personal workstation to be repurposed into multiple high-performance virtual workstation instances, enabling remote users to share resources to drive high-end design, AI, and compute workloads.

PCIe Gen 4

PCI Express Gen 4 support provides double the bandwidth of PCIe Gen 3, improving data-transfer speeds from CPU memory for data-intensive tasks like AI and data science.

GPU Architecture	NVIDIA Ada Lovelace Architecture
GPU Memory	48GB GDDR6 with ECC
Memory Bandwidth	864GB/s
Interconnect Interface	PCIe Gen4 x16: 64GB/s bidirectional
NVIDIA Ada Lovelace Architecture-Based CUDA® Cores	18,176
NVIDIA Third-Generation RT Cores	142
NVIDIA Fourth-Generation Tensor Cores	568
RT Core Performance TFLOPS	209
FP32 TFLOPS	91.6
TF32 Tensor Core TFLOPS	183 \| 366*
BFLOAT16 Tensor Core TFLOPS	362.05 \| 733*
FP16 Tensor Core	362.05 \| 733*
FP8 Tensor Core	733 \| 1,466*
Peak INT8 Tensor TOPS	733 \| 1,466*
Peak INT4 Tensor TOPS	733 \| 1,466*
Form Factor	4.4″ (H) x 10.5″ (L), dual slot
Display Ports	4x DisplayPort 1.4a
Max Power Consumption	350W
Power Connector	16-pin
Thermal	Passive
Virtual GPU (vGPU) Software Support	Yes
vGPU Profiles Supported	See Virtual GPU Licensing Guide
NVENC \| NVDEC	3x \| 3x (includes AV1 encode and decode)
Secure Boot With Root of Trust	Yes
NEBS Ready	Level 3
MIG Support	No
NVIDIA® NVLink® Support	No

* With Sparsity

Speak with an expert to learn more.