Merlin HugeCTR Support Matrix

This container enables you to train and deploy NVTabular workflows and HugeCTR models to the Triton Inference Server for production.

22.xx Container Images

Container Release

Release 22.09

Release 22.07

Release 22.06

DGX

DGX System

  • DGX-1

  • DGX-2

  • DGX A100

  • DGX Station

  • DGX-1

  • DGX-2

  • DGX A100

  • DGX Station

  • DGX-1

  • DGX-2

  • DGX A100

  • DGX Station

Operating System

Ubuntu 20.04.4 LTS

Ubuntu 20.04.4 LTS

Ubuntu 20.04.4 LTS

NVIDIA Certified Systems

NVIDIA Driver

NVIDIA Driver version 465.19.01

or later is required. However,

if you’re running on Data Center

GPUs (formerly Tesla) such as T4,

you can use any of the following

NVIDIA Driver versions:

  • 418.40 (or later R418)

  • 440.33 (or later R440)

  • 450.51 (or later R450)

  • 460.27 (or later R460)

Note: The CUDA Driver

Compatibility Package does not

support all drivers.

NVIDIA Driver version 465.19.01

or later is required. However,

if you’re running on Data Center

GPUs (formerly Tesla) such as T4,

you can use any of the following

NVIDIA Driver versions:

  • 418.40 (or later R418)

  • 440.33 (or later R440)

  • 450.51 (or later R450)

  • 460.27 (or later R460)

Note: The CUDA Driver

Compatibility Package does not

support all drivers.

NVIDIA Driver version 465.19.01

or later is required. However,

if you’re running on Data Center

GPUs (formerly Tesla) such as T4,

you can use any of the following

NVIDIA Driver versions:

  • 418.40 (or later R418)

  • 440.33 (or later R440)

  • 450.51 (or later R450)

  • 460.27 (or later R460)

Note: The CUDA Driver

Compatibility Package does not

support all drivers.

GPU Model

Base Container Image

Container Operating System

Ubuntu 20.04.4 LTS

Ubuntu 20.04.4 LTS

Ubuntu 20.04.4 LTS

Base Container

Triton version 22.08

Triton version 22.05

Triton version 22.05

CUDA

11.7.1.017

11.7.1.014

11.7.0.022

RMM

22.06.00a+76.g185c18e6

21.12.0

21.12.0

cuDF

22.06.00a+319.g97422602b8

22.4.0

22.4.0

cuDNN

8.5.0.96

8.4.1.50+cuda11.6

8.4.0.27+cuda11.6

Merlin Core

0.7.0

0.5.0+1.g1354dcf

0.4.0

Merlin Models

0.8.0

0.6.0+8.g042ee198

0.5.0+7.g886cf6de

Merlin Systems

0.6.0

0.4.0+2.gf1e2bf5

0.3.0+1.g712b04d

NVTabular

1.5.0

1.3.3+1.g32ed5fa12

1.2.2

Transformers4Rec

0.1.13

0.1.11+1.g3367d725

0.1.10

HugeCTR

4.0.0

3.8.0

3.7.0

SM

60, 61, 70, 75, 80

60, 61, 70, 75, 80

60, 61, 70, 75, 80

Triton Inference Server

2.25.0

2.23.0

2.22.0

Size

15.7 GB

14.61 GB

13.95 GB

Compressed Size

10.83 GB

7.15 GB

6.57 GB