NVIDIA Terraform Modules is a reference architecture that can help to create CSP Kubernetes Cluster with NVIDIA GPU and NIM Operators. All the components that have been listed below tested successfully together
When NVIDIA Terraform Modules is released, the previous release enters maintenance support and only receives patch release updates. All prior batches enter end-of-life (EOL) and are no longer supported and do not receive patch updates.
| Release | Status |
|---|---|
| 24.11.0 | Generally Available |
| 0.7.0 | Maintenance |
The Kubernetes clusters provisioned by the modules in this repository provide tested and certified versions of Kubernetes, the NVIDIA GPU operator, and NVIDIA NIM Operator.
If your application does not require a specific version of Kubernetes, we recommend using the latest available version. We also recommend you plan to upgrade your version of Kubernetes at least every 6 months.
Each CSP has its own end of life date for the versions of Kubernetes they support. For more information see:
NVIDIA Terraform Modules 24.11.0 Release
| TF Modules | K8s 1.31 | K8s 1.30 | K8s 1.29 |
|---|---|---|---|
| Platforms | Amazon EKS Azure AKS Google GKE |
Amazon EKS Azure AKS Google GKE |
Amazon EKS Azure AKS Google GKE |
| Supported OS | Ubuntu 22.04 LTS | Ubuntu 22.04 LTS | Ubuntu 22.04 LTS |
| Containerd | EKS: 1.7.12 AKS: 1.7.23-1 GKE: 1.7.22 |
EKS: 1.7.12 AKS: 1.7.23-1 GKE: 1.7.22 |
EKS: 1.7.12 AKS: 1.7.23-1 GKE: 1.7.22 |
| NVIDIA Container Toolkit | 1.17.0 | 1.17.0 | 1.17.0 |
| CNI | CSP dependent | CSP dependent | CSP dependent |
| NVIDIA GPU Operator | 24.9.0 | 24.9.0 | 24.9.0 |
| NVIDIA DataCenter Driver | 550.127.05 | 550.127.05 | 550.127.05 |
| NVIDIA NIM Operator | 1.0.0 | 1.0.0 | 1.0.0 |
| Helm | 3.16.2 | 3.16.2 | 3.16.2 |
Infrastructure as code for GPU accelerated managed Kubernetes clusters. These scripts automate the deployment of GPU-Enabled Kubernetes clusters on various cloud service platforms.
Terraform is an open-source infrastructure as code software tool that we will use to automate the deployment of Kubernetes clusters with the required add-ons to enable NVIDIA GPUs. This repository contains Terraform modules, which are sets of Terraform configuration files ready for deployment. The modules in this repository can be incorporated into existing Terraform-managed infrastructure, or used to set up new infrastructure from scratch. You can learn more about Terraform here.
You can download Terraform (CLI) here.
Clone the repo
git clone https://github.com/NVIDIA/nvidia-terraform-modules.git
- Create an EKS Cluster
- Create an AKS Cluster
- Create a GKE Cluster
These modules do not set up state management for the generated Terraform state file, deleting the statefile (terraform.tfstate) generated by Terraform could result in cloud resources needing to be manually deleted. We strongly encourage you configure remote state.
Please see the Terraform Documentation for more information.
Pull requests are welcome! Please see our contribution guidelines.
Please open an issue on the GitHub project for any questions. Your feedback is appreciated.