To install the NVIDIA L40 driver and cuda on Ubuntu 24.04
1. 打开终端并更新
使用sudo更新apt软件包列表并使用sudo升级apt软件包
sudo apt update && sudo apt upgrade
2. 确定可用驱动
使用sudo命令列出ubuntu驱动程序列表
sudo ubuntu-drivers list ...... nvidia-driver-565, (kernel modules provided by nvidia-dkms-565) nvidia-driver-535, (kernel modules provided by linux-modules-nvidia-535-generic) nvidia-driver-575, (kernel modules provided by nvidia-dkms-575) nvidia-driver-555-open, (kernel modules provided by nvidia-dkms-555-open) nvidia-driver-575-open, (kernel modules provided by nvidia-dkms-575-open) nvidia-driver-570-server, (kernel modules provided by linux-modules-nvidia-570-server-generic) nvidia-driver-555, (kernel modules provided by nvidia-dkms-555) nvidia-driver-535-server-open, (kernel modules provided by linux-modules-nvidia-535-server-open-generic) nvidia-driver-560, (kernel modules provided by nvidia-dkms-560) nvidia-driver-570-server-open, (kernel modules provided by linux-modules-nvidia-570-server-open-generic) nvidia-driver-570-open, (kernel modules provided by linux-modules-nvidia-570-open-generic) nvidia-driver-535-server, (kernel modules provided by linux-modules-nvidia-535-server-generic) nvidia-driver-560-open, (kernel modules provided by nvidia-dkms-560-open) nvidia-driver-565-open, (kernel modules provided by nvidia-dkms-565-open) nvidia-driver-550, (kernel modules provided by linux-modules-nvidia-550-generic) nvidia-driver-550-open, (kernel modules provided by linux-modules-nvidia-550-open-generic) nvidia-driver-570, (kernel modules provided by linux-modules-nvidia-570-generic) nvidia-driver-535-open, (kernel modules provided by linux-modules-nvidia-535-open-generic) open-vm-tools-desktop
3.安装驱动
sudo apt install nvidia-driver-570-server #数据中心卡（如L40）专用驱动，稳定性更好，支持 MIG、多用户多实例等特性
4.重启系统
sudo reboot
5.验证驱动是否正常加载
root@su:~# nvidia-smi
Thu Jun 12 06:14:12 2025
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 570.133.20 Driver Version: 570.133.20 CUDA Version: 12.8 |
|-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA L40 Off | 00000000:13:00.0 Off | 0 |
| N/A 29C P0 79W / 300W | 0MiB / 46068MiB | 3% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| No running processes found |
+-----------------------------------------------------------------------------------------+
6.安装 CUDA
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64/cuda-keyring_1.1-1_all.deb
sudo dpkg -i cuda-keyring_1.1-1_all.deb
sudo apt-get update
sudo apt-get -y install cuda-toolkit-12-8
用 nvcc --version 确认cuda的版本，如果显示Command nvcc not found，则编辑~/.bashrc
vim ~/.bashrc
export PATH=/usr/local/cuda-12.8/bin${PATH:+:${PATH}}
export LD_LIBRARY_PATH=/usr/local/cuda-12.8/lib64:${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}
#更新变量
source ~/.bashrc
root@su:~# nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2025 NVIDIA Corporation
Built on Fri_Feb_21_20:23:50_PST_2025
Cuda compilation tools, release 12.8, V12.8.93
Build cuda_12.8.r12.8/compiler.35583870_0
7.锁定驱动版本防止升级冲突
sudo apt-mark hold nvidia-driver-570-server sudo apt-mark hold cuda-toolkit-12-8
