Nvidia GPU
The amount of VRAM and Compute Capability can be important for some AI applications.
| CUDA SDK | Maxwell | Pascal | Volta | Turing | Ampere | Ada | Hopper | Blackwell |
|---|---|---|---|---|---|---|---|---|
| 12.0 - 12.6 | 5.x | 6.x | 7.x | 7.5 | 8.x | 8.9 | 9.x | |
| 12.8 | 5.x | 6.x | 7.x | 7.5 | 8.x | 8.9 | 9.x | 12.0 |
| 12.9 | 5.x | 6.x | 7.x | 7.5 | 8.x | 8.9 | 9.x | 12.1 |
| 13.0 | 7.5 | 8.x | 8.9 | 9.x | 12.1 |
We suggest contributing GPUs with VRAM of at least 6 GByte and Compute Capability of at least 5.0 (at least Maxwell).
Following is a sample of some contributed GPUs:
| Nvidia Models | GByte | GB/s | CUDA | PCI | CC | Deployed |
|---|---|---|---|---|---|---|
| GeForce GTX 1060 | 6 | 192 | 1280 | 3.0 x16 | 6.1 | 1 |
| GeForce RTX 2060 Super | 8 | 448 | 2176 | 3.0 x16 | 7.5 | 1 |
| GeForce RTX 4060 Ti | 16 | 288 | 4352 | 4.0 x8 | 8.9 | 6 |
| GeForce RTX 5060 Ti | 16 | 448 | 4608 | 5.0 x8 | 12.0 | 4 |
CC = Compute Capability
Note currently, most open source software CANNOT use advanced hardware features like FP8 and Tensor Cores.
Fan Control
We need to spin the GPU fans up before it gets too hot
Need to edit the nvidia_fan_control.py file to set the fan curve before running it.
Suggested Fan Curve:
# Fan curve parameters
temperature_points = [30, 40, 60, 70]
fan_speed_points = [30, 60, 80, 100]