Lien : https://shionn.github.io/draft/nvidia-proxmox-lxc-passthrought-ollama.html

• utiliser un conteneur avec les pilotes Nvidia
• installer les prérequis

apt install -y curl zstd pciutils

• installer Ollama

# wget https://ollama.com/install.sh
# bash ./install.sh
>>> Cleaning up old version at /usr/local/lib/ollama
>>> Installing ollama to /usr/local
>>> Downloading ollama-linux-amd64.tar.zst
########################################################################################################## 100.0%
>>> Creating ollama user...
>>> Adding ollama user to render group...
>>> Adding ollama user to video group...
>>> Adding current user to ollama group...
>>> Creating ollama systemd service...
>>> Enabling and starting ollama service...
Created symlink '/etc/systemd/system/default.target.wants/ollama.service' -> '/etc/systemd/system/ollama.service'.
>>> NVIDIA GPU installed.

* test en console.

# ollama run qwen2.5-coder:7b