Revision history of "Ollama GPU usage validation"

From Notes_Wiki

Diff selection: Mark the radio buttons of the revisions to compare and hit enter or the button at the bottom.
Legend: (cur) = difference with latest revision, (prev) = difference with preceding revision, m = minor edit.

  • curprev 12:36, 2 February 2025‎ Saurabh talk contribs‎ 981 bytes +981‎ Created page with "Home > Local system based AI tools > Ollama > Ollama GPU usage validation =Ollama GPU usage validation= # Verify `/etc/systemd/system/ollama.service` has below line: #:<pre> #:: Environment="OLLAMA_FLASH_ATTENTION=1" #:</pre> # Run below in one terminal to monitor GPU usage including processes using GPU #:<pre> #:: watch nvidia-smi #:</pre> # Run some model on second terminal such as: #:<pre> #:: ollama run deepseek-r1:8b #:</pre> # In nvidia-s..."
Retrieved from "http://www.sbarjatiya.com/notes_wiki/index.php/Ollama_GPU_usage_validation"