vulkaninfo --summary
$ sudo systemctl edit ollama.service
## Editing /etc/systemd/system/ollama.service.d/override.conf
### Anything between here and the comment below will become the contents of the drop-in file
[Service]
Environment="OLLAMA_VULKAN=1"
Environment="OLLAMA_IGPU_ENABLE=1"
Environment="OLLAMA_FLASH_ATTENTION=1"
Environment="GGML_VK_VISIBLE_DEVICES=0"
### Edits below this comment will be discarded
forrás: https://www.blogger.com/blog/post/edit/5244940777514615496/130213258824047445
Megjegyzések
Megjegyzés küldése