Ollama error
Ollama error
Now that 2025.1.0.7494 has been installed and the database has been updated, I tried the new AI using Ollama with Gemma3. When I try it on a few random images, I keep getting "Ollama error (response code=500). What does that mean and how do I resolve it?
Re: Ollama error
If you look in the Users Ollama directory there are some log files that might explain the problem or at least give you some more info. Mine produced some Server html:500 errors and reported in the log as CUDA memory problems after restarting it settled down again happily.
CUDA error: out of memory
current device: 0, in function ggml_backend_cuda_synchronize at C:\a\ollama\ollama\ml\backend\ggml\ggml\src\ggml-cuda\ggml-cuda.cu:2414
cudaStreamSynchronize(cuda_ctx->stream())
C:\a\ollama\ollama\ml\backend\ggml\ggml\src\ggml-cuda\ggml-cuda.cu:73: CUDA error
[GIN] 2025/04/05 - 11:35:31 | 500 | 44.6904841s | 127.0.0.1 | POST "/v1/chat/completions"
[GIN] 2025/04/05 - 11:35:31 | 500 | 35.5196158s | 127.0.0.1 | POST "/v1/chat/completions"
[GIN] 2025/04/05 - 11:35:31 | 500 | 40.2995439s | 127.0.0.1 | POST "/v1/chat/completions"
Geoff Mather (G8DHE)
Re: Ollama error
The lastest version is 2025.1.2.7551
And maybe I'm wrong, but CUDA is nVidia specific. Old driver?
Cheers, Robert
PSU V2025 Single User, Windows 11/MacOS . PSU V2025 PostgreSQL on Debian Linux Server
PSU V2025 Single User, Windows 11/MacOS . PSU V2025 PostgreSQL on Debian Linux Server
Re: Ollama error
Yes it could be nVidia specific but the problem resolved itself, sometimes shows up immediately after booting but then resolves itself after a second attempt. Drivers were updated yesterday so it might be a new problem rather than old drivers 

Geoff Mather (G8DHE)
Re: Ollama error
Which drivers are you using game-ready or Studio?
Cheers, Robert
PSU V2025 Single User, Windows 11/MacOS . PSU V2025 PostgreSQL on Debian Linux Server
PSU V2025 Single User, Windows 11/MacOS . PSU V2025 PostgreSQL on Debian Linux Server
Re: Ollama error
Studio 572.83 which seem to be the latest dated 18th March 2025
Geoff Mather (G8DHE)