Ollama error

Post Reply
vkfoto
Posts: 290
Joined: 19 Oct 16 2:51

Ollama error

Post by vkfoto »

Now that 2025.1.0.7494 has been installed and the database has been updated, I tried the new AI using Ollama with Gemma3. When I try it on a few random images, I keep getting "Ollama error (response code=500). What does that mean and how do I resolve it?
G8DHE
Posts: 763
Joined: 21 Aug 17 12:58

Re: Ollama error

Post by G8DHE »

If you look in the Users Ollama directory there are some log files that might explain the problem or at least give you some more info. Mine produced some Server html:500 errors and reported in the log as CUDA memory problems after restarting it settled down again happily.
CUDA error: out of memory
current device: 0, in function ggml_backend_cuda_synchronize at C:\a\ollama\ollama\ml\backend\ggml\ggml\src\ggml-cuda\ggml-cuda.cu:2414
cudaStreamSynchronize(cuda_ctx->stream())
C:\a\ollama\ollama\ml\backend\ggml\ggml\src\ggml-cuda\ggml-cuda.cu:73: CUDA error
[GIN] 2025/04/05 - 11:35:31 | 500 | 44.6904841s | 127.0.0.1 | POST "/v1/chat/completions"
[GIN] 2025/04/05 - 11:35:31 | 500 | 35.5196158s | 127.0.0.1 | POST "/v1/chat/completions"
[GIN] 2025/04/05 - 11:35:31 | 500 | 40.2995439s | 127.0.0.1 | POST "/v1/chat/completions"
Geoff Mather (G8DHE)
RobiWan
moderator
Posts: 243
Joined: 03 Nov 17 8:14

Re: Ollama error

Post by RobiWan »

vkfoto wrote: 05 Apr 25 12:38 Now that 2025.1.0.7494 has been installed
The lastest version is 2025.1.2.7551

And maybe I'm wrong, but CUDA is nVidia specific. Old driver?
Cheers, Robert

PSU V2025 Single User, Windows 11/MacOS . PSU V2025 PostgreSQL on Debian Linux Server
G8DHE
Posts: 763
Joined: 21 Aug 17 12:58

Re: Ollama error

Post by G8DHE »

Yes it could be nVidia specific but the problem resolved itself, sometimes shows up immediately after booting but then resolves itself after a second attempt. Drivers were updated yesterday so it might be a new problem rather than old drivers ;-)
Geoff Mather (G8DHE)
RobiWan
moderator
Posts: 243
Joined: 03 Nov 17 8:14

Re: Ollama error

Post by RobiWan »

Which drivers are you using game-ready or Studio?
Cheers, Robert

PSU V2025 Single User, Windows 11/MacOS . PSU V2025 PostgreSQL on Debian Linux Server
G8DHE
Posts: 763
Joined: 21 Aug 17 12:58

Re: Ollama error

Post by G8DHE »

Studio 572.83 which seem to be the latest dated 18th March 2025
Geoff Mather (G8DHE)
Post Reply