Yeah I think there's probably some really cool stuff you can do there, I really want to try it out. You could definitely run an Ollama model on your local network, e.g. from your laptop or desktop PC and have your Raspberry Pi make requests to it.
You might even be able to connect an eGPU to a Raspberry Pi somehow, but not entirely sure on it.
What about taking it mobile on something small like a Raspberry Pi? You could give it a mic and camera, but keep it private and offline.
Yeah I think there's probably some really cool stuff you can do there, I really want to try it out. You could definitely run an Ollama model on your local network, e.g. from your laptop or desktop PC and have your Raspberry Pi make requests to it.
You might even be able to connect an eGPU to a Raspberry Pi somehow, but not entirely sure on it.