After my adventure with [[Serge LLaMA AI Chat - Windows Podman Container Setup|Serge AI Chat]] it was time to take a look at other AI tools. But now in combination with NixOS. And I would like to use the GPU this time, cuda in my case, where Serge only used... [ Read More]

Serge is a chat interface crafted with llama.cpp for running Alpaca models. Because it is fully dockerized it was the perfect choice for me, also the software seems trusted to use. [ Read More]