I host self-hosted AI models on a dual-CPU desktop that has a 24GB AMD GPU. It’s neat but surprisingly slow and can’t handle models whose .gguf files are larger than like, 9GB.

Despite this limitation, I was able to make a toy demo where I use an AI model to continually update and edit a Git repo.

https://github.com/meltingscales/pillbugplants

I’ve learned that “Aider” is a neat, young, and somewhat buggy AI coding tool to rival Claude’s CLI.