I tried llamafile on Windows with two GGUF models that I also imported into Ollama. Here is what worked, what went wrong and how to repeat the process using the CPU.
Artificial IntelligenceRead articleBLOG · DANIEL GARCIA
#Local AI
Experiments with AI models running on your own computer, including tools, performance and limitations.
Follow via RSS ↗Running AI locally no longer necessarily requires high-end hardware. In this article I look at when a local model makes sense, where its limitations begin, and why the best choice may simply be the smallest model that can solve the task well.
Artificial IntelligenceRead article
