I tried llamafile on Windows with two GGUF models that I also imported into Ollama. Here is what worked, what went wrong and how to repeat the process using the CPU.
Artificial IntelligenceRead articleBLOG · DANIEL GARCIA
Artificial Intelligence
Exploring AI models, tools and agents through practical experiments, tests and reflections on their capabilities and limitations.
Follow via RSS ↗Running AI locally no longer necessarily requires high-end hardware. In this article I look at when a local model makes sense, where its limitations begin, and why the best choice may simply be the smallest model that can solve the task well.
Artificial IntelligenceRead articleSkills turn instructions and procedures into reusable capabilities for Artificial Intelligence agents. In this article, we explore how they work, their structure, their main components, and the best practices for creating consistent, secure and reusable Skills.
Artificial IntelligenceRead article
