Blog

Part 3 of the “Local AI” series — Coding, reasoning, medical summarization, and clinical decision support Benchmarks tell you how fast a model runs. They don’t tell you if it can actually do anything useful. In Part 1 we set up Ollama, and in Part 2 we measured generation speeds. Now we push these models…

Part 2 of the “Local AI” series — Benchmarks and recommendations for CPU-only inference In Part 1, we installed Ollama and ran our first local model. Now the question becomes: which model should you actually use? The answer depends on your hardware and your patience. On CPU-only systems, model size directly impacts speed — and…

Part 1 of the “Local AI” series — A practical guide to running local LLMs on CPU-only consumer hardware You’ve probably heard that running AI models locally requires expensive hardware: a Mac with Apple Silicon, or a gaming PC with a high-end NVIDIA GPU. This isn’t entirely wrong — those setups are faster. But they’re…