The Model Runs, the User Waits: The Paradox of Large Local LLMs

distressed early 20th-century doctor struggles to inject an enormous syringe labeled “Llama 3.1 405B Parameters” into a tiny desktop PC

Hunting for the largest language model you can run on a personal computer has turned into a discipline of its own. Forums, repositories and social feeds circulate configurations that load models of 70, 120, even several hundred billion parameters, using consumer GPUs, generous amounts of system RAM and increasingly aggressive quantisation. The results are frequently … Read more

Natural Language Processing for Medical Report Analysis – Part 3

A doctor reads a discharge letter to a patient.

Machine Learning and Large Language Models for Clinical Text Analysis Article authored by Michele D. Pierri, MD Cardiac Surgeon & Medical Technology Researcher Last updated: May 2025 Reading time: 30 minutes Abstract The first two articles in this series traced a progression from rule-based pattern matching (regular expressions) to linguistic analysis (spaCy/scispaCy) for extracting structured … Read more

Natural Language Processing for Medical Report Analysis – Part 2

A doctor translates text

Introduction to Natural Language Processing for Medical Report Analysis: Advanced Linguistic Analysis with spaCy and scispaCy for Medical Reports Article authored by Michele D. Pierri, MD Cardiac Surgeon & Medical Technology Researcher Last updated: May 2025 Reading time: 30 minutes Abstract Regular expressions give us a solid foundation for pulling structured data out of clinical … Read more

Local AI: The LM Studio Surprise

A researcher observes a brain in a cage

Part 4: the conclusion of the “Local AI” series — The LM Studio surprise: same model, same hardware, 40-200x faster In Part 3, we pushed gemma4:e4b through four demanding tests. The results were impressive — excellent clinical reasoning, comprehensive summaries, working code. But the wait times were brutal: 5 to 16 minutes per response on … Read more

Local AI: Choosing the Right Model for Your Hardware

A researcher observes a brain in a cage

Part 2 of the “Local AI” series — Benchmarks and recommendations for CPU-only inference In Part 1, we installed Ollama and ran our first local model. Now the question becomes: which model should you actually use? The answer depends on your hardware and your patience. On CPU-only systems, model size directly impacts speed — and … Read more

Local AI: Running LLMs Without Dedicated Graphics

A researcher observes a brain in a cage

Part 1 of the “Local AI” series — A practical guide to running local LLMs on CPU-only consumer hardware You’ve probably heard that running AI models locally requires expensive hardware: a Mac with Apple Silicon, or a gaming PC with a high-end NVIDIA GPU. This isn’t entirely wrong — those setups are faster. But they’re … Read more

Natural Language Processing for Medical Report Analysis – Part 1

Painterly rural scene at sunset, where a solitary man studies an immense handwritten scroll by candlelight beside a thatched farmhouse, surrounded by hay bales, a wooden desk, an antique typewriter, barrels, and farming tools.

Introduction to Natural Language Processing for Medical Report Analysis: Pattern Matching with Regular Expressions Article authored by Michele D. Pierri, MD Cardiac Surgeon & Medical Technology Researcher Last updated: January 2025 Reading time: 25 minutes Abstract Medical discharge summaries contain critical clinical information that remains largely inaccessible to automated analysis due to their unstructured nature. … Read more