https://www.zdenek-jurman.cz/tags/ai/ Recent content in AI on Zdenek Jurman Hugo en Sat, 11 Jul 2026 00:00:00 +0000 https://www.zdenek-jurman.cz/posts/mesh-llm/ Sat, 11 Jul 2026 00:00:00 +0000 https://www.zdenek-jurman.cz/posts/mesh-llm/ <p>Mesh LLM pools GPUs and memory across machines and exposes the result as one OpenAI-compatible API at http://localhost:9337/v1. Start one node, add more nodes later, and let the mesh decide whether a model runs locally, routes to a peer, or uses Skippy stage splits for models that are too large for one box.</p> https://www.zdenek-jurman.cz/posts/dont-use-ollama/ Wed, 15 Apr 2026 00:00:00 +0000 https://www.zdenek-jurman.cz/posts/dont-use-ollama/ <p>Ollama is the most popular way to run local LLMs. It shouldn’t be. It gained that position by being first, the first tool that made llama.cpp accessible to people who didn’t want to compile C++ or write their own server configs. That was a real contribution, briefly. But the project has since spent years systematically obscuring where its actual technology comes from, misleading users about what they’re running, and drifting from the local-first mission that earned it trust in the first place. All while taking venture capital money.</p>