#local-models
11 posts
2026 - October
1 post2026 - June
1 post2026 - April
2 posts2026 - March
1 post2026 - January
1 post2025 - April
5 posts2026 - October
1 postWhich Jev-like AI Decision/Classifier Model Is Best?
I ran my own decision-model benchmark: Jev, Clef, OpenAI Decisions and Microsoft Decision-1 in the cloud, plus eighteen open configurations (Perplexity Decider 27B, Decision 3.0 and Edge, Clef-flash, Kev, Jebadiah, Mapika, Eikos, Laya, Julia, GLiNER, Simple-Jev) on my Strix Halo, across more than 22 thousand classifications with cases in English and Portuguese. The top now has two open-weights models: Perplexity and Decision 3.0 tied at 99.4%, with identical labels on the 1,024 classifications and 100% in Portuguese. Microsoft Decision-1 tied Jev at 97.6% while being the cheapest hosted one. Full table, cost in support emails, gotchas, and where the data converges.
2026 - June
1 postLLM Benchmark: Kimi v2.7 Code, GLM 5.2, MiniMax M3 Local
In the benchmark, GLM 5.2 scored 87 and Kimi K2.7 Code scored 86. The open MiniMax M3 doesn’t fit in 128 GB, while serious programming still calls for Opus 4.8 or GPT 5.5.
2026 - April
2 postsHow ElevenLabs Was Not Killed by Qwen3 TTS
When Qwen3 TTS dropped, half the internet called it an 'ElevenLabs killer'. I spent weeks trying to run Qwen3 in production on my podcast. Yesterday I finally switched to ElevenLabs v3. Less than a day later, I can tell you: open source is still miles behind.
Testing Open Source and Commercial LLMs - Can Anyone Beat Claude Opus?
This historical benchmark compared 33 LLMs on a Rails app: Opus, Sonnet, and GLM 5 worked, while Qwen 3.6 35B came close on an RTX 5090 after a fix. The rankings were later revised.
2026 - March
1 postReview: Minisforum MS-S1 Max | AMD AI Max+ 395 with 96GB of VRAM
In my tests, the RTX 5090 was up to 7 times faster on models that fit within 32GB. The Minisforum, however, ran 50-to-81GB models the card can’t handle.
2026 - January
1 postAI Agents: Is GLM 4.7 Flash really that good?
Running GLM 4.7 Flash locally on an RTX 5090 via Ollama to see if it can finally match commercial LLMs on a hard coding challenge.
2025 - April
5 postsDissecting an Ollama Modelfile - Tuning Qwen3 for Code
A walkthrough of sampling parameters (temperature, top_p, top_k, min_p, repeat_penalty) and how to build a custom Ollama Modelfile to tune Qwen3 for software development tasks.
Your Own Free Universal Co-Pilot Running Local: AIDER-OLLAMA-QWEN
How to run Aider with Ollama and Qwen 2.5 Coder locally to build a free, universal Co-Pilot alternative that works with any editor.
LLM Hello World: Building Your Own Local AI Chat
A hands-on Hello World experiment explaining how LLMs actually work under the hood, building a tiny local chat CLI with Qwen 2.5 Coder running on a single GPU.
Changing Clothes Using A.I. (ComfyUI)
A walkthrough of a ComfyUI workflow using IDM-VTON and IPAdapter to swap clothing on photos while preserving the original face and pose.
Using A.I. (ComfyUI) to Generate NPCs in Game Development
A walkthrough of Mickmumpitz's ComfyUI workflow for generating coherent NPC character sheets from scratch, running on my Docker Compose setup.