Three and a Half Weeks, 689M Tokens, No Meter
689M tokens. 25 days. ~$40 electricity. The math, the caveats, and what changed when the meter stopped existing.
Qwen3.8 27B on Dual RTX 3090s: A vLLM Field Report
Three days into making Qwen3.8 27B my daily local coding driver on dual 3090s — the hybrid linear-attention architecture, an OOM that masqueraded as a backend error, and what the …
Highly Available AI Inference Cluster
What this proves: Resilience — enterprise-grade AI infrastructure at a single operator's desk. A custom routing plane in front of a three-server GPU fleet that switches models and …
•
3 min read
Read more
I Built an LLM Traffic Router for My Homelab — Here is What Happened
I hooked up multiple local models behind a single proxy that routes traffic by complexity. Here is what I found deploying it on a cheap Intel GPU.
Running Qwen3.6 27B Locally on Dual RTX 3090s with vLLM v0.19
How I went from a blank Docker template to 116+ tok/s with speculative decoding, FlashInfer, and a 160k context window on dual 3090s.
Build Your Personalized AI System Prompt
The secret to a great AI assistant isn't the model — it's what you tell it about yourself. Here's the framework for building a system prompt that makes AI actually useful.
Qwen3.5 Showdown: 27B Q8 vs 35B-A3B Q8 — Real-World Testing for Local AI
A real-world comparison of Qwen3.5 27B Q8 and 35B-A3B Q8 running locally on a dual RTX 3090 homelab — which one actually belongs in your daily workflow?
One Year Later: The Agentic CLI Revolution Revisited
A year ago, I predicted CLI AI tools would transform development. Here's what actually happened—the good, the unexpected, and the 'wait, what?' moments.
From Google Skills to AI Skills: The Evolution of Information Discovery
The art of crafting perfect search queries has evolved into the skill of prompt engineering. Learn how mastering AI interactions is the next generation of being a master Googler.
AI and Machine Learning for Coders
Skip the theory overload—build working ML models fast with TensorFlow and deploy them in production.
By Laurence Moroney
TECH
7
LEAD
2
GROW
5
•
1 min read
Read more
Showing 1-10 of 16 items (Page 1 of 2)