Three and a Half Weeks, 689M Tokens, No Meter
689M tokens. 25 days. ~$40 electricity. The math, the caveats, and what changed when the meter stopped existing.
Qwen3.8 27B on Dual RTX 3090s: A vLLM Field Report
Three days into making Qwen3.8 27B my daily local coding driver on dual 3090s — the hybrid linear-attention architecture, an OOM that masqueraded as a backend error, and what the …
Highly Available AI Inference Cluster
What this proves: Resilience — enterprise-grade AI infrastructure at a single operator's desk. A custom routing plane in front of a three-server GPU fleet that switches models and …
•
3 min read
Read more
Why I Use Both GitHub and Forgejo - And Why That Matters
I use GitHub for public collaboration and Forgejo for self-hosted control. They share the same Actions workflow syntax, just in different folders. Here is why running both makes …
Self-Hosting Plausible Analytics with Podman and Cloudflare Tunnels
How I deployed self-hosted Plausible analytics on a podman server, routed it through Cloudflare tunnels, and integrated it with my Hugo site — with a backup strategy that actually …
Self Hosted AI: Actually Running Local LLMs for a Multi-User Household
How self-hosted AI became the final piece of my homelab puzzle, delivering true parallel processing for multi-user setups and unlocking the real superpower of knowledge management.
Running Qwen3.6 27B Locally on Dual RTX 3090s with vLLM v0.19
How I went from a blank Docker template to 116+ tok/s with speculative decoding, FlashInfer, and a 160k context window on dual 3090s.
The Proxmox Utility Toolkit: Stop Cloning That VM by Hand
A tour of my open-source Proxmox utility toolkit — scripts, docs, and learning paths for homelabbers and enterprise engineers who are tired of repeating themselves.
Self-Hosted AI Inference Cluster
I build and operate AI infrastructure right now, today.
•
1 min read
Read more
Gitea: Git on Your Own Terms
Discover the benefits of self-hosting Git with Gitea in your home lab. Lightweight, fast, and secure—control your code on your terms!