Three and a Half Weeks, 689M Tokens, No Meter
689M tokens. 25 days. ~$40 electricity. The math, the caveats, and what changed when the meter stopped existing.
Qwen3.8 27B on Dual RTX 3090s: A vLLM Field Report
Three days into making Qwen3.8 27B my daily local coding driver on dual 3090s — the hybrid linear-attention architecture, an OOM that masqueraded as a backend error, and what the …
I Built an LLM Traffic Router for My Homelab — Here is What Happened
I hooked up multiple local models behind a single proxy that routes traffic by complexity. Here is what I found deploying it on a cheap Intel GPU.
Locking Down a DMZ Web Server with Cloudflare Tunnels
Hardening an internet-facing web server sitting in a home DMZ: firewall, SSH, SELinux, fail2ban, and tunnel-only traffic via Cloudflare.
Why I Use Both GitHub and Forgejo - And Why That Matters
I use GitHub for public collaboration and Forgejo for self-hosted control. They share the same Actions workflow syntax, just in different folders. Here is why running both makes …
Self-Hosting Plausible Analytics with Podman and Cloudflare Tunnels
How I deployed self-hosted Plausible analytics on a podman server, routed it through Cloudflare tunnels, and integrated it with my Hugo site — with a backup strategy that actually …
Self Hosted AI: Actually Running Local LLMs for a Multi-User Household
How self-hosted AI became the final piece of my homelab puzzle, delivering true parallel processing for multi-user setups and unlocking the real superpower of knowledge management.
Running Qwen3.6 27B Locally on Dual RTX 3090s with vLLM v0.19
How I went from a blank Docker template to 116+ tok/s with speculative decoding, FlashInfer, and a 160k context window on dual 3090s.
The Proxmox Utility Toolkit: Stop Cloning That VM by Hand
A tour of my open-source Proxmox utility toolkit — scripts, docs, and learning paths for homelabbers and enterprise engineers who are tired of repeating themselves.
Qwen3.5 Showdown: 27B Q8 vs 35B-A3B Q8 — Real-World Testing for Local AI
A real-world comparison of Qwen3.5 27B Q8 and 35B-A3B Q8 running locally on a dual RTX 3090 homelab — which one actually belongs in your daily workflow?
Showing 1-10 of 14 items (Page 1 of 2)