Vllm

Self Hosted AI: Actually Running Local LLMs for a Multi-User Household featured image

Self Hosted AI: Actually Running Local LLMs for a Multi-User Household

How self-hosted AI became the final piece of my homelab puzzle, delivering true parallel processing for multi-user setups and unlocking the real superpower of knowledge management.

Derek Armstrong - Software Engineer · AI · Infrastructure
Derek Armstrong
Read more
Self-Hosted AI Inference Cluster featured image

Self-Hosted AI Inference Cluster

I build and operate AI infrastructure right now, today.

Read more