I Built an LLM Traffic Router for My Homelab — Here is What Happened
I hooked up multiple local models behind a single proxy that routes traffic by complexity. Here is what I found deploying it on a cheap Intel GPU.
I hooked up multiple local models behind a single proxy that routes traffic by complexity. Here is what I found deploying it on a cheap Intel GPU.