Case Study 01
Python FastAPI gateway
AI Home Lab API Gateway
I built a local OpenAI-compatible gateway so my site, agents, and scripts could call one stable /v1 contract. Ollama, PostgreSQL, Redis, and Qdrant stay private on the Mac. The hard parts were auth, backpressure, model warmup, and zero public inbound ports.
Ingress
Cloudflare
Gateway limit
10 chats
Model runtime
Ollama 0.30.6
Memory profile
q8 KV