LLM serving on DGX Spark
Gateway on a Proxmox VM, vLLM per model in its own container, Prometheus and Grafana for GPU metrics.
Read EP.1 and EP.2 →Inference, GPU serving, gateways and observability.
From bare-metal servers to Kubernetes across multi-cloud and multi-IDC setups, and now LLM serving on a DGX Spark in my homelab. I build the gateway, GPU and observability layers that make AI run.
“Engineering is the art of organizing complexity into invisible simplicity.”
philosophyGateway on a Proxmox VM, vLLM per model in its own container, Prometheus and Grafana for GPU metrics.
Read EP.1 and EP.2 →A custom smart home energy management system built for optimized power use and IoT automation.
A private cloud of containerized services, media servers and dev tools on self-managed hardware.
Home automation that combines IoT sensors, custom scripts and centralized control.
A gateway I build myself to route LLM traffic, with per-provider failover, cooldowns, an MCP proxy, and an admin UI.
A delivery workflow where AI agents open PRs, run CI, and review code, with human approval gates before every merge and release.