title: AI Gateway
created: 2026-07-04
updated: 2026-07-04
type: entity
tags: [apps, ai-gateway, llm, models]
AI Gateway
Model switching proxy on Windows. Routes LLM requests between available models and exposes a control panel.
Details
| Property | Value |
|---|---|
| Host | Windows (100.119.202.68) |
| Port | :5000 |
| URL | http://144.91.107.8/ai-gateway/ |
| Tech | Python (ai_gateway.py) |
| Endpoints | POST /switch, GET /status, GET /models |
Main Functions
- Switch between LLM models (27b, 9b, nemotron)
- Health check endpoint
- Model status reporting
- Control panel UI
Dependencies
- Qwen LLM — the underlying model server(s)
- Tailscale — accessible from VPS
- NGINX — reverse proxy at /ai-gateway/
Cross-Functionality
- Switches model used by SimpleChat, Decksmith, Meeting App
- Controls which Qwen LLM variant answers requests
- Bridged via Tailscale to VPS apps