← Back to all projects

LLM Monitor (OpenRouter Watchdog)

2026
LLMObservabilityMonitoringOpenRouterTelegram BotFastAPIPythonDockerCI/CDSQLite

LLM Monitor is a comprehensive watchdog system designed to track the health of free Large Language Models on the OpenRouter platform. It addresses the volatility of free tier availability by providing instant notifications when models go down or return online.

Key Components:

  • Automated Discovery: Scans the OpenRouter API hourly to find and categorize new free models (including VLMs).
  • Real-time Health Checks: Performs smoke tests every 10 minutes to measure TTFT (Time To First Token) and overall availability.
  • Telegram Integration: A feature-rich bot allowing users to subscribe to alerts, check current status via /status, and receive instant push notifications on state changes.
  • Web Dashboard: A FastAPI-powered interface providing a clean overview of monitored models and their recent performance metrics.
  • Production-Ready CI/CD: Fully automated pipeline with GitHub Actions that builds 'clean' Docker images (no baked-in secrets) and performs secure SSH deployments using dynamic environment variable injection.

Media Gallery

LLM Monitor (OpenRouter Watchdog) media 1