Ensure high availability
Errors & Reliability Monitoring
Monitor error rate, cache hit rate, and reliability trends directly from the dashboard.
Reliability · last hour
Live
- Error rate 0.4%−0.2%
- Cache hit rate 31%+6%
- 429s from one providerrerouted
- Upstream timeoutretried
01
Error Rate Tracking
Monitor error rates across all providers and models
02
Cache Hit Rate
Track cache efficiency and optimize for cost savings
03
Reliability Metrics
Monitor uptime and availability of your LLM services
04
Alerting
Get notified when error rates exceed acceptable thresholds
See it in the dashboard
Error Rate
Track reliability and identify issues early
1.37%
Error Rate
Failed Requests29
Successful Requests2,087
Total Requests2,116
Cache Performance
Monitor cache efficiency and cost savings
11.01%
Cache Hit Rate
Cached Responses233
Estimated Savings$1.17
Cache EfficiencyExcellent
Reliability Summary
Overall system health metrics
98.63%
Success Rate
1.2s
Avg Latency
0
Critical Errors
99.2%
Uptime
Built for
Proactive Monitoring
Catch issues before they affect your users
SLA Compliance
Track and ensure you meet your SLA commitments
Incident Response
Quickly identify and resolve issues
More in observability & cost
All featuresStart using Errors & Reliability Monitoring today
One API key. Every model. Live in minutes.