Failover & Rotation
For each model we maintain multiple upstream routes (different providers/keys).- Weighted selection and cooldowns are used.
- When a route returns repeated errors it is temporarily removed from rotation.
- Healthy routes are preferred.
- Upstream failures are never charged to your quota.