Pular para o conteúdo
#0709
Exec

The model outage your users never noticed

9:14 AM. Your primary model starts returning errors. Your app never finds out.

The app's AI calls go through a script in front of the gateway. The script catches the failed upstream call and retries the same request against the fallback model: same OpenAI-compatible shape, different model field. The response comes back a beat slower, tagged with a header so you can count how often it happens.

Failover logic usually lives in every call site, half-tested, or inside a vendor SDK you don't control. Here it's fifteen lines you wrote, in one place, covering every AI call your product makes.

You read about the outage at lunch; your users never did.