Skip to main content

Gateway

Every model call flows through one gateway that records latency, token usage, and cost from the registry list prices, and falls back to the alternate provider on errors. The most recent 50 calls:

Every model call in the app (chat, evals, the judge) flows through one gateway that observes and logs it.

  1. Send a chat message or run an eval first, then refresh this page.
  2. Each call lists the model, latency, input and output tokens, and the USD cost computed from list prices, newest first.
  3. If a provider call fails, the gateway retries on the other provider and the entry is flagged fallbackUsed.
TimeModelKindRouteTokens in/outLatencyCost
11 Jun 2026, 2:35:50 pmClaude Opus 4.8streamcomplex-reasoning2,227 / 2886,180 ms$0.0550
11 Jun 2026, 2:35:44 pmClaude Opus 4.8streamcomplex-reasoning1,953 / 1091,931 ms$0.0375
11 Jun 2026, 2:35:40 pmGPT-4.1streamcalculation480 / 1522,676 ms$0.0022
11 Jun 2026, 2:35:37 pmGPT-4.1streamcalculation341 / 572,335 ms$0.0011
11 Jun 2026, 2:10:58 pmGPT-4.1streamcalculation410 / 1564,529 ms$0.0021
11 Jun 2026, 2:10:54 pmGPT-4.1streamcalculation271 / 572,427 ms$0.0010
11 Jun 2026, 1:40:43 pmClaude Haiku 4.5generatejudge631 / 913,732 ms$0.0011
11 Jun 2026, 1:40:42 pmClaude Haiku 4.5generatejudge406 / 11412,201 ms$0.0010
11 Jun 2026, 1:40:39 pmClaude Opus 4.8generateeval1,186 / 4298,297 ms$0.0500
11 Jun 2026, 1:40:36 pmClaude Haiku 4.5generatejudge454 / 1144,654 ms$0.0010
11 Jun 2026, 1:40:35 pmClaude Haiku 4.5generatejudge470 / 1053,820 ms$0.0010
11 Jun 2026, 1:40:31 pmGPT-4.1generateeval313 / 1142,497 ms$0.0015
11 Jun 2026, 1:40:31 pmClaude Haiku 4.5generateeval1,046 / 1193,307 ms$0.0016
11 Jun 2026, 1:40:31 pmClaude Opus 4.8generateeval889 / 1324,098 ms$0.0232
11 Jun 2026, 1:40:30 pmGPT-4o minigenerateeval263 / 641,794 ms<$0.0001
11 Jun 2026, 1:40:29 pmGPT-4.1generateeval222 / 242,163 ms$0.0006
11 Jun 2026, 1:40:28 pmGPT-4o minigenerateeval211 / 161,818 ms<$0.0001
11 Jun 2026, 1:40:28 pmClaude Haiku 4.5generateeval940 / 591,139 ms$0.0012
11 Jun 2026, 1:39:43 pmClaude Opus 4.8generateeval1,192 / 3967,727 ms$0.0476
11 Jun 2026, 1:39:38 pmClaude Haiku 4.5generateeval1,046 / 1086,001 ms$0.0016
11 Jun 2026, 1:39:35 pmClaude Opus 4.8generateeval889 / 1384,149 ms$0.0237
11 Jun 2026, 1:39:34 pmGPT-4o minigenerateeval263 / 642,264 ms<$0.0001
11 Jun 2026, 1:39:33 pmGPT-4.1generateeval313 / 1101,669 ms$0.0015
11 Jun 2026, 1:39:32 pmClaude Haiku 4.5generateeval940 / 591,190 ms$0.0012
11 Jun 2026, 1:39:32 pmGPT-4.1generateeval222 / 241,225 ms$0.0006
11 Jun 2026, 1:39:31 pmGPT-4o minigenerateeval211 / 161,151 ms<$0.0001
11 Jun 2026, 1:39:01 pmGPT-4o ministreamfactual-lookup406 / 1275,039 ms$0.0001
11 Jun 2026, 1:38:56 pmGPT-4o ministreamfactual-lookup269 / 551,809 ms<$0.0001
11 Jun 2026, 1:38:44 pmGPT-4o ministreamfactual-lookup408 / 1212,585 ms$0.0001
11 Jun 2026, 1:38:41 pmGPT-4o ministreamfactual-lookup271 / 553,647 ms<$0.0001
11 Jun 2026, 1:38:35 pmGPT-4o ministreamfactual-lookup558 / 1152,396 ms$0.0002
11 Jun 2026, 1:37:58 pmGPT-4o ministreamfactual-lookup408 / 1202,757 ms$0.0001
11 Jun 2026, 1:37:55 pmGPT-4o ministreamfactual-lookup271 / 552,400 ms<$0.0001
11 Jun 2026, 1:36:32 pmGPT-4o ministreamfactual-lookup569 / 462,363 ms$0.0001
11 Jun 2026, 1:36:30 pmGPT-4o ministreamfactual-lookup432 / 555,171 ms<$0.0001
11 Jun 2026, 1:35:55 pmGPT-4.1streamcalculation357 / 452,843 ms$0.0011
11 Jun 2026, 1:35:52 pmGPT-4.1streamcalculation266 / 241,744 ms$0.0007
11 Jun 2026, 1:23:37 pmClaude Sonnet 4.6streampersonalised-advice2,538 / 764,341 ms$0.0088
11 Jun 2026, 1:23:32 pmClaude Sonnet 4.6streampersonalised-advice2,342 / 1425,766 ms$0.0092
11 Jun 2026, 1:23:09 pmClaude Opus 4.8streamcomplex-reasoning2,490 / 1985,488 ms$0.0522
11 Jun 2026, 1:23:04 pmClaude Opus 4.8streamcomplex-reasoning2,216 / 1092,654 ms$0.0414
11 Jun 2026, 1:22:40 pmGPT-4o ministreamfactual-lookup799 / 1022,555 ms$0.0002
11 Jun 2026, 1:22:37 pmGPT-4o ministreamfactual-lookup662 / 553,073 ms$0.0001
11 Jun 2026, 1:22:11 pmGPT-4o ministreamfactual-lookup592 / 404,172 ms$0.0001
11 Jun 2026, 1:22:07 pmGPT-4o ministreamfactual-lookup540 / 163,096 ms<$0.0001
11 Jun 2026, 4:04:52 amGPT-4o ministreamfactual-lookup573 / 402,232 ms$0.0001
11 Jun 2026, 4:04:49 amGPT-4o ministreamfactual-lookup521 / 162,944 ms<$0.0001