Zach Wright Email Zach
All Updates

Here is what you missed while you were shipping.

Swarm Daily: The Base URL Is Becoming the Strategy

Gateways, compatibility layers, and model-swappable tooling are turning provider choice into routing policy instead of a rewrite.

The Big Thing

Provider choice is moving out of SDK rewrites and into gateways, base URLs, and task-level model pickers.

Why it matters: once OpenAI-compatible and Anthropic-compatible surfaces sit in front of multiple vendors, switching models stops being a replatforming event. The operator job shifts to deciding which requests can stay on the common path, then attaching routing, budgets, auth, observability, and privacy rules at the gateway. Native APIs still matter, but increasingly as escape hatches for premium features instead of the default integration path.

Code & Tools

  1. Cloudflare default gateway bootstrap - the first authenticated request can now stand up the gateway, which means teams can treat the gateway endpoint as day-zero infrastructure instead of a later hardening step. https://developers.cloudflare.com/changelog/post/2026-03-02-default-gateway/ https://developers.cloudflare.com/ai-gateway/configuration/manage-gateway/
  2. Cloudflare Dynamic Routing - route names can encapsulate provider choice, A/B tests, header-based branches, quota checks, and failover rules, which turns model selection into a deployable routing graph. https://developers.cloudflare.com/ai-gateway/features/dynamic-routing/
  3. Cloudflare Unified Billing + ZDR - one Cloudflare bill can cover OpenAI, Anthropic, Google AI Studio, xAI, and Groq traffic, with spend limits and zero-data-retention controls attached at the gateway. https://developers.cloudflare.com/ai-gateway/features/unified-billing/
  4. Vercel's compatible endpoint stack - one gateway now exposes OpenAI Chat Completions, OpenAI Responses, Anthropic Messages, and provider-order controls, so existing clients can move by changing the base URL instead of the SDK. https://vercel.com/docs/ai-gateway https://vercel.com/docs/ai-gateway/sdks-and-apis/openai-chat-completions https://vercel.com/docs/ai-gateway/sdks-and-apis/anthropic-messages-api https://vercel.com/docs/ai-gateway/provider-options
  5. GitHub model-pick surfaces - Copilot CLI lets operators switch models mid-session with /model, PR comments now support choosing the model for @copilot, and GPT-5.4 is generally available across more Copilot surfaces. https://github.blog/changelog/2026-02-25-github-copilot-cli-is-now-generally-available/ https://github.blog/changelog/2026-03-05-pick-a-model-for-copilot-in-pull-request-comments/ https://github.blog/changelog/2026-03-05-gpt-5-4-is-generally-available-in-github-copilot/

Tech Impact

Meme of the Day

"Standards" (xkcd) - because the market's answer to "too many model APIs" is to add one more compatibility layer and hope this is the one that everyone finally shares.

Image URL: https://imgs.xkcd.com/comics/standards.png
Post: https://xkcd.com/927/