Glossary
AI gateway
One control point that every application's model calls pass through, whichever provider answers: it can hold the provider keys and add authentication, rate and spend limits, caching, routing between models, content checks and logs.
Cloudflare's AI Gateway, for example, offers all of these, plus data loss prevention and logs of every request and response. That makes a gateway a good place to keep API keys out of application code and to set budgets, and a valuable target: its logs hold every prompt and answer, so guard who can read them.