overview
Overview
Kong AI Gateway extends Kong's enterprise API management platform. It provides LLM-specific capabilities such as prompt compression, semantic caching, and dynamic model routing. This solution integrates LLM routing and governance into a broader, enterprise-grade API management framework.
It offers robust API management, access control, and policy enforcement specifically for LLM traffic. The gateway includes strong token compression features and provides robust routing and fallback mechanisms. It is designed for organizations already utilizing Kong's API management ecosystem.