Apache APISIX

Apache APISIX is an open-source API Gateway designed for high-performance traffic management across APIs, microservices, and LLM workloads. It provides dynamic routing, load balancing, and traffic management capabilities. While a general-purpose API gateway, Apache APISIX has extended its functionality to include an AI Gateway specifically built for LLM and AI workloads. It offers infrastructure-level traffic management for these applications, supporting various protocols and integrations.