overview
Overview
KServe is an open-source, Kubernetes-native platform designed for standardized, distributed AI inference. It provides a serving layer for Generative and Predictive AI models within a Kubernetes environment.
The platform offers features such as autoscaling, scale-to-zero, and canary deployments. KServe focuses on standardizing the serving layer across various machine learning frameworks, providing a serverless experience for model deployment on Kubernetes.
