overview
What is Vellum Response Cache?
Vellum Response Cache is a cutting-edge tool designed to store prompt and response pairs efficiently, enabling swift lookups and reducing reliance on complex model calls. By focusing on high-confidence matches, it ensures your responses are both accurate and timely.
- Optimized for fast retrieval of responses.
- Reduces latency and enhances user experience.
- Perfect for applications needing real-time data.