Who can benefit from using Microsoft Olive?

Microsoft Olive is designed for AI model developers, machine learning engineers, and organizations that want to optimize deployment of ONNX models across various hardware platforms.

What new features does Olive include?

Recent updates include selective mixed precision, blockwise RTN quantization, and a native GPTQ implementation, all geared towards improving model efficiency and lowering deployment costs.

How does Olive simplify the optimization process?

With enhancements such as a streamlined CLI command, improved Python APIs, and advanced tools for evaluation and packaging, Olive enables users to optimize and test models with minimal manual intervention.

AI Tool

Optimize Your AI Models with Microsoft Olive

Effortless model compression and deployment for CPUs, GPUs, and NPUs.

shipped Nov 20, 2025deploypaid

DeployHardware & AcceleratorsCPU-only Optimizers

Why it matters

1Unlock significant cost savings with advanced mixed-precision and quantization techniques for large language models.

2Seamlessly integrate with a wide range of hardware and frameworks, ensuring optimal performance across diverse deployment environments.

3Experience a user-friendly interface that simplifies model optimization, making it accessible for both novices and experts.

Specs

API Docs

View Documentation →

GitHub

View Repository →

API Available

Yes, public API

overview

What is Microsoft Olive?

Microsoft Olive is a powerful model compression and compilation pipeline designed to enhance the efficiency of AI models. It targets a variety of hardware platforms, including CPUs, GPUs, and NPUs, helping developers deploy models with ease.

Supports ONNX models for broader compatibility.
Optimizes for both cost and performance.
Streamlines the deployment process.

features

Key Features of Microsoft Olive

Olive offers a plethora of features aimed at improving model performance while simplifying the optimization process. With new updates in mixed-precision and quantization, users can expect enhanced efficiency and reduced operational costs.

Selective mixed precision and blockwise RTN quantization.
Native GPTQ implementation for large language models.
User-friendly CLI commands for optimization.

use cases

Use Cases for Microsoft Olive

Olive is invaluable for AI model developers and machine learning engineers seeking to enhance model deployment across various hardware platforms. Whether you're working in the cloud or on edge devices, Olive simplifies the optimization lifecycle.

Optimize and deploy AI models efficiently.
Design models applicable to diverse hardware targets.
Facilitate collaboration with frameworks like Hugging Face.

Policies

Pricing Page

View Pricing→

Similar Tools

Compare Alternatives

Other tools you might consider

Intel Neural Compressor

ONNX Runtime CPU EP

Intel OpenVINO

Apache TVM Unity

OpenVINO Optimization Toolkit

View on Stork→

Visit Microsoft Olive↗

Connect

⌘

GitHubgithub.com/fluidicon.png

AI Reputation Report

Is Microsoft Olive yours?

ChatGPT, Perplexity, Gemini, Claude & Grok answer buyer questions about Microsoft Olive every day. See whether they name Microsoft Olive — or send buyers to a rival.

See what AI saysfree preview