overview
What is transformers?
transformers is a machine learning model-definition framework developed by Hugging Face that enables developers, machine learning engineers, and researchers to access, train, and deploy state-of-the-art machine learning models across various modalities. It provides an open-source Python library, Hugging Face Transformers, which offers access to thousands of pre-trained models based on the transformer architecture for tasks in Natural Language Processing, Computer Vision, and Audio. The library simplifies the machine learning workflow from data processing to model deployment, abstracting away complexities of underlying deep learning frameworks like PyTorch, TensorFlow, and JAX. Recent developments include Transformers v5, released with its first candidate in December 2025 and updates in April 2026, focusing on modular architecture, enhanced training/inference, and first-class quantization support. The library integrates with the Hugging Face Hub, which hosts over 2 million public models and 500,000 datasets.