Skip to content

The Token Company

The Token Company provides an API-hosted compression middleware that preprocesses Large Language Model (LLM) inputs to reduce token usage and optimize performance.

Paid · API

stork
I am one still image.
One typed sentence. This clip cost 5 cents, the minimum per video.
Make a photo talk for 20 cents a minute.
Upload one photo and type the words. No subscription. One free video a day.
Make one freeDevelopers: there is an API

What is The Token Company?

The Token Company is a Large Language Model (LLM) input compression tool developed by The Token Company that enables developers and organizations to reduce the number of input tokens for large language models. It utilizes an extractive machine learning classifier to achieve token reduction while preserving the original accuracy and context of the input. The company's core offering is an API-hosted compression middleware that preprocesses LLM inputs, employing its proprietary "Bear" series of machine learning models to identify and remove low-signal or redundant tokens from prompts before they are sent to LLMs such as GPT, Claude, and Gemini. This process aims to preserve the semantic meaning of the input while significantly reducing its length, thereby optimizing LLM performance by cutting costs, improving efficiency, and enhancing accuracy. Key models include bear-1 (released October 2025), bear-1.1 (January 2026), and Bear-2-Safety (June 2026).

Key Features of The Token Company

The Token Company's API provides specialized functionalities for optimizing Large Language Model interactions through advanced token compression. Its proprietary Bear-2 model is central to its offerings, focusing on efficiency and semantic integrity.

  • Bear-2 prompt compression API for LLM inputs.
  • Utilizes an extractive machine learning classifier for token reduction.
  • Preserves original accuracy and context of input during compression.
  • Strips low-signal tokens from LLM inputs, offering 10-40% reduction.
  • Functions as a standalone API for general text compression.
  • Achieves below 50ms inference latency with full determinism and cache safety.
  • Offers one-line integration with OpenAI or Anthropic clients.
  • Includes a customizable compression aggressiveness parameter.
  • Supports safe labels for critical content to prevent unintended removal.
  • Provides fine-tuning capabilities for domain-specific data.

Who Should Use The Token Company?

The Token Company is designed for developers and organizations seeking to enhance the efficiency and cost-effectiveness of their Large Language Model applications. Its compression capabilities are particularly beneficial for scenarios involving extensive text processing and high token volumes.

  • Agent Frameworks: For improving the performance of long-running AI agents that analyze extensive datasets.
  • Web-Research and Enrichment Pipelines: To optimize the processing of large volumes of text data from web sources.
  • RAG Systems: For enhancing Retrieval-Augmented Generation systems by making inputs more concise and efficient.
  • Chat Applications with Long Histories: To manage and reduce token costs associated with extended conversational contexts.
  • Document Workflows: Applicable in legal, financial, and healthcare sectors for efficient analysis of lengthy documents.
  • Coding Agents: For improving the understanding of architectural contexts without altering code content.

How to Use The Token Company

Integrating The Token Company's compression API typically involves incorporating its endpoint into existing LLM application workflows. The service is designed for straightforward implementation with popular LLM clients.

  1. Obtain an API key from The Token Company.
  2. Integrate the API using a one-line modification with OpenAI or Anthropic clients.
  3. Send LLM prompts to The Token Company's API for compression.
  4. Receive the compressed prompt from the API.
  5. Forward the compressed prompt to the target LLM (e.g., GPT, Claude, Gemini).
  6. Optionally, customize compression aggressiveness or utilize safe labels for specific content.

The Token Company Pricing & Plans

The Token Company operates on a transactional, usage-based model for its API services, charging based on the number of tokens saved. The company asserts that clients consistently achieve cost savings compared to uncompressed LLM usage. Token counts are calculated using the Gemma 2 tokenizer.

  • Cost: $0.30 per 1 million tokens saved.
  • Free Plan: Offers 10 requests per minute, suitable for evaluation and small-scale projects.
  • Pro Plan: Provides a higher rate limit of 60 requests per minute, with specific pricing beyond the rate limit not publicly detailed.
  • Enterprise Plan: Custom pricing for production-scale throughput, including options for fine-tuning on domain data, zero data retention, and roadmap features like on-premise/VPC deployment.

Pros

  • Reduces LLM token costs by a reported 10-40%, leading to direct savings.
  • Preserves the original accuracy and semantic context of inputs during compression.
  • Achieves fast inference speeds (below 50ms) and offers full determinism, ensuring consistent output.
  • Functions as a neutral, cross-LLM compatible middleware, working with major providers like OpenAI and Anthropic.
  • Offers specific product versions (Bear-1, Bear-1.1, Bear-2-Safety) with documented improvements and capabilities.
  • Provides one-line integration with popular LLM clients, simplifying adoption.

Cons

  • Operates as a commercial API, requiring payment per tokens saved, unlike open-source alternatives.
  • Reported token reduction (10-40%) may be lower than some open-source methods (e.g., LLMLingua's 2x-5x).
  • Requires integration as a third-party API, adding an additional layer to the LLM call stack.
  • Comprehensive public user reviews are not widely available, relying on case studies and benchmarks.
  • Specific pricing for the 'Pro Plan' beyond rate limits is not publicly disclosed, potentially leading to uncertainty for scaling.

The Token Company vs Competitors

The Token Company positions itself as a neutral efficiency layer for LLM inputs, distinct from LLM providers who are incentivized to sell more tokens. It acts as compression middleware compatible with various LLM providers, addressing the issue of 'context bloat' and inefficient LLM inputs.

The Token Company

Paid · API

Enjoying this? Get one like it in your inbox each morning.

one email a day · unsubscribe in two clicks · no third-party tracking