Introducing Typhoon 2 API Pro: Accessible, Production-grade Thai LLMs

Originally published March 17, 2025 – Updated June 18, 2025

We’re excited to announce major updates to Typhoon 2 API Pro, our production-ready API offering in collaboration with Together AI. Most notably, we’ve launched Typhoon 2.1 Gemma—a more powerful, more scalable Thai LLM now accessible via Together’s serverless API infrastructure.

🚀 What’s New

• Typhoon 2.1 Gemma is now live on Together AI

Typhoon 2.1 Gemma—our latest text model, now available via API Pro with the endpoint scb10x/scb10x-typhoon-2-1-gemma3-12b. Developed with Together AI, it provides production-grade performance and lower latency while scaling seamlessly.

• Deprecation notice:
  • Typhoon-2-8b model scb10x/scb10x-llama3-1-typhoon2-8b-instruct is no longer available
  • Typhoon-2-70b model scb10x/scb10x-llama3-1-typhoon2-70b-instruct will be deprecated on August 20, 2025 — we encourage all users to migrate to Typhoon 2.1 Gemma (12B) as soon as possible.

typhoon‑v2‑70b‑instruct remains accessible only until August 20, 2025. We strongly recommend switching to Typhoon 2.1 before this date to avoid service disruption.

Key Features

• Leverage Together AI’s serverless inference infrastructure to deliver fast responses while minimizing costs through per-token billing
• Compatible with popular frameworks and easy to integrate with existing AI pipelines
• Built for production-grade Enterprise AI applications, offering reliability, uptime, and scalability

Pricing

Typhoon 2 API Pro is available at the following prices:

• Typhoon 2.1 Gemma 12b: $0.20 per 1 million tokens
• Typhoon 2 Instruct 70b: $0.88 per 1 million tokens

Quickstart Guide

Getting started with Typhoon 2 API Pro is easy! Our models are hosted on
Together AI for seamless deployment. Follow these simple steps to start using Typhoon.

Try out Typhoon Models in Together’s playground

Register for a Together.ai account. New accounts get $1 free credit to help you get started.
You can test the Typhoon models on the Together Playground.

Get API Access

1. Set your API key as an environment variable named TOGETHER_API_KEY

1. Make your first API call

Using Typhoon API Pro with Official Together Libraries

Together AI provides official libraries for Python and TypeScript. You can install them using pip install together for Python and npm install together-ai for Typescript.

Send your first Typhoon 2 API Pro request and start generating a response:

Python

Typescript

OpenAI Compatibility

Together API endpoints are fully compatible with the OpenAI API. If your application is already using OpenAI’s client libraries, you can configure it to point to Together API servers and start using Typhoon models.

Using Together APIs with OpenAI Client Libraries

1. Set the api_key to your Together API key. You can find your API key in your .
2. Update the base_url to https://api.together.xyz/v1

Python

Typescript

Join the Typhoon Community

We’re excited to see how developers and businesses use Typhoon 2 API Pro to build innovative Thai AI solutions. Join our Discord community to share your experiences, ask questions, and stay updated on new releases.

Ready to build with Typhoon API Pro? Get started today! 🚀

Read the full documentation at Together AI. For more information on Typhoon, please visit https://docs.opentyphoon.ai/.

For support on Together AI, please visit their Support page.