> ## Documentation Index
> Fetch the complete documentation index at: /docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Groq

> Use ultra-fast LLM inference with Groq

## Overview

Groq provides blazing-fast inference for popular open-source models through their custom LPU hardware. Known for exceptional speed while maintaining strong model quality.

## Available Models

> [card] GPT-OSS (20B)
>
> **1 credit** • Speed-optimized open-weight 20B model. Ideal for real-time, high-volume applications.
>
> * 131K context window
> * Good reasoning
> * Speed: Extremely\_fast • Cost: Very\_low
> * Model id: `openai/gpt-oss-20b`

> [card] Qwen 3.8 (27B)
>
> **7 credits** • Alibaba's Qwen 3.8 served on Groq's inference stack, with a 128K context window.
>
> * 131K context window
> * Excellent reasoning
> * Speed: Very fast • Cost: Low
> * Model id: `qwen/qwen3.8-27b`

> [card] Groq Compound
>
> **2 credits** • Groq's own compound system, combining models and tools behind one model id.
>
> * 131K context window
> * Excellent reasoning
> * Speed: Very fast • Cost: Low
> * Model id: `groq/compound`

> [card] GPT-OSS (120B)
>
> **2 credits** • Larger open-weight 120B model with strong performance across diverse tasks.
>
> * 131K context window
> * Excellent reasoning
> * Speed: Fast • Cost: Low
> * Model id: `openai/gpt-oss-120b`

## Setup

### Using BoostGPT-Hosted API Keys

**1. Select Groq Model**

In your BoostGPT dashboard, select any Groq model when creating or configuring your bot.

**2. Choose Your Model**

* **Llama 3.1 Instant**: For real-time, ultra-fast responses
* **Llama 3.3 Versatile**: For balanced performance
* **DeepSeek Llama 70B**: For reasoning tasks
* **Qwen models**: For multilingual applications

### Using Your Own Groq API Key

> [tab] Dashboard Setup
>
> **1. Navigate to Integrations**
>
> Go to [app.boostgpt.co](https://app.boostgpt.co/integrations) and select **Integrations**
>
> **2. Select Groq**
>
> Find and click on the **Groq** provider
>
> **3. Add API Key**
>
> Enter your Groq API key and select which AI teammates will use this key
>
> **4. Save Configuration**
>
> Click save to apply your custom API key

> [tab] Core SDK
>
> ```javascript bot.js theme={null}
> import { BoostGPT } from 'boostgpt';
>
> const client = new BoostGPT({
>   project_id: process.env.BOOSTGPT_PROJECT_ID,
>   key: process.env.BOOSTGPT_API_KEY
> });
>
> // Create bot with Groq model
> const botResponse = await client.createBot({
>   name: 'My Groq Bot',
>   model: 'openai/gpt-oss-20b', // Ultra-fast!
>   instruction: 'You are a quick and helpful assistant.',
>   max_reply_tokens: 1000,
>   status: 'active'
> });
>
> if (botResponse.err) {
>   console.error('Error:', botResponse.err);
> } else {
>   console.log('Bot created:', botResponse.response);
> }
> ```

## Performance Benefits

> [!TIP]
>
> Groq's LPU (Language Processing Unit) hardware provides inference speeds up to 10x faster than traditional GPUs, making it ideal for real-time applications.

## Next Steps

> [card] [Reasoning Models](/docs/providers/reasoning-models.md)
>
> Learn about reasoning models on Groq

> [card] [Model Comparison](/docs/providers/model-comparison.md)
>
> Compare Groq with other providers

> [card] [SDK Reference](/docs/sdk/core/api-reference.md)
>
> Full API documentation

> [card] [Bring Your Own Key](/docs/providers/bring-your-own-keys.md)
>
> Use your own Groq API key


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.