> For the complete documentation index, see [llms.txt](https://xalora-ai.gitbook.io/xalora-ai-docs/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://xalora-ai.gitbook.io/xalora-ai-docs/llm-gateway/introduction.md).

# Introduction

### Xalora LLM Gateway <a href="#heurist-llm-gateway" id="heurist-llm-gateway"></a>

Access open source LLMs in Xalora instantly and transform your AI capabilities using the familiar OpenAI SDK. Simply replace the base URL setting in OpenAI libraries with `https://llm-gateway.xalora.xyz`.

#### [​](https://docs.heurist.ai/dev-guide/llm-gateway/introduction#key-features)Key Features <a href="#key-features" id="key-features"></a>

* **OpenAI Compatibility**: Xalora LLM Gateway is designed to be fully compatible with the OpenAI SDK, allowing you to use the same familiar interface to interact with decentralized LLMs.
* **Decentralized AI at Low Cost**: Leverage the benefits of decentralized computing to access powerful LLMs while significantly reducing operational costs.
* **Simple Integration**: You can start using Xalora Gateway with just 3 lines of code. No complicated setup required.
* **Streaming Responses**: Get real-time results from LLMs with built-in support for streaming responses, enabling interactive experiences like chatbots and live content generation.
* **Open-Source Ecosystem**: Xalora supports a wide range of open source LLMs, allowing you to choose the best model for your use case, from conversational agents to code generation.

#### [​](https://docs.heurist.ai/dev-guide/llm-gateway/introduction#getting-started)Getting Started <a href="#getting-started" id="getting-started"></a>

To get started with the Xalora LLM Gateway, you’ll first need an API key from Xalora. Once you have your API token, integrating it into your application is as simple as a few lines of code.

Here’s how you can use the Xalora **LLM Gateway** in different languages.

NodePythonCopy

```
import OpenAI from "openai";

const openai = new OpenAI({
  apiKey: process.env["XALORA_API_TOKEN"],
  baseURL: "https://llm-gateway.xalora.xyz",
});

const completions = await openai.chat.completions.create({
  model: "mistralai/mixtral-8x7b-instruct",
  messages: [
    {
      role: "user",
      content: "Write rap lyrics about Solana",
    },
  ],
  maxTokens: 64,
  stream: true,
});

for await (const part of completions) {
  process.stdout.write(part.choices[0]?.delta?.content || "");
}
```

Xalora LLM Gateway integrates seamlessly with the official OpenAI libraries. You can easily replace the `baseURL` in your client configuration to use Xalora’s decentralized models, gaining low-cost and uncensored AI capabilities. Refer to your language-specific [OpenAI SDK docs](https://platform.openai.com/docs/libraries) for endpoint configuration.