API Clients

Mixlayer provides an OpenAI-compatible Chat Completions API for interacting with our models. The API is available at https://models.mixlayer.ai/v1/chat/completions. The API has full support for streaming and tool calling.

To use the REST API, you need to provide an API key. You can create an API key in the Mixlayer console.

Clients

You can use common client libraries for the OpenAI API, such as OpenAI’s Node Library or the Vercel AI SDK.

OpenAI Node

import OpenAI from "openai";
 
const openai = new OpenAI({
  apiKey: process.env["MIXLAYER_API_KEY"]!,
  baseURL: "https://models.mixlayer.ai/v1",
});
 
async function getChatCompletionStream() {
  const stream = await openai.chat.completions.create({
    model: 'meta/llama3.1-8b-instruct-free',
    messages: [
      { role: "system", content: "You are a helpful assistant." },
      { role: "user", content: "Tell me a fun fact about chihuahuas." },
    ],
    stream: true,
  });
 
  for await (const event of stream) {
    process.stdout.write(event.choices[0].delta.content ?? "");
  }
}

Vercel AI SDK

To use the Vercel AI SDK, you need to install the Mixlayer provider:

npm install ai @mixlayer/ai-sdk-provider

import { streamText } from "ai";
import { mixlayer } from "@mixlayer/ai-sdk-provider";
import type { NextRequest } from "next/server";
 
export async function POST(req: NextRequest) {
  try {
    const { prompt, model } = await req.json();
 
    if (!prompt) {
      return new Response("Prompt is required", { status: 400 });
    }
 
    const result = streamText({
      model: mixlayer(model || "meta/llama3.1-8b-instruct-free"),
      prompt,
      maxTokens: 1000,
    });
 
    // Since Mixlayer is OpenAI-compatible, this should work perfectly
    return result.toDataStreamResponse();
  } catch (error) {
    console.error("Streaming error:", error);
    // @ts-ignore
    return new Response(`Failed to stream text: ${error.message}`, {
      status: 500,
    });
  }
}

Introduction Pricing