Introduction

Welcome to Mixlayer! 🎉

What is this?

Mixlayer is a platform that enables you to build and deploy customized versions of AI models using simple Javascript code. It is designed to be easy to use, and to allow you to focus on building your models, rather than writing a bunch of API boilerplate or managing infrastructure. You send us your code and we hand you an API you can use back.

Why is it useful?

Building in this way means that models are more programmable and easier to use. Many complex use-cases such as multi-step prompting, tool use and structured output fall out naturally as a result of this design. Mixlayer provides features such as constrained generation, tool use and output capture that make it seamless and easy for you and your code to cooperatively work with the underlying model to achieve a common goal.

Most AI inference APIs have amnesia. When you send them requests, you have to remind them of everything you've told them before. Mixlayer is stateful: while your code is executing you have total control over the model's context window. You don't have to send new requests for every message in a conversation between your code and the model, or every step of a multi-step process.

And when you're ready to open up your model to the rest of the world, we provide a way to easily deploy your model as an API, so that you can share it with others or have it power features in other products.

How does it work?

Mixlayer's built on top of a custom implementation of open source large language models. When you deploy an app on our platform, we compile it to WebAssembly and run it along side the model.