In the generative AI community, there’s a growing movement towards open source models in an effort to reduce dependence on OpenAI – and the recent corporate governance blow up is only a small part of why. Many OpenAI customers are finding it’s not the best-fit for every use-case.

We’re excited to announce the launch of OctoAI Text Gen Solution, the fastest and easiest way to consume open source LLMs from your applications. Starting today, you can build on your choice of Llama 2 Chat, Code Llama Instruct and Mistral Instruct models, across 7B, 13B, 34B and 70B model sizes, all powered by OctoAI’s best in class compute infrastructure.

We’re excited today to launch the OctoAI Image Gen Solution, the fastest and most customizable GenAI stack for production-grade image generation applications. Building on one unified API endpoint, you can now reliably create or import thousands of fine-tuning assets, and generate millions of images a day at industry-leading latency.