Welcome to the OctoML Blog
Explore the latest OctoAI product updates, TVM updates, and overall machine learning news.
OctoAI Model Remix Program Shrinks Your Dependency on OpenAI
In the generative AI community, there’s a growing movement towards open source models in an effort to reduce dependence on OpenAI – and the recent corporate governance blow up is only a small part of why. Many OpenAI customers are finding it’s not the best-fit for every use-case.
Announcing OctoAI Text Gen Solution: Blazing fast Llama 2, Code Llama and Mistral models at industry leading price & performance
We’re excited to announce the launch of OctoAI Text Gen Solution, the fastest and easiest way to consume open source LLMs from your applications. Starting today, you can build on your choice of Llama 2 Chat, Code Llama Instruct and Mistral Instruct models, across 7B, 13B, 34B and 70B model sizes, all powered by OctoAI’s best in class compute infrastructure.
OctoAI Image Gen Solution: Fine-tuned GenAI images in seconds, on the fastest and most cost effective Stable Diffusion XL 1.0 (SDXL) and Stable Diffusion 1.5 models in the market
We’re excited today to launch the OctoAI Image Gen Solution, the fastest and most customizable GenAI stack for production-grade image generation applications. Building on one unified API endpoint, you can now reliably create or import thousands of fine-tuning assets, and generate millions of images a day at industry-leading latency.
Start building with ease in minutes using OctoAI
Our mission is empowering developers to build AI applications that delight users by leveraging fast models running on the most efficient hardware. Sign up and start building in minutes.