Your Free ML Deployment Tool

Get a trained model running in your app, in your environment, in a few easy steps.

Download the OctoML CLI
OctoML free CLI tool animated
DEPLOY ML ON ANY HARDWARE

The OctoML CLI: Your Path to Production

You built and trained the perfect ML model for your application, now it’s time to push to production. You don’t need to spend months learning a new set of tools and techniques – you need a bridge to get from model development to deployment as fast as possible.

With the OctoML Command Line Interface (CLI), you can rapidly deploy ML using:

  • Your choice of models

  • Your environment

  • Your application

  • Your cloud or hardware targets

The OctoML Platform optimizes and containerizes ML models into a flexible, CI/CD friendly deployment package that can be repackaged and redeployed in a few clicks when the model or hardware target changes.

When you’re ready, use OctoML to accelerate the model with various engines such as Apache TVM, ONNX-Runtime, TensorRT, and more to get the maximum performance for the hardware you choose.

It only takes 3 commands to package and deploy YOLOv5 to a container in Docker Desktop

Download the free OctoML CLI

Trained ML models become agile, portable, reliable software functions that easily integrate with your workflows.

Download the OctoML CLI
TRY IT WITH AN AI-POWERED SAMPLE APP

Learn how with Transparent AI

Don't have your own AI-powered app in development? Use the OctoML sample app, Transparent AI, to learn how to enhance applications with AI in the cloud. Check out the Transparent AI tutorials demonstrate the core developer loop:
  1. Adding a model to the application

  2. Exposing the model over an API

  3. Wrapping that API with pre & post processing code

  4. Deploying the model in the app for development

  5. Deploying the model with the app for production in the cloud

  6. Monitoring the model as it runs in production

  7. Accelerating the model for best performance

Built on Open Source technologies, and enabled by OctoML, Transparent AI empowers developers to add intelligence to their applications. Get started with Transparent AI.

Figure 1: OctoML Comparison Dashboard for Analyzing AI/ML Hardware Migration Options

OctoML Customers and Partners

Microsoft
AWS
Google
Azure
AMD
Arm
Qualcomm
vmware
Wipro
Nvidia
Automate Deployment

Automate Model Deployment to Any Hardware

The CLI cleans up the trained model artifact –model math expressed in Python code– and streamlines it into a portable, intelligent function to be used your way.

Copyright © 2023 OctoML. All Rights Reserved.