Jared Roesch
Jun 21, 2022
New AI/ML Tool for Fans of Docker Compose and Kubernetes–OctoML CLI
We’re excited to share with you our first public release of OctoML CLI (v0.4.4) which provides an ML deployment workflow which should feel very familiar to anyone who uses Docker, Docker Compose and Kubernetes.
Beware the Tensor From Hell: How to Avert the Combinatorial Complexity Explosion in ML Engineering
In an earlier era, deploying ML systems was not exactly easy, but at least the problem was contained. Engineers could focus on a few important models, all of which built on similar libraries and tools. That era of uniformity is gone.
Adrian Sampson
Apr 6, 2022
OctoML Engineering Team
Jul 29, 2022
OctoML Engineering Team
Jul 29, 2022
The OctoML CLI is a sophisticated and powerful tool to fast-track your machine learning deployments. We wanted to share our favorite tips to get the most out of your accelerated ML containers.
Jared Roesch
Jun 21, 2022
Jared Roesch
Jun 21, 2022
We’re excited to share with you our first public release of OctoML CLI (v0.4.4) which provides an ML deployment workflow which should feel very familiar to anyone who uses Docker, Docker Compose and Kubernetes.
Jun 21, 2022
Jun 21, 2022
Today, we introduce the OctoML CLI, a Command Line Interface that automates the deploying deep learning models - model containerization and acceleration. One of the key technologies that ties our containerization and acceleration together is NVIDIA Triton Inference Server.
Adrian Sampson
Apr 6, 2022
Adrian Sampson
Apr 6, 2022
In an earlier era, deploying ML systems was not exactly easy, but at least the problem was contained. Engineers could focus on a few important models, all of which built on similar libraries and tools. That era of uniformity is gone.
Sameer Farooqui
Feb 2, 2022
Sameer Farooqui
Feb 2, 2022
OctoML is helping Woven Planet use Apache TVM as a core component of the Arene AI Platform to accelerate ML inference and simplify deployment across various targets.
