This week at TVMCon, OctoML is launching a model zoo with pre-accelerated, ready-to-download vision and language models. Running extremely fast, sub-millisecond models in production is now easier than ever, whether in the cloud or at the edge.

Today we’re excited to announce our partnership with Arm, which highlights our collaboration across a broad array of hardware and embedded systems.

The OctoML Machine Learning Deployment Platform now supports inferencing targets from the cloud to the edge, including hardware from leading industry vendors like AWS, GCP, NVIDIA, AMD, Arm, and Intel.

Apple’s release of an Arm-based chip, called the M1, was a seismic shift in the personal computing landscape.