Jared Roesch

Jared Roesch

Chief Architect and Co-Founder

3 Articles

Jared Roesch

Jared Roesch

Jun 21, 2022

Jared Roesch

Jared Roesch

Jun 21, 2022

New AI/ML Tool for Fans of Docker Compose and Kubernetes–OctoML CLI

We’re excited to share with you our first public release of OctoML CLI (v0.4.4) which provides an ML deployment workflow which should feel very familiar to anyone who uses Docker, Docker Compose and Kubernetes.

Jared Roesch

T

Dec 16, 2021

Jared Roesch

T

Dec 16, 2021

Write Python with blazing fast CUDA-level performance

By using TVMScript, TVM's embedded domain specific language (DSL), OctoML engineers are able to demonstrate a 20x speedup over a straightforward PyTorch implementation on CPU, and a 1.3x speedup over handwritten CUDA implementation on GPU for a real-world kernel.

Phil Mazenett
Jared Roesch

Dec 9, 2021

Phil Mazenett
Jared Roesch

Dec 9, 2021

OctoML’s BERT Model Acceleration Proves Apple M1 Pro and Max Chips Make AI Accessible to Everyone

OctoML, the company behind the leading Machine Learning (ML) Deployment Platform, has recently spearheaded ML acceleration work with Hugging Face’s implementation of BERT to automatically optimize its performance for the “most powerful chips Apple has ever built.”

1

Accelerate Your AI Innovation