LLMs Everywhere: Running 70B models in browsers and iPhones using MLC — with Tianqi Chen of CMU / OctoML
Episode 52 min 9s

LLMs Everywhere: Running 70B models in browsers and iPhones using MLC — with Tianqi Chen of CMU / OctoML

We have just announced our first set of speakers at AI Engineer Summit! Sign up for the livestream or email [email protected] if you’d like to support. We are facing a massive GPU crunch. As both startups and VC’s hoard Nvidia GPUs like countries co...

Full show notes and links

Community discussion