FlashAttention 2: making Transformers 800% faster w/o approximation - with Tri Dao of Together AI
FlashAttention was first published by Tri Dao in May 2022 and it had a deep impact in the large language models space. Most open models you’ve heard of (RedPajama, MPT, LLaMA, Falcon, etc) all leverage it for faster inference. Tri came on the podcast t...
You May Also Like
The Deep Dive Radio Show and Nick's Nerd News
Nick Espinosa, Chief Security Fanatic
ITSPmagazine
ITSPmagazine, Sean Martin, Marco Ciappelli
Jak Piggott
Jak Piggott
Artificial Intelligence Masterclass
AI Masterclass
Daily Tech News Show
Tom Merritt
The Linux Cast
The Linux Cast
The Rollup
Where digital assets and finance converge. Hosted by Andy and Robbie.
Paper-to-Podcast
Artificially Human
Theo - t3․gg
Theo - t3․gg
CISO Insights: Voices in Cybersecurity
CISO Marketplace
The Deep Dive Radio Show and Nick's Nerd News
Nick Espinosa, Chief Security Fanatic
ITSPmagazine
ITSPmagazine, Sean Martin, Marco Ciappelli
Jak Piggott
Jak Piggott
Artificial Intelligence Masterclass
AI Masterclass
Daily Tech News Show
Tom Merritt
The Linux Cast
The Linux Cast
The Rollup
Where digital assets and finance converge. Hosted by Andy and Robbie.
Paper-to-Podcast
Artificially Human
Theo - t3․gg
Theo - t3․gg
CISO Insights: Voices in Cybersecurity
CISO Marketplace
Community discussion