SoloAnaly

Show HN: Introduction to GPU Inference, a short course with Interactive diagrams

Hi HN!<p>I've spent most of this year working on GPU inference, and I put together a short course to share what I've learned.<p>It starts with the basics and works up to how inference is actually served, things like continuous batching, goodput, and disaggregated prefill and decode. I'll soon add a lesson that shows how to run adaptive disaggregated inference on a consumer GPU!<p>The lessons are around 5-10min each, include interactive diagrams and are fully voice narrated.<p>No signup or fees.<p>I'd love to hear what you guys think, and I'm happy to answer any questions!

athrael.net1개 플랫폼에서 추적최초 수집 11. 17. 오후 05:08최근 업데이트 11. 17. 오후 09:42

경쟁 제품 및 대안

플랫폼별 수집 기록