Show HN: Introduction to GPU Inference, a short course with Interactive diagrams
Hi HN!<p>I've spent most of this year working on GPU inference, and I put together a short course to share what I've learned.<p>It starts with the basics and works up to how inference is actually served, things like continuous batching, goodput, and disaggregated prefill and decode. I'll soon add a lesson that shows how to run adaptive disaggregated inference on a consumer GPU!<p>The lessons are around 5-10min each, include interactive diagrams and are fully voice narrated.<p>No signup or fees.<p>I'd love to hear what you guys think, and I'm happy to answer any questions!
경쟁 제품 및 대안
Show HN: Liquid Inference – auto-routing to competitive LLM marketplace
Our background is trading systems and exchanges. Liquid Inference applies that to LLM inference. On Liquid Inference, m…
Show HN: Every number in a tiny GPT, from one forward pass to one step of RLHF
Source: <a href="https://github.com/manogyasingh/transformer-visualisation" rel="nofollow">https://github.com/manogyasi…
Show HN: Interactive Diesel Price Forecaster
Interactive model of diesel price I've been working on with my (sightspinner) agent. Takes into account the main (known…
Show HN: Strata Architecture
I've long thought about how we're influenced by CPU architectures, and importantly, their ISAs.<p>In a discussion at a…
Show HN: Confetti – Start designing hardware with plain English prompts
Hey HN! We're Tianyi and Lucas from Confetti (YC F26) (<a href="https://confetti.build/">https://confetti.build/</a>).…