/tags/inference/Recent content in Inference on Sagnik DasHugo -- gohugo.ioenFri, 05 Jun 2026 19:57:47 +0530/posts/inferencemaxxing/Tue, 28 Apr 2026 00:00:00 +0000/posts/inferencemaxxing/AI Inference learnings Experiments (Threads/Blogs/Articles) # Topic Link 1 Inference comparison PyTorch vs vLLM — Qwen2.5-1.5B-Instruct Comparison 2 kv cache Why do we need KV cache? 3 prefill and decode What actually happens inside an LLM when you send a prompt? Learning Resources Prefill decode basics redis tech blog about p/d Disaggregated infernce distServe - split p/d in diff gpus Continuous Batching for LLM Inference — How batching works and how to optimize for better performance.