Daily Dose of Data Science

Daily Dose of Data Science

Deep learning

12 Optimizers for Training Neural Networks, clearly explained!
...and what each one costs in GPU memory!
22 hrs ago • Avi Chawla
​Implement Knowledge Distillation from Scratch​
(must-know to efficiently run ML models in production)
May 18 • Avi Chawla
Google solved an Old RNN Problem
A better middle ground between RNNs and Transformers.
Apr 15 • Avi Chawla
A Memory-efficient Technique to Train Large Models
...that even LLMs like GPTs and LLaMAs use.
Apr 3 • Avi Chawla
CPU vs GPU vs TPU vs NPU vs LPU
...explained visually!
Mar 26 • Avi Chawla
16 Techniques to Optimize Neural Network Training
...explained in a single frame.
Mar 4 • Avi Chawla
Researchers Solved a Decade-old Problem in Object Detection
...explained visually.
Feb 19 • Avi Chawla
Build Portable ML Models with ONNX
...explained with code.
Jan 19 • Avi Chawla
4 Strategies for Multi-GPU Training
...explained visually.
Dec 11, 2025 • Avi Chawla
8 AI Model Architectures, Visually Explained!
must-know for AI engineers!
Dec 4, 2025 • Avi Chawla
6 Types of Contexts for AI Agents
...explained from a context engineering perspective.
Oct 17, 2025 • Avi Chawla
A Memory-efficient Technique to Train Large Models
...that even LLMs like GPTs and LLaMAs use.
Oct 14, 2025 • Avi Chawla
© 2026 Avi Chawla · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture