Kashif's bizarre codeventures

Kashif's bizarre codeventures

#machine-learning

Articles tagged with #machine-learning

From Karpathy's micrograd to smoltorch: Understanding Autograd from First Principles
Why I Built My Own Deep Learning Framework? After watching Andrej Karpathy’s micrograd lecture, I had a realization: I’d been using PyTorch for months, but I didn’t really understand how autograd worked. Sure, I could call .backward() and get gradien...
Nov 18, 20257 min read60
The instability of a softmax function
The softmax, as we know, is numerically unstable when applied to vectors containing very small or very large numbers because of the exponential function involved in its computation. The softmax formula is: \(\text{softmax}(x_{i}) = \frac{e^{x_{i}}}{\...
Mar 5, 20252 min read26