From Dev.to Community
Tech Articles
Curated developer articles, tutorials, and guides — auto-updated hourly
Wesam Khallaf — Author of PyTorch From Ground Up3d ago • 10 min read
What optimizer.step() Actually Does: One Step of SGD, Momentum and Adam by Hand
last time i took a two-layer network and computed all four gradients by hand, and then ran the same....
#pytorch#deeplearning#machinelearning#beginners
0 1
Wesam Khallaf — Author of PyTorch From Ground UpAug 23, 2026 • 9 min read
Backpropagation by Hand: Two Layers, a Pen, and Then Autograd Agrees
in the last piece i did autograd, and the whole point of it was that you call loss.backward() once.....
#pytorch#python#machinelearning#beginners
0 0