Oct 19, 2026
Muon Optimizer: From wx+b to Matrix Updates
From scalar wx+b through housing GEMM, AdamW and Muon, a nonlinear FFN, and a measured scaling spectrum.
Read post →Tagged With
gemm
3 posts connected to this tag.
Subscribe
Get my rants delivered to your inbox
I will send new posts as and when I write. No fixed cadence, just engineering notes, rants, and things I am thinking through.
Subscribe to emails from Anthony
First Name
Last Name
Email
Submit
Need an intelligent system to work on real hardware?
Embedded systems · Robotics · Constrained AI · CPU and HPC · Accelerators · Distributed systems
Work With Us / Antshiv Robotics
ShivasNotes
Independent notes on software, systems, AI workflows, robotics, and building in public.
