encoder-decoder

1 post connected to this tag.

Jul 5, 2026

How Audio Transformers Work: The Encoder Path, Whisper, Timestamps, And Why Audio Is Not A VLM Patch

How Audio Transformers Work: The Encoder Path, Whisper, Timestamps, And Why Audio Is Not A VLM Patch Audio transformers use the same high-level trick as language and vision transformers: con...

Read post →

Get my rants delivered to your inbox

I will send new posts as and when I write. No fixed cadence, just engineering notes, rants, and things I am thinking through.

ShivasNotes

Engineering notes, A.I. workflow, drones, systems programming, and the messy process of building in public.

Explore

Latest Articles
Blog
Projects
Resume
About

Connect

hello@shivasnotes.com
AntShiv Robotics
StylesDoc

How Audio Transformers Work: The Encoder Path, Whisper, Timestamps, And Why Audio Is Not A VLM Patch

Subscribe

Subscribe to emails from Anthony

ShivasNotes

Explore

Connect