https://subhash.net/tags/transformers/Recent content in Transformers on Subhash DasyamHugoenSun, 13 Jul 2025 23:23:34 +0400https://subhash.net/posts/mixture-of-experts-moe-specialist/Sun, 13 Jul 2025 23:00:00 +0400https://subhash.net/posts/mixture-of-experts-moe-specialist/<p>Building on our transformer story - if you haven&rsquo;t read the complete transformer guide yet, check it out first!</p> <h2 id="remember-our-transformer-story">Remember Our Transformer Story?</h2> <p>In our previous deep dive, we learned that transformers have this amazing &ldquo;deep thinking step&rdquo; (the Feed Forward Network) where they:</p>https://subhash.net/posts/how-transformers-actually-work-complete/Tue, 08 Jul 2025 00:45:00 +0400https://subhash.net/posts/how-transformers-actually-work-complete/<p>Ever wondered how ChatGPT, Claude, or GPT-4 actually understand and generate text? Let me break down the magic behind transformers like you&rsquo;re 12 years old! 👇</p> <p>Note: When I mention &ldquo;117 million parameters&rdquo; in examples, I&rsquo;m talking about GPT-1 and BERT-base models. Modern models like GPT-4 are much, much bigger!</p>https://subhash.net/posts/the-complete-guide-to-transformer/Wed, 21 May 2025 22:58:00 +0400https://subhash.net/posts/the-complete-guide-to-transformer/<h3 id="1-the-big-breakthrough-introduction-to-transformer-architecture">1. The Big Breakthrough: Introduction to Transformer Architecture</h3> <p>Two weeks after successfully implementing his first transformer model, Alex was hunched over his laptop in the university AI lab, a look of amazement on his face as he compared the results from his old model and his new transformer-based solution.</p>