https://woletee.github.io/Recent content on My Papers & CodeHugoen-usTue, 04 Aug 2026 00:00:00 +0000https://woletee.github.io/understanding-transformers/Tue, 04 Aug 2026 00:00:00 +0000https://woletee.github.io/understanding-transformers/<h2 id="paper">Paper</h2> <p><a href="https://arxiv.org/abs/1706.03762">Attention Is All You Need</a></p> <h2 id="the-problem">The problem</h2> <p>Explain the problem using your own words.</p> <h2 id="main-idea">Main idea</h2> <p>Describe the important concepts, diagrams, and equations.</p> <h2 id="python-implementation">Python implementation</h2> <div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"><code class="language-python" data-lang="python"><span style="display:flex;"><span><span style="color:#f92672">import</span> numpy <span style="color:#66d9ef">as</span> np </span></span><span style="display:flex;"><span> </span></span><span style="display:flex;"><span><span style="color:#66d9ef">def</span> <span style="color:#a6e22e">softmax</span>(values): </span></span><span style="display:flex;"><span> exp_values <span style="color:#f92672">=</span> np<span style="color:#f92672">.</span>exp(values <span style="color:#f92672">-</span> np<span style="color:#f92672">.</span>max(values)) </span></span><span style="display:flex;"><span> <span style="color:#66d9ef">return</span> exp_values <span style="color:#f92672">/</span> exp_values<span style="color:#f92672">.</span>sum() </span></span><span style="display:flex;"><span> </span></span><span style="display:flex;"><span>print(softmax(np<span style="color:#f92672">.</span>array([<span style="color:#ae81ff">1.0</span>, <span style="color:#ae81ff">2.0</span>, <span style="color:#ae81ff">3.0</span>]))) </span></span></code></pre></div><h2 id="what-i-learned">What I learned</h2> <p>Summarize the practical lessons and link to your complete GitHub project.</p>