Articles
Machine Learning
4 articles in this category.
Machine Learning5 min read
Positional Encoding in Transformers: From Sinusoidal to RoPE
Understand positional encoding in Transformers, from sinusoidal embeddings to RoPE, and learn how models capture token order and relative position.
Machine Learning11 min read
PyTorch Compiler Explained: TorchDynamo, AOTAutograd & TorchInductor
Understand how PyTorch compilation works under the hood: bytecode capture with TorchDynamo, forward/backward staging with AOTAutograd, and kernel optimization with TorchInductor.
Machine Learning10 min read
Understanding Attention: The Idea Behind Modern AI
One paper changed everything: Attention Is All You Need. This post breaks down the foundations behind attention, starting from embeddings. A simple journey from words to meaning.
Machine Learning4 min read
What Are Transformers in AI?
Learn what Transformers are, how they work, and why they power models like GPT and modern AI systems. A clear, beginner-friendly introduction.