Articles & Tutorials
Thoughts, tutorials and reflections about AI, machine learning, web development and everything I'm passionate about.
Machine LearningPositional Encoding in Transformers: From Sinusoidal to RoPE
Understand positional encoding in Transformers, from sinusoidal embeddings to RoPE, and learn how models capture token order and relative position.
Rubén
Machine LearningPyTorch Compiler Explained: TorchDynamo, AOTAutograd & TorchInductor
Understand how PyTorch compilation works under the hood: bytecode capture with TorchDynamo, forward/backward staging with AOTAutograd, and kernel optimization with TorchInductor.
Rubén
Machine LearningUnderstanding Attention: The Idea Behind Modern AI
One paper changed everything: Attention Is All You Need. This post breaks down the foundations behind attention, starting from embeddings. A simple journey from words to meaning.
Rubén
Machine LearningWhat Are Transformers in AI?
Learn what Transformers are, how they work, and why they power models like GPT and modern AI systems. A clear, beginner-friendly introduction.
Rubén