Transformers

Graduate Course, Department of Electrical Engineering, IIT Bombay, 2024

EE 769 Lecture: Intro to Transformers

Took a lecture for EE 769: Introduction to Machine Learning, a graduate level course in IIT Bombay and introduced the transformer architecture and self attention to students. This introductory lecture on the transformer architecture is inspired by the Stanford lecture on Introduction to transformers by Andrej Karpathy.