Lesson 3 - A Zoo of Models
in Proteins Last modified at:
The revolution will not be supervised
Required reading for this lesson
Optional reading for this lesson
- D2L Book Chapter on Attention and Transformer
- PyTorch Lightning - Deep Learning Course, Unit 8 explaining Attention and Language Models
Slides
Video
Credits
The title image of this exercise is from an excellent review paper by Mohammed AlQuraishi & Peter K. Sorger called Differentiable Biology; a highly recommended read!
Some of the visualisations in the video were created via the fantastic ManimML library; see their paper for more details on it! Also thanks to Nicholas Gale and Stephen Eglen for allowing me to use some of their amazing figures in this lecture!
