Final Project: Transformer Knowledge Distillation
After learning about the Transformer and it’s incredible capacity to work with language, I was I excited to integrate it into a tool for people to use. I ha...
Posts
2019
Week 5: Fun Implementations
Week 5 After reading about wonderful neural net architectures for working with sequences of texts, I decided to try some implementations, complementing my ...
Week 4: Fun Architectures
Week 4 I’ll be sharing some wonderful neural network architectures for working with sequences of text! Here they are: Vanilla Recurrent Neural Net (RN...
Week 3: Refined Focus
Week 3 I have enjoyed an wonderful breadth of knowledge the past two weeks, and now it’s time to refine my plan and focus! To accelerate my progression, I ...
Week 2: Getting A Groove
Week 2 After kicking this week off, it took some time but I feel that I’ve got a groove I can get with to get things done! I was exposed to a lot of new kn...
Week 1: Syllabus & Orientation
Week 1 I just finished a fulfilling first week for the OpenAI Scholars program. Here’s a sweet pic of our time in the office: