Geek Night NCR

Flashback

Attention Mechanism in Neural Networks, and its Applications
In this talk, we will briefly talk about Attention Mechanism in Neural Networks, its Applications and implementation in PyTorch

35^th edition

Jul 14 2022

Geek Night is a regular event to promote the sharing of technical knowledge and increase collaboration among the geeks in the National Capital Region (Delhi). It is organized by a passionate group of programmers and sponsored by Thoughtworks.

We love feedback! If you have any suggestions or cribs, feel free to fill out our feedback form. Don't worry, your feedback will remain completely anonymous.
Geek Night Volunteers

Agenda

4:00 - 4:05 pm

Inspiration of ATTENTION

By: Ankit Shukla & Karrtik Iyer

4:05 - 4:10 pm

Key, Value & Queries

By: Ankit Shukla & Karrtik Iyer

4:10 - 4:40 pm

Attention Pooling - Nadaraya-Watson Kernel Regression

By: Ankit Shukla & Karrtik Iyer

4:40 - 4:45 pm

Break

4:45 - 5:00 pm

Masked Softmax & Scaled Dot-Product attention

By: Ankit Shukla & Karrtik Iyer

5:00 - 5:30 pm

Decoder with Attention - Bahdanau Attention

By: Ankit Shukla & Karrtik Iyer

Geek Night NCR

Flashback

Attention Mechanism in Neural Networks, and its Applications In this talk, we will briefly talk about Attention Mechanism in Neural Networks, its Applications and implementation in PyTorch

Jul 14 2022

Agenda

Previous Editions

Attention Mechanism in Neural Networks, and its Applications
In this talk, we will briefly talk about Attention Mechanism in Neural Networks, its Applications and implementation in PyTorch