Implementation of Multi-head Self-attention transformers from scrach

This is a hobby project implemented with an intention of gaining hands-on experience with transformers and self-attention.

Reference

This blog post was followed as a reference.

Name		Name	Last commit message	Last commit date
Latest commit History 8 Commits
experiments		experiments
mini-self-attention		mini-self-attention
.gitattributes		.gitattributes
.gitignore		.gitignore
README.md		README.md
requirements.txt		requirements.txt
setup.py		setup.py