It is a language model based on paper ‘Attention Is All You Need’ from 2017

Transformers Architecture

Below is an image taken from the paper, describing the model architecture of Transformer

Attention Is All You Need

The Annotated Transformer

Interfaces for Explaining Transformer Language Models

Demystifying Transformers Architecture in Machine Learning

CS480/680 Lecture 19: Attention and Transformer Networks

Transformer Neural Networks, ChatGPT's foundation, Clearly Explained!!!

Attention Mechanism

Introduction to Attention Mechanism - Blog by Kemal Erdem

The math behind Attention: Keys, Queries, and Values matrices

Intuition Behind Self-Attention Mechanism in Transformer Networks

Explained

Illustrated Guide to Transformers Neural Network: A step by step explanation