The development history of LLMs

Neural Networks

Deep Learning

CNN: DNN for images

RNN: DNN for sequences

Reinformcement Learning

Transformer

• Self-attention
• Positional encoding
• Multi-head attention
• Coding

LLMs

ChatGPT

The future of LLMs