Timeline Visuelle
1943 ─ Neurone formel (McCulloch-Pitts)
1951 ─ SGD
1958 ─ Perceptron (Rosenblatt)
1964 ─ Hinge Loss (SVM)
1974 ─ Backpropagation (Werbos)
1986 ─ Backprop populaire (Rumelhart) / Momentum
1989 ─ CNN / LeNet (LeCun)
1997 ─ LSTM (Hochreiter)
1998 ─ MNIST / Q-Learning
2002 ─ Torch (Collobert)
2003 ─ NNLM (Bengio)
2005 ─ GNN (Scarselli)
2006 ─ CUDA / Deep Belief Nets (Hinton) / $\epsilon$-DP (Dwork)
2007 ─ Theano (Bengio)
2009 ─ ImageNet (Fei-Fei Li)
2010 ─ ReLU
2011 ─ AdaGrad
2012 ─ AlexNet ────► ère deep learning / Dropout
2013 ─ Word2Vec / DQN / FGSM
2014 ─ GANs / Adam / Seq2Seq+Attn / GoogLeNet / VGG
2015 ─ TensorFlow / ResNet / BatchNorm / AlphaGo / TPUv1 / ELU / Triplet Loss
2016 ─ PyTorch / GCN / LayerNorm / DARTS / PATE
2017 ─ Transformer ────► ère LLM / GAT / PPO / V100 / GELU
2018 ─ BERT / GPT / JAX / GIN / WGAN / InfoNCE
2019 ─ GPT-2 / T5 / LAMB / StyleGAN / AlphaZero / Adapter
2020 ─ GPT-3 / ViT / DALL-E / SimCLR / Diffusion / A100 / LoRA / Chinchilla / RLHF
2021 ─ Codex / DALL-E 2 / DINO / MAML / TPUv4 / RoPE / FlashAttention
2022 ─ ChatGPT / Stable Diffusion / LLaMA / H100 / DPO / MoE (Mixtral)
2023 ─ GPT-4 / Llama 2 / PyTorch 2.0 / Gaudi / SAM / Zephyr
2024 ─ Llama 3 / Gemini 1.5 / Mamba / Sora / B200 / FlashAttention-3
2024 ─ GPT-4o (multimodal natif) / Mixtral 8×22B / DeepSeek V2 / Claude 3.5 Sonnet / Stable Diffusion 3
2025 ─ DeepSeek R1 (reasoning RL) / Llama 3.1 405B / Gemini 2.5 Pro (2M ctx) / GPT-5 / o3 (reasoning)
2025 ─ xAI Colossus (100k H100) / Claude 4 (computer use) / OLMo 2 / Qwen 3.6 / Grok 3
2026 ─ Llama 4 (Maverick) / DeepSeek V4 (1.2T MoE) / GPT-5.5 Pro / Claude 4.7 / Gemini 3 Ultra (10M ctx) / AI Act enforced
2026 ─ ? ────► ta thèse ici
🔗 Voir aussi : Hardware, Distributed Systems, Databases, Python, Rust, Linux & Unix