1× knowledge

Generative AI / Subject

Intermediate

Develop generative models with advanced transformer architectures, distributed training, fine-tuning, alignment, agents, agent protocols, advanced RAG and multimodal systems.

Your Progress

Learning Summary

0 of 139 topics completed
Quizzes Completed 0Best Quiz Score —Current Level Not startedContinue Choose a topic

Suggested sequence

Learning roadmap

Topics follow the Admin display order

Intermediate

139 topics
  1. Transformer Scaling
  2. Decoder-Only Transformers
  3. Encoder-Only Transformers
  4. Encoder-Decoder Transformers
  5. Mixture of Experts
  6. Sparse Models
  7. Dense Models
  8. Grouped Query Attention
  9. Multi-Query Attention
  10. Flash Attention
  11. Sliding Window Attention
  12. Sparse Attention
  13. Rotary Position Embeddings
  14. ALiBi
  15. KV Cache
  16. Long-Context Models
  17. State Space Models
  18. Hybrid Architectures
  19. Pretraining
  20. Dataset Collection
  21. Dataset Cleaning
  22. Dataset Deduplication
  23. Data Filtering
  24. Data Mixture
  25. Tokenizer Training
  26. Distributed Training
  27. Data Parallelism
  28. Model Parallelism
  29. Tensor Parallelism
  30. Pipeline Parallelism
  31. Fully Sharded Data Parallelism
  32. Mixed Precision Training
  33. Gradient Accumulation
  34. Gradient Checkpointing
  35. Learning Rate Scheduling
  36. Checkpointing
  37. Training Stability
  38. Supervised Fine-Tuning
  39. Instruction Fine-Tuning
  40. Full Fine-Tuning
  41. Parameter-Efficient Fine-Tuning
  42. PEFT
  43. LoRA
  44. QLoRA
  45. Adapter Layers
  46. Prefix Tuning
  47. Prompt Tuning
  48. Dataset Preparation
  49. Fine-Tuning Evaluation
  50. Hyperparameter Optimization
  51. Catastrophic Forgetting
  52. Domain Adaptation
  53. AI Alignment
  54. Human Feedback
  55. RLHF
  56. Reward Models
  57. Preference Data
  58. Preference Optimization
  59. DPO
  60. RLAIF
  61. Constitutional AI
  62. Instruction Following
  63. Refusal Training
  64. Safety Alignment
  65. Alignment Evaluation
  66. Introduction to AI Agents
  67. Agent Architecture
  68. Agent Loops
  69. Planning
  70. Reasoning
  71. Tool Use
  72. Function Calling
  73. Agent Memory
  74. Short-Term Memory
  75. Long-Term Memory
  76. Episodic Memory
  77. Semantic Memory
  78. Working Memory
  79. Agent State
  80. Agent Context
  81. Agentic RAG
  82. Reflection
  83. Self-Correction
  84. Multi-Step Agents
  85. Multi-Agent Systems
  86. Agent Communication
  87. Agent Coordination
  88. Agent Delegation
  89. Agent Routing
  90. Human-in-the-Loop Agents
  91. Browser Agents
  92. Coding Agents
  93. Research Agents
  94. Data Analysis Agents
  95. Workflow Agents
  96. Autonomous Agents
  97. Model Context Protocol
  98. Agent-to-Agent Communication
  99. Tool Interfaces
  100. Resource Discovery
  101. Agent Skills
  102. Agent Permissions
  103. Agent Authentication
  104. Agent Authorization
  105. Agent Sandboxing
  106. Agentic RAG
  107. Graph RAG
  108. Knowledge Graph RAG
  109. Multimodal RAG
  110. Corrective RAG
  111. Adaptive RAG
  112. Self-RAG
  113. Hierarchical RAG
  114. Multi-Hop Retrieval
  115. Parent-Child Retrieval
  116. Contextual Retrieval
  117. Query Routing
  118. Retrieval Fusion
  119. Reciprocal Rank Fusion
  120. Cross-Encoder Reranking
  121. Late Interaction Retrieval
  122. Knowledge Graph Integration
  123. RAG Observability
  124. RAG Optimization
  125. Multimodal Models
  126. Vision-Language Models
  127. Audio-Language Models
  128. Video-Language Models
  129. Image Understanding
  130. Document Understanding
  131. Visual Question Answering
  132. Image Captioning
  133. Multimodal Embeddings
  134. Multimodal Prompting
  135. Multimodal RAG
  136. Multimodal Agents
  137. Vision Agents
  138. Native Multimodal Models
  139. Cross-Modal Attention

Topics

139 published topics

  1. 01 Transformer ScalingLearn Transformer Scaling through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning
  2. 02 Decoder-Only TransformersLearn Decoder-Only Transformers through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning
  3. 03 Encoder-Only TransformersLearn Encoder-Only Transformers through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning
  4. 04 Encoder-Decoder TransformersLearn Encoder-Decoder Transformers through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning
  5. 05 Mixture of ExpertsLearn Mixture of Experts through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning
  6. 06 Sparse ModelsLearn Sparse Models through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning
  7. 07 Dense ModelsLearn Dense Models through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning
  8. 08 Grouped Query AttentionLearn Grouped Query Attention through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning
  9. 09 Multi-Query AttentionLearn Multi-Query Attention through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning
  10. 10 Flash AttentionLearn Flash Attention through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning
  11. 11 Sliding Window AttentionLearn Sliding Window Attention through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning
  12. 12 Sparse AttentionLearn Sparse Attention through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning
  13. 13 Rotary Position EmbeddingsLearn Rotary Position Embeddings through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning
  14. 14 ALiBiLearn ALiBi through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning
  15. 15 KV CacheLearn KV Cache through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning
  16. 16 Long-Context ModelsLearn Long-Context Models through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning
  17. 17 State Space ModelsLearn State Space Models through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning
  18. 18 Hybrid ArchitecturesLearn Hybrid Architectures through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning
  19. 19 PretrainingLearn Pretraining through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning
  20. 20 Dataset CollectionLearn Dataset Collection through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Intermediate · 14 min read · 120 min learning