Generative AI / Subject
Beginner
Build foundations in generative AI, machine learning, language models, transformers, prompt engineering, embeddings, vector databases, RAG, model APIs and media generation.
Your Progress
Learning Summary
Suggested sequence
Learning roadmap
Topics follow the Admin display order
Beginner
236 topics- Introduction to Generative AI
- What is Generative AI
- History of Generative AI
- Generative AI vs Traditional AI
- Generative AI vs Machine Learning
- Generative AI vs Deep Learning
- Generative AI vs Predictive AI
- Generative AI Applications
- Generative AI Use Cases
- Types of Generative AI
- Text Generation
- Image Generation
- Audio Generation
- Music Generation
- Video Generation
- Code Generation
- Multimodal Generation
- Synthetic Data Generation
- Artificial Intelligence Fundamentals
- Machine Learning Fundamentals
- Supervised Learning
- Unsupervised Learning
- Reinforcement Learning
- Neural Networks
- Deep Learning
- Training Data
- Training and Inference
- Parameters
- Hyperparameters
- Loss Functions
- Optimization
- Gradient Descent
- Backpropagation
- Introduction to Large Language Models
- Language Models
- Tokens
- Tokenization
- Vocabulary
- Context Window
- Embeddings
- Model Parameters
- Prompts
- Completions
- Inference
- Temperature
- Top-k Sampling
- Top-p Sampling
- Maximum Tokens
- Stop Sequences
- Deterministic vs Stochastic Generation
- Hallucinations
- Model Limitations
- Introduction to Transformers
- Transformer Architecture
- Encoder
- Decoder
- Encoder-Decoder Models
- Self-Attention
- Attention Mechanism
- Multi-Head Attention
- Positional Encoding
- Feed-Forward Networks
- Residual Connections
- Layer Normalization
- Causal Attention
- Attention Masks
- Introduction to Prompt Engineering
- Prompt Structure
- Instructions
- Context
- Input Data
- Output Format
- Zero-Shot Prompting
- One-Shot Prompting
- Few-Shot Prompting
- Role Prompting
- Contextual Prompting
- Prompt Templates
- Prompt Variables
- Prompt Constraints
- Structured Output
- JSON Output
- Prompt Testing
- Prompt Iteration
- Prompt Evaluation
- System Prompts
- Instruction Hierarchy
- Multi-Step Prompting
- Prompt Chaining
- Decomposition
- Self-Consistency
- Generated Knowledge Prompting
- Retrieval-Augmented Prompting
- Tool-Augmented Prompting
- Dynamic Prompting
- Adaptive Prompting
- Prompt Optimization
- Prompt Versioning
- Prompt Management
- Prompt Injection
- Indirect Prompt Injection
- Jailbreak Attacks
- Prompt Security
- Embedding Models
- Text Embeddings
- Image Embeddings
- Multimodal Embeddings
- Embedding Dimensions
- Vector Representation
- Semantic Similarity
- Cosine Similarity
- Dot Product Similarity
- Euclidean Distance
- Chunk Embeddings
- Document Embeddings
- Query Embeddings
- Embedding Search
- Embedding Evaluation
- Introduction to Vector Databases
- Vector Indexing
- Approximate Nearest Neighbor Search
- Similarity Search
- Metadata Filtering
- Hybrid Search
- HNSW
- IVF Indexes
- Product Quantization
- Vector Database Architecture
- Vector Database Scaling
- Vector Database Optimization
- Introduction to RAG
- RAG Architecture
- Knowledge Bases
- Document Loading
- Document Parsing
- Text Extraction
- Chunking
- Fixed-Size Chunking
- Semantic Chunking
- Recursive Chunking
- Overlapping Chunks
- Indexing
- Retrieval
- Semantic Retrieval
- Keyword Retrieval
- Hybrid Retrieval
- Query Transformation
- Query Expansion
- Multi-Query Retrieval
- Reranking
- Context Selection
- Context Compression
- Contextual Retrieval
- RAG Prompt Construction
- Citation Generation
- Source Attribution
- RAG Evaluation
- RAG Hallucination Reduction
- LLM APIs
- API Authentication
- Model Selection
- Message Roles
- Streaming Responses
- Structured Outputs
- Function Calling
- Tool Calling
- JSON Schema
- Error Handling
- Retry Strategies
- Rate Limits
- Token Management
- Cost Management
- Conversation Management
- Chat History
- Memory Systems
- Session Management
- Context Management
- Semantic Caching
- Response Caching
- LangChain
- LangGraph
- LlamaIndex
- Hugging Face Transformers
- Hugging Face Datasets
- Hugging Face Tokenizers
- Semantic Kernel
- DSPy
- Haystack
- LiteLLM
- vLLM
- OpenAI Models
- Anthropic Claude Models
- Google Gemini Models
- Meta Llama Models
- Mistral Models
- DeepSeek Models
- Qwen Models
- Microsoft AI Models
- Amazon Bedrock Models
- Open-Source LLMs
- Proprietary LLMs
- Local LLMs
- Generative Image Models
- Text-to-Image Generation
- Image-to-Image Generation
- Image Editing
- Inpainting
- Outpainting
- Image Conditioning
- Diffusion Models
- Stable Diffusion
- Latent Diffusion
- ControlNet
- LoRA for Image Models
- Image Prompt Engineering
- Negative Prompts
- Image Upscaling
- Speech Generation
- Text-to-Speech
- Speech-to-Text
- Voice Models
- Voice Cloning Concepts
- Audio Generation
- Music Generation
- Audio Transformers
- Speech Recognition
- Real-Time Voice AI
- Generative Video Models
- Text-to-Video
- Image-to-Video
- Video-to-Video
- Video Diffusion
- Video Transformers
- Video Prompt Engineering
- Temporal Consistency
- Video Editing with AI
Topics
236 published topics
- 41 Model ParametersLearn Model Parameters through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning
- 42 PromptsLearn Prompts through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning
- 43 CompletionsLearn Completions through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning
- 44 InferenceLearn Inference through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning
- 45 TemperatureLearn Temperature through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning
- 46 Top-k SamplingLearn Top-k Sampling through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning
- 47 Top-p SamplingLearn Top-p Sampling through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning
- 48 Maximum TokensLearn Maximum Tokens through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning
- 49 Stop SequencesLearn Stop Sequences through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning
- 50 Deterministic vs Stochastic GenerationLearn Deterministic vs Stochastic Generation through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning
- 51 HallucinationsLearn Hallucinations through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning
- 52 Model LimitationsLearn Model Limitations through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning
- 53 Introduction to TransformersLearn Introduction to Transformers through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning
- 54 Transformer ArchitectureLearn Transformer Architecture through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning
- 55 EncoderLearn Encoder through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning
- 56 DecoderLearn Decoder through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning
- 57 Encoder-Decoder ModelsLearn Encoder-Decoder Models through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning
- 58 Self-AttentionLearn Self-Attention through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning
- 59 Attention MechanismLearn Attention Mechanism through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning
- 60 Multi-Head AttentionLearn Multi-Head Attention through a detailed Generative AI lesson with a relevant example, verification, exercises, safety analysis and practice questions.Beginner · 14 min read · 90 min learning