Course Content
MODULE 1 Generative AI Foundations
Build a solid conceptual and architectural understanding.
0/7
1.1 Introduction to Generative AI
22:08
1.2 Probability, Tokens & Model Behavior
38:07
1.3 Modern Model Architectures
01:04:30
1.4 The Generative AI Pipeline End-to-End
30:00
1.5 Industry Landscape & Role of Generative AI
32:54
Foundations of Generative AI — Core Concepts Assessment
00:10:00
Build & Analyze a Mini Neural Network From Scratch Using NumPy
MODULE 2 Deep Learning Essentials for Generative AI
This module builds the technical backbone required to understand and create generative AI systems. Learners move from basic neural network mechanics into the advanced architectural concepts that power modern LLMs. The lessons drill into how networks learn, how attention replaces recurrence, and why deep learning techniques like residual connections, layer normalization, and transformer-based patterns dominate current AI systems. The module also covers the practical realities of training—optimizers, loss functions, precision formats, GPU requirements, and distributed strategies—ensuring learners can reason about model performance, stability, and scalability. By the end, students understand the essential engineering foundations behind any production-grade generative model.
0/7
2.1 Neural Network Fundamentals
30:00
2.2 Modern Deep Learning Architecture Patterns
01:19:00
2.3 Attention Mechanism — The Real Engine Behind LLMs
30:00
2.4 Training Dynamics of Deep Networks
30:00
2.5 Deep Learning Infrastructure
01:30:00
Deep Learning Foundations — Neural Networks & Training Dynamics Assessment
00:10:00
Constructing a Neural Network Engine Using Pure NumPy
MODULE 3 Transformer Architecture & LLM Internals
This module provides a complete, practical understanding of the architecture powering modern generative AI systems: the Transformer. The content demystifies how these models process language, how attention mechanisms work, and why Transformers dominate every state-of-the-art model from GPT to Gemini to LLaMA. You’ll learn how the encoder and decoder blocks function, how they differ, and how they interact in more complex tasks like translation and summarization.
MODULE 4 Embeddings, Vector Databases & Semantic Search
A large part of the module focuses on self-attention, the mathematical engine that enables models to reason over long sequences and understand relationships between tokens. You’ll dismantle the Query–Key–Value mechanism, attention scores, softmax scaling, and multi-head attention, gaining a concrete understanding of what is actually computed inside each layer. You will also analyze cross-attention, used heavily in instruction-tuning, multi-modal pipelines, and closed-book question answering.
MODULE 5 Retrieval-Augmented Generation (RAG) Systems
This module focuses on Retrieval-Augmented Generation (RAG), the architecture that turns large language models into reliable, knowledge-grounded systems suitable for enterprise use. You’ll learn why LLMs hallucinate, where their knowledge limits lie, and how retrieval solves these limitations by supplementing the model with external facts at inference time.
Generative AI

What happens from prompt → final output

  1. Tokenize input

  2. Build attention maps

  3. Generate probability distribution

  4. Sample next token

  5. Repeat until stop condition

  6. Detokenize to human-readable output

For image models:

  1. Start with random noise

  2. Iteratively denoise using UNet + cross-attention

  3. Decode latent vectors into pixel space

Latency & Cost Breakdown

You need to know what actually consumes compute:

  • Model size (parameter count)

  • Sequence length

  • Batch size

  • KV cache hit ratio

  • GPU vRAM

This determines whether your product is fast or unusably slow.

Previous
Next
0% Complete