About This Course
<div>Databricks has become the default lakehouse platform for data engineering on AWS — over 60% of the Fortune 500 run on it. But knowing individual features isn't the same as being able to design, build, test, and deploy a real production pipeline. This course takes you through both: you'll master the core Databricks and AWS skills chapter by chapter, then apply every one of them to a single, realistic capstone project — an end-to-end lakehouse built for a real business, deployed the way production teams actually deploy.</div><div><ul><li>Learn Databricks on AWS and Build a Real Production Lakehouse from the Ground Up</li><li><span style="font-size: 1rem;">Set up and govern a Databricks workspace on AWS with Unity Catalog from day one</span></li><li><span style="font-size: 1rem;">Master Delta Lake — ACID transactions, time travel, constraints, performance</span></li><li><span style="font-size: 1rem;">Design Medallion Architecture pipelines with Lakeflow Connect and Lakeflow Declarative Pipelines</span></li><li><span style="font-size: 1rem;">Orchestrate production pipelines with Lakeflow Jobs — multi-task DAGs, retries, parameterization</span></li><li><span style="font-size: 1rem;">Build a complete lakehouse for a real e-commerce business — five source systems, five business-critical gold outputs</span></li><li><span style="font-size: 1rem;">Test, package, and deploy your pipelines with pytest, Databricks Asset Bundles, and GitHub Actions CI/CD</span></li><li><span style="font-size: 1rem;">A complete path from Databricks fundamentals to a deployed, production-grade lakehouse — built one real skill at a time.</span></li></ul></div><div><span style="font-size: 1rem;">Phase 1 — Foundations. You'll start with the core skills every Databricks data engineer needs on AWS:</span></div><div><ul><li>Workspace setup and Unity Catalog governance</li><li><span style="font-size: 1rem;">Delta Lake internals — ACID transactions, time travel, constraints</span></li><li><span style="font-size: 1rem;">Medallion Architecture, built by hand first, then declaratively with Lakeflow Declarative Pipelines</span></li><li><span style="font-size: 1rem;">Ingestion with Lakeflow Connect — SaaS, database CDC, and Auto Loader</span></li><li><span style="font-size: 1rem;">Orchestration with Lakeflow Jobs — DAGs, retries, control flow, REST API and CLI</span></li></ul></div><div><span style="font-size: 1rem;">Phase 2 — The Capstone. Every skill above gets applied to one continuous project: StepRight, a mid-size online footwear retailer with five source systems feeding five gold-layer outputs — daily revenue, customer 360, product performance, funnel analysis, and fulfillment health.</span></div><div><br></div><div>You'll ingest CDC and file-based data at production scale, then go further than most courses do:</div><div><ul><li>Write unit and integration tests for your transformation logic</li><li><span style="font-size: 1rem;">Package the project as a Databricks Asset Bundle</span></li><li><span style="font-size: 1rem;">Wire up GitHub Actions CI/CD — test, validate, deploy to UAT</span></li><li><span style="font-size: 1rem;">This is the same workflow real data platform teams run — not a toy example.</span></li><li><span style="font-size: 1rem;">By the end of this course, you'll have built and deployed a governed, tested, production-structured lakehouse — end to end, on your own.</span></li></ul></div><div><span style="font-size: 1rem;">You'll walk away with:</span></div><div><ul><li>A complete, working lakehouse project you built and can show, not just watched</li><li><span style="font-size: 1rem;">Hands-on notebooks for every chapter, ready to import into your own Databricks workspace</span></li><li><span style="font-size: 1rem;">A full GitHub repo structure from the capstone, showing exactly how a production project is organized</span></li></ul></div><div><span style="font-size: 1rem;">This isn't a features tour. It's the architecture, tooling, and deployment discipline real data platform teams run.</span></div><div><br></div><div>Disclaimer: This course was developed with the assistance of AI tools for content research, editing, and slide production. All technical content has been reviewed, tested and validated by the instructor.</div>
What you'll learn:
- Set up and govern a production Databricks workspace on AWS using Unity Catalog
- Master Delta Lake internals — ACID transactions, time travel, constraints, and performance tuning
- Design Medallion Architecture pipelines, first manually, then declaratively with Lakeflow Declarative Pipelines
- Ingest data at scale with Lakeflow Connect — SaaS connectors, database CDC, and Auto Loader
- Orchestrate production pipelines with Lakeflow Jobs — DAGs, retries, control flow, REST API and CLI
- Build a complete production lakehouse for a real e-commerce business, from ingestion through five gold-layer outputs
- Write unit and integration tests for Databricks pipeline code with pytest
- Package and deploy pipelines using Databricks Asset Bundles (DABs)
- Build a CI/CD pipeline with GitHub Actions that tests, validates, and deploys to a UAT environment