End to End Data Project with Microsoft Fabric - Data Engineering, Data Factory and Power BI

🚀Join me in this tutorial as we build an end to end data engineering and reporting solution using Microsoft Fabric.

This tutorial uses the USGS Earthquake API to build an end to end data solution focusing on the Data Engineering, Data Factory and Power BI experiences.

⌚ Timestamps
00:00 Introduction to the Project and Solution Overview
03:20 Creating a Fabric Workspace and Data Lakehouse
06:48 Overview of the USGS Earthquake API
08:04 Using Python Requests to Fetch API data
14:40 Coding the Bronze Layer Processing Notebook
21:40 Coding the Silver Layer Processing Notebook
30:40 Coding the Gold Layer Processing Notebook
41:14 Updating the Default Semantic Model and Creating the Power BI Report
52:36 Using a Data Factory Pipeline to Orchestrate the Data Processing
01:03:10 Project Debrief

🔗 Links and Resources
- GitHub Repository: https://github.com/malvik01/Earthquake-Data-Engineering-Project-with-Microsoft-Fabric/tree/main
- Earthquake API: https://earthquake.usgs.gov/fdsnws/event/1/#parameters
- How to get a Fabric Free Trial without a work email: https://www.youtube.com/watch?v=RHV7jZqc_tE
- Unix Timestamp Convertor: https://www.unixtimestamp.com/
- Reverse Geocoder Python Library: https://pypi.org/project/reverse_geocoder/
- What is the Medallion Architecture: https://learn.microsoft.com/en-us/azure/databricks/lakehouse/medallion
- Fabric Environments: https://learn.microsoft.com/en-us/fabric/data-engineering/create-and-use-environment

📚 Check out my Udemy Course
- Microsoft Fabric: The Ultimate Guide: https://www.udemy.com/course/microsoft-fabric-the-ultimate-guide/?referralCode=94FDA5B8134E63965E92