azuresynapse

Transform data from on-premises SQL Server to Azure Delta Lake Storage for Analytics and Visualization

Local SQL Database ---> Azure ---> Power BI

Generic Pipelines / Templates for Data Factory / Synapse Pipelines w.r.t Different MSFT Offering Integrations / Use Cases

Explore the Tokyo Olympics data journey! We ingested a GitHub CSV into Azure via Data Factory, stored it in Data Lake Storage Gen2, performed transformations in Databricks, conducted advanced analytics in Azure Synapse, and visualized insights in Synapse or Power BI.

This project builds an End-to-End Azure Data Engineering Pipeline, performing ETL and Analytics Reporting on the AdventureWorks2022LT Database.

Ingested Tokyo Olympic data into Azure Data Lake using Azure Data Factory. Enhanced data quality with Apache Spark on Azure Databricks. Optimized SQL queries on Synapse Analytics, reducing execution time. Developed engaging Power BI dashboards, boosting user engagement creating KPI's with DAX.

This project aims to predict customer booking behaviors by classifying them into three categories: Booked and Canceled Booked and Checked Out Booked and Did Not Show

Practice with Azure Synapse Analytics/Databricks Pipeline

Create high-quality data pipelines using Azure

A spark reader to read the Common Event Format (CEF) built using Scala and SBT and optimised for Databricks workloads

This project builds an End-to-End Azure Data Engineering Pipeline, performing ETL and Analytics Reporting on the AdventureWorks2022LT Database.

Azure_Synapse_Project_NYC_TAXI_DATA--Sayantan Barat

Contains solutions/versions of Batch Data Pipelines created on Azure Data Factory

End-to-end Azure healthcare data engineering platform with batch & real-time ingestion, Medallion Architecture, Databricks, Event Hubs, Synapse, Power BI, Unity Catalog and CI/CD.

End-to-end data engineering pipeline on Azure that transforms PostgreSQL bike-share data into a Synapse star schema warehouse and Power BI analytics dashboards.

The objective of this project is to design and implement a scalable, cloud-based data pipeline using Azure Databricks, Azure Data Lake, and Azure Synapse Analytics

End-to-end Azure data pipeline (ADF → ADLS → Databricks/PySpark → Synapse Serverless → Power BI) using Medallion architecture.

This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Artificial Intelligence topics.