Maheswararao A

I am a Data Engineer with over 5 years of experience in the IT industry, specializing in Big Data Development and Azure Data Engineering. I have a strong background in working with Azure services such as Azure Gen2 Lake, Azure Key Vault, Azure Data Bricks, Azure Data Factory, and SQL Server. My expertise lies in building Azure Data Bricks PySpark and Spark-SQL Notebooks for data transformations, as well as reading and writing data in Azure Data Bricks. I have also worked extensively with big data components like Spark SQL, Data-frames, and Hive database implementation using Azure Data Bricks.

One of my major achievements includes developing extraction flows using Azure Data Factory for handling incremental and full data loads. I have also gained hands-on experience in implementing end-to-end data migration, including data ingestion using ADF. Additionally, I have expertise in maintaining Delta Lake and managing data in different zones such as Raw, Cleansed, Enriched, and Curated. I have implemented metadata-driven ADF pipelines to process incremental data loads and have worked with various ADF components like Linked services, Data sets, Integration runtime, Pipelines, Activities, and Triggers.

Throughout my career, I have worked with Agile methodology, ensuring the delivery of quality work within sprint planning and estimation. I possess excellent communication and analytical skills, and I am always eager to learn new concepts and technologies.