I am a passionate Data Engineer with over 3.6+ years of experience in crafting scalable and efficient data engineering solutions. My expertise lies in leveraging cutting-edge technologies like Azure Databricks, PySpark, Spark SQL, and Azure Data Factory (ADF) to build robust ETL pipelines and handle complex data transformations. I specialize in advanced data profiling, cleansing, and query optimization, ensuring seamless data processing and delivery.
Proficient in cloud platforms such as AWS and GCP, I have hands-on experience with big data tools like Hive, Kafka, HDFS, and Sqoop, enabling me to manage large-scale data ecosystems effectively. My projects often involve optimizing batch processing logic, designing scalable data architectures, and solving intricate data challenges to drive business insights.
Apart from my technical skills, I excel in collaborating across teams in Agile environments and aligning solutions with business objectives. I am also committed to continuous learning, staying updated with emerging trends in data engineering, and mentoring peers to foster a culture of growth and innovation.
In my free time, I enjoy exploring advancements in machine learning, contributing to open-source projects, and participating in technical communities. My career goal is to continuously deliver impactful data solutions that empower businesses to make data-driven decisions.