I am a Senior Data Engineer with over 5 years of experience in the Retail and Entertainment sectors. I have a strong background in designing and implementing scalable, secure, and cost-effective data solutions on cloud platforms like AWS and GCP. My expertise lies in AWS Data Engineering and services such as S3, RDS, EMR, EC2, and Dynamo DB. I also have hands-on experience with ETL tools like Databricks Workflows and Apache Airflow.
As a practitioner in the field, I have successfully cleaned and performed exploratory data analysis on large datasets. I have built ETL pipelines utilizing various data engineering tools. I am skilled in data mining, visualization, stakeholder management, and business intelligence. I am also proficient in predictive modeling, data cleaning, data structuring, and cross-functional coordination.
I am well-versed in agile practices and have experience in Hadoop, data pipelines, deployment, and framework maintenance. I have a strong background in data modeling, scheduling, and workflows. My technical skills include Python, BigData, PySpark, Apache Spark, MySQL, Elastic Store, Mongo DB, RDBMS, Hadoop, Sqoop, Pandas, Numpy, Excel, Power BI, Matplotlib, Seaborn, Airflow, Databricks, Linux, and Bitbucket.
