Open to opportunities

Shauk Hassan

@shaukhassan1

Message

Results-driven Data Engineer with expertise in Big Data technologies.

United States

Message

What I'm looking for

I am looking for a challenging role that fosters innovation and growth in data engineering.

I am a results-driven Data Engineer with over 10 years of experience in data analytics, engineering, and ETL/ELT across various domains including Banking, Finance, Insurance, and Telecom. My expertise lies in building scalable data pipelines and Data Lakes on AWS, utilizing technologies such as Hadoop, Spark, and Kafka to drive impactful data solutions.

Throughout my career, I have successfully developed complex data processing applications, optimized data models, and ensured data quality in fast-paced environments. I thrive in Agile/Scrum teams and am dedicated to delivering high-performance solutions that meet business needs. My technical fluency in programming languages like Java, Scala, and Python, combined with my strong analytical skills, allows me to tackle challenging data problems effectively.

Experience

Work history, roles, and key accomplishments

Current

Sr. Data Engineer

Current

Pixelette Technologies Ltd

Oct 2021 - Present (3 years 10 months)

Developed Spark scripts in Scala for data transformations and created Hive Fact tables for analytics. Optimized Spark SQL queries and integrated data from various sources into HDFS/AWS S3.

Spark Scala Hive HDFS AWS S3 Pyspark Kafka Sqoop Impala Oozie

Data Engineer

Covariant

Aug 2017 - Sep 2021 (4 years 1 month)

Built scalable distributed data pipelines using Amazon EMR for large-scale processing. Ingested real-time data streams using Kafka REST API and Spark Streaming, persisting results in HDFS as Parquet files. Designed and optimized Hive tables with partitions and bucketing for efficient querying.

Amazon EMR Kafka HDFS Parquet Scala Hive MapReduce Spring Boot Avro

Data Engineer

SupportLogic

Jun 2014 - May 2017 (2 years 11 months)

Designed ETL solutions with Informatica, covering database structure and error handling. Implemented AWS-based Data Lake and used AWS Lambda for real-time data validation. Ingested raw data using Kafka producers and processed clickstream events via Spark Streaming.

Informatica AWS Lambda DynamoDB Kafka SparkSQL Python SQL Jenkins

Sr. ETL Consultant

MindsDB

Mar 2012 - Apr 2014 (2 years 1 month)

Gathered business and technical requirements for the RDM project and implemented EDW data quality fixes. Developed Hive tables and optimized performance using partitioning and bucketing techniques. Wrote MapReduce jobs in Java to process log data and led data reconciliation efforts.

Hive MapReduce Java Informatica Tivoli SCM Teradata Oracle

Education

Degrees, certifications, and relevant coursework

Unknown University

Bachelor of Science, Computer Science

Completed a Bachelor of Science in Computer Science, focusing on foundational computer science principles. Gained expertise in various programming paradigms and software development methodologies.