Open to opportunities

santosh kharal

@santoshkharal

Message

Senior Data Engineer with expertise in cloud solutions and data processing.

United States

Message

What I'm looking for

I am looking for opportunities that foster innovation, collaboration, and continuous learning in data engineering and cloud solutions.

I am a Senior Data Engineer with over 7 years of experience specializing in optimizing data processing and throughput using technologies like Apache Spark, Kafka, and AWS. My visionary approach has led cross-functional teams to exceed performance targets and enhance data-driven decision-making capabilities. I have a proven track record of developing high-performance ETL pipelines and deploying machine learning models into production, significantly improving operational efficiency.

Throughout my career, I have successfully built next-gen data analytics platforms and enforced cloud-native data governance frameworks. My expertise in SQL and NoSQL database management ensures data accuracy and integrity across various platforms. I am dedicated to continuous learning, staying updated on serverless architectures and AI-driven analytics to drive business innovation.

Experience

Work history, roles, and key accomplishments

Current

Lead Data Engineer

Current

Raytheon Company

Aug 2022 - Present (2 years 10 months)

Built a next-gen data analytics platform on AWS that reduced ingestion latency by 40% and enabled scalable batch and real-time processing. Designed and optimized AWS Glue pipelines with Lambda, S3, and Step Functions, reducing batch processing time by 50%.

AWS Redshift EMR DynamoDB AWS Glue Lambda S3 Step Functions Terraform CloudFormation Kinesis Kafka API Gateway GuardDuty

Senior Data Engineer

Cisco Systems, Inc

Feb 2020 - Jul 2022 (2 years 5 months)

Optimized data retrieval performance on Azure Databricks using Delta Lake, Blob Storage, and partition pruning, reducing query times by 30%. Led the migration of legacy systems to Azure Cloud, leveraging Azure Data Factory, Synapse Analytics, and Data Lake.

Databricks Delta Lake Azure Blob Storage Azure Data Factory Synapse Data Lake RBAC Log Analytics Power BI Logic Apps Azure DevOps Azure Stream Analytics

Data Engineer

CVS Health

Mar 2018 - Jan 2020 (1 year 10 months)

Developed and managed ETL pipelines with Apache Airflow, processing 5M+ records daily to power BI dashboards and customer segmentation models. Automated data quality checks using SQL, Python, and Great Expectations, reducing data discrepancies.