Open to opportunities

Purushotham J

@purushothamj

Message

Senior Data Engineer with expertise in ETL and cloud solutions.

United States

Message

What I'm looking for

I seek a challenging role in a dynamic environment that fosters innovation and growth.

I am a Senior Data Engineer with over 9 years of experience in the IT industry, specializing in data engineering across Banking, Finance, and Healthcare sectors. My expertise lies in designing and implementing scalable ETL/ELT pipelines, data acquisition, and data warehousing solutions using Microsoft BI tools like Tableau, SSIS, and Power BI. I have a proven track record of developing Spark applications in Azure Databricks and utilizing AWS and Azure cloud services to create cloud-based data pipelines.

Throughout my career, I have successfully managed complex data projects, ensuring compliance with data security standards such as HIPAA and GDPR. My experience includes working with various databases, including NoSQL and RDBMS, and leveraging tools like Python, R, and SQL for data analysis and machine learning initiatives. I am passionate about transforming data into actionable insights and have a strong commitment to delivering high-quality solutions that meet business needs.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Conifer Health Solutions

Jan 2024 - Present (1 year 5 months)

Designed and implemented scalable, automated ETL pipelines using AWS Glue, EMR, Lambda, and Terraform to manage data across Amazon S3, RDS, and Redshift, enhancing standardization of deployments across environments. Developed and deployed Spark applications using Scala, PySpark, Spark SQL, and Spark Streaming in AWS EMR clusters to process EHR, healthcare, and e-commerce data pipelines in PHI-comp

Data Engineer

Wipro

May 2021 - Present (4 years 1 month)

Responsible for tuning ETL procedures and schemas to optimize load and query performance. Designed and set up an Enterprise Data Lake to support various use cases including analytics, processing, storing, and reporting of voluminous, rapidly changing data.

ETL Data Lake Redshift S3 Lambda DynamoDB Amazon SageMaker Apache Spark HBase Apache Kafka Hive Sqoop Snowflake Python SSIS DTS Packages

Data Engineer

Bank Of America

Mar 2018 - Present (7 years 3 months)

Designed and implemented database solutions using Azure SQL Database and Azure SQL Data Warehouse for enterprise-scale data systems. Designed CI/CD pipelines using Azure DevOps Pipelines and Terraform for infrastructure as code (IaC) deployment and automated testing of data applications within containerized environments managed by Docker and Azure Kubernetes Service.

Data Analyst

FedEx

Jan 2017 - Present (8 years 5 months)

Involved in the complete life-cycle of Power BI workflow, starting from building a report in Power BI Desktop, publishing, maintaining, and sharing reports in the Power BI service. Created various Power BI reports like Maps, Line charts, Area Charts, Column Charts, Bar Charts, Pie Charts, and Doughnut Charts.

Power BI DAX Power Query Microsoft SQL Server T SQL Excel SSIS

Data Analyst

CignaHealthcare

Nov 2015 - Present (9 years 7 months)

Collected customer data from multiple sources, applying necessary transformations using Power BI Query Editor and building high-end Data models to analyze the data as per customer requirements in Power BI. Implemented Row-Level Security (RLS) and Power BI Personal Gateway to manage data access and enable scheduled refresh for on-premise datasets.

Power BI DAX Microsoft SQL Server T SQL Excel SharePoint)