Open to opportunities

Micheal Lively

@micheallively

Message

Senior Data Engineer specializing in cloud, Databricks, and scalable ETL pipelines.

United States

Message

What I'm looking for

I seek a data-engineering role focused on cloud-native architectures, scalable ETL, strong data governance, mentoring opportunities, and collaborative teams driving analytics impact.

I am a Senior Data Engineer with deep expertise in data architecture, pipeline development, and cloud-based platforms, focused on delivering reliable, scalable data solutions.

I have designed and optimized ETL and PySpark pipelines, led migrations from on-premise SQL Server to Azure Synapse and Data Lake, and implemented Delta Lake and Unity Catalog for governance.

My work reduced pipeline runtimes, improved query performance through partitioning and indexing, and enforced data quality and SLA monitoring across production systems while mentoring junior engineers.

I hold cloud and data engineering certifications and a computer science degree, and I bring strong collaboration, problem-solving, and data governance skills to help organizations leverage data effectively.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

HealthPulse Technologies

Jan 2021 - Present (4 years 9 months)

Developed and deployed Azure-based ETL pipelines for electronic health records and claims data, migrated on-premise SQL Server to Azure Synapse/Data Lake, and implemented optimizations that improved pipeline performance and reliability. Led code reviews, mentorship, and SLA monitoring to maintain data quality and governance across production systems.

Azure Synapse Data Lake T SQL Python ETL Data Governance Performance Tuning Monitoring Data Quality

Databricks Engineer

DxOMark

Feb 2018 - Dec 2020 (2 years 10 months)

Designed and optimized PySpark/Databricks pipelines and implemented Delta Lake and Unity Catalog, reducing runtime by 40% and enabling governed, versioned access to large imaging analytics datasets. Collaborated with data science teams on models and mentored junior engineers to improve code quality and SLA compliance.

Pyspark Databricks Delta Lake Unity Catalog Spark Optimization Data Ingestion Monitoring Data Visualization

Data Engineer

PlanHub

Mar 2015 - Nov 2017 (2 years 8 months)

Built and maintained ETL pipelines and SQL-based transformations for transportation and logistics datasets, supported cloud migration to Azure Data Lake & Synapse, and delivered Power BI dashboards that provided actionable operational insights. Applied performance tuning and data governance to ensure accuracy and timeliness.