Open to opportunities

Łukasz Pamuła

@ukaszpamua

Message

Lead Big Data engineer specializing in Hadoop, Spark, and cloud data platforms.

Poland

Message

What I'm looking for

I seek senior/lead roles building and operating scalable Big Data platforms, focusing on cloud migrations, governance, automation, and mentoring within collaborative, growth-oriented teams.

I am a Lead Hadoop Engineer and Senior Big Data expert with extensive experience designing, implementing, and operating large-scale Hadoop and cloud-based data platforms. I have a strong background in cluster management, performance tuning, ETL workflows, and data governance.

I have led transitions from external providers, built Cloudera clusters on EC2, and automated deployments and monitoring using Python, Terraform, Zabbix, Datadog, and New Relic. I regularly support Databricks, Immuta integrations, and SOC audit preparations to ensure compliance and operational reliability.

Throughout my career I contributed to real-time streaming and batch processing using Kafka, Flume, Spark (Scala), Hive, and Tez, and I developed automation and DevOps solutions with Jenkins, Puppet, Docker, Ansible-like practices, Bash, and Python. I also mentored teams, negotiated resources for projects, and fostered inclusive remote work cultures that supported team wellbeing.

I seek roles where I can continue to architect scalable data platforms, improve cost-performance and governance, and mentor engineers while working on cutting-edge Big Data and cloud migration projects.

Experience

Work history, roles, and key accomplishments

Current

Lead Hadoop Engineer

Current

Visa

Jan 2024 - Present (2 years)

Designed and managed Hadoop clusters, implemented ETL and data ingestion pipelines, and tuned Hive/Spark/Tez jobs to ensure high availability and scalability while mentoring remote team members.

Hadoop Hive Spark Tez ETL Data Security

Current

Senior Big Data Expert

Current

Aon

Jan 2019 - Present (7 years)

Took over cluster operations, built Cloudera clusters on EC2, authored Python monitoring and Databricks integrations, and supported SOC audit readiness and migrations using Terraform.

Cloudera Databricks Python AWS EC2 Terraform Datadog Zabbix Immuta ETL

Solution Architect

Cloudera

Dec 2021 - Apr 2022 (4 months)

Designed and audited upgrade plans (CDH → CDP7), supported component upgrades, resolved cluster and ETL issues, and produced client handover documentation.

Cloudera Solution Design Documentation

Hadoop Specialist

TVN S.A.

Jun 2014 - Nov 2021 (7 years 5 months)

Managed Cloudera/Horton clusters, implemented Sentry/Kerberos policies, developed Spark applications and streaming solutions with Flume/Kafka/Spark, and automated ETL workflows with Jenkins/NiFi.

Cloudera Spark Scala Kafka Flumes NiFi Jenkins Sentry Kerberos

Data Specialist

HSBC

May 2018 - Dec 2018 (7 months)

Analyzed and corrected data inconsistencies, created and monitored ETL workflows, managed Horton clusters and backups, and resolved Spark/Hive issues while developing QlikView solutions.

ETL Spark Hive Qlikview Data Analysis Backup

System and Network Administrator

TVN S.A.

Sep 2011 - Jun 2014 (2 years 9 months)

Installed and administered Linux servers, managed Cisco UCS and virtualization (Xen, LVS, DRBD), configured web and application servers, databases, and automated deployments with Puppet and Jenkins.