Open to opportunities

Arshiya Hussain

@arshiyahussain

Message

Senior data engineer and architect building scalable AWS data pipelines that boost performance and efficiency.

United Kingdom

Message

What I'm looking for

I’m looking to lead and build scalable AWS data pipelines and data lake architectures with strong governance—owning high-throughput reliability, performance tuning, and measurable cost/process improvements in an environment that values technical integrity.

I’m a Senior Data/Software Engineer and Architect specializing in scalable pipelines and AWS data lakes, with a focus on building autonomous, high-throughput systems that deliver measurable outcomes—cutting processing time by 90% and improving cost efficiency by up to 300% through redesign and cluster tuning.

At BBC Worldwide, I design and deploy microservices-based applications and high-throughput data pipelines on AWS for the Audience Data team. I lead engineering efforts that emphasize data governance and technical integrity, including end-to-end pipeline orchestration with Apache Airflow (DAGs) and metadata cataloging via AWS Glue.

Highlights include engineering the SCV (Single Customer View) analytics pipeline using S3, EMR (Spark), and Redshift delivery, building a greenfield BBC Audience Gateway (BAG) system decoupled with Spring Boot and MS Kafka, and optimizing ingestion pipelines using Glue/Hive/EMR for joins and aggregations. I’m hands-on with TDD/BDD (JUnit/Mockito, TestContainers/LocalStack) and performance/load testing (Gatling), ensuring systems are reliable, scalable, and cost-effective.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

BBC Worldwide

Feb 2016 - Present (10 years 2 months)

Designed and deployed microservices-based applications and high-throughput AWS data pipelines for the Audience Data team using Java, Python, and Scala. Built end-to-end analytics and ingestion systems with Apache Airflow/Glue/S3/Redshift and optimized performance by 70% and achieved up to 300% cost efficiency through architecture and EMR tuning.

AWS S3 Amazon Redshift Apache Airflow AWS Glue Java Python DynamoDB

Software Developer

IBM UK - Monitise

Jul 2013 - Feb 2016 (2 years 7 months)

Developed SOAP and REST APIs for the Standing Order Maintenance Service and Mobile Payment Service using Apache CXF. Established CI/CD pipelines with Jenkins to support continuous delivery for production services.

Java Apache CXF SOAP REST APIs CI CD Groovy Maven Git

Lead Developer

Trafalgar Management Services

Jan 2011 - Jul 2013 (2 years 6 months)

Developed and maintained mission-critical Java/J2EE applications for a content management system (CMS), including CCAPI web services and SOLR search functionality. Served as a senior system administrator managing Linux, MySQL, Apache2, and Tomcat.

Java J2EE Web Services Apache SOLR Linux MySQL Tomcat