Open to opportunities

aparna marepally

@aparnamarepally

I build scalable, secure data platforms and ingestion pipelines with Microsoft Fabric, Python, SQL, and Azure.

I build secure, scalable data platforms and ingestion pipelines using Microsoft Fabric, Python, SQL, and Azure services.

At Amicus Global IT, I led medallion-layered architecture design in Microsoft Fabric and built reusable dbt Core transformation models with incremental and change-data-capture patterns, improving pipeline efficiency by 25%.

I also integrated REST and OAuth2 APIs with pagination and rate limiting to achieve 99.8% ingestion uptime, automated secure deployments through infrastructure-as-code and Git workflows, and built MCP servers with authorization scoping and injection resistance.

Previously at Wells Fargo and L&T Mindtree, I developed streaming and batch data pipelines with Kafka, Spark Structured Streaming, Azure Data Factory, Azure Synapse, and PySpark—reducing fraud-detection latency by 85%, report refresh times by 30%, and environment setup time by 60%.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Amicus Global IT

Oct 2024 - Present (1 year 11 months)

Led design and refinement of medallion-layered architecture in Microsoft Fabric, improving data ingestion pipelines and traceability. Developed reusable transformation models and implemented API integrations with REST and OAuth2, improving pipeline efficiency and reliability.

Microsoft Fabric Medallion Architecture Python SQL DBT REST OAuth PySpark Infrastructure as Code Git MCP Servers Secrets Management

Data Engineer

Wells Fargo

Jun 2023 - Oct 2024 (1 year 4 months)

Engineered streaming data ingestion pipelines with Apache Kafka and Spark Structured Streaming, reducing fraud-detection latency by 85%. Enhanced transformation workflows with Great Expectations and integrated RESTful APIs with OAuth2 for secure data ingestion.

Kafka Spark Structured Streaming Python SQL Great Expectations REST OAuth Azure DevOps Infrastructure as Code Git Secrets Management Quickbooks Business Central

Junior Data Engineer

L&T Mindtree

Jan 2021 - Dec 2022 (1 year 11 months)

Developed Azure Data Factory pipelines and Azure Synapse datasets using medallion architecture, improving data consistency and reducing report refresh times. Optimized PySpark and Python transformations with secrets management and automated infrastructure deployment using Git-based workflows.