Frank Carrasco Paulino
@frankcarrascopaulino
Senior Data Engineer building end-to-end data pipelines with Python, PySpark, and Databricks on Azure.
What I'm looking for
I’m a Senior Data Engineer focused on designing and delivering reliable data pipelines end-to-end. I’ve built solutions with Python and PySpark in Databricks, leveraging Azure Data Factory for orchestration, Azure Storage for storage, and Azure Logic Apps/Function Apps for event-driven workflows.
I also strengthen delivery through infrastructure and platform practices—using Terraform for IaC, GitHub/Azure Repos/Bitbucket for version control, and Jenkins/CI/CD for automation. On the data side, I’ve implemented T-SQL objects (queries, tables, views, functions, stored procedures) and integrated platforms such as Azure SQL, SQL Server, Oracle, and IBM DataStage, while staying hands-on with Linux/HDFS and big data technologies like Hadoop, Impala/Cloudera, and Spark.
Experience
Work history, roles, and key accomplishments
Senior Data Engineer
Tranzact
Oct 2023 - Aug 2024 (10 months)
Designed and implemented data pipelines using Python and PySpark in Databricks, including data logic in T-SQL (queries, tables, views, functions, stored procedures). Implemented Terraform IaC with GitHub version control and orchestrated pipelines with Azure Data Factory while managing data in Azure Storage.
Designed and implemented PySpark data pipelines in Databricks and built T-SQL logic (queries, views, functions, stored procedures). Managed Azure-based storage and repositories (Azure Storage, Azure Repos) and implemented event-driven processes using Azure Logic Apps and Function Apps.
Developed CI/CD pipelines using Bitbucket (Git) and Jenkins and supported data management with Hive (HQL), Impala, and Oracle. Used Linux for HDFS management and integrated/processed data with PySpark and IBM DataStage.
Junior BI & Big Data Consultant
FactorIT
Apr 2020 - Jul 2020 (3 months)
Performed data integration work using Oracle Warehouse Builder and IBM DataStage and supported ongoing BI/Big Data initiatives. Continued training and development across cloud platforms and analytics tooling.
BI & Big Data Intern
FactorIT
Jul 2019 - Mar 2020 (8 months)
Supported data integration across Azure Data Factory, Oracle Warehouse Builder, and IBM DataStage, and contributed to BI data visualization with Power BI. Helped with Spark SQL data loading and continued learning across Azure, GCP, AWS, and Udemy.
Education
Degrees, certifications, and relevant coursework
НИУ ВШЭ (HSE)
Master's degree, Business Analytics and Big Data Systems
2025 -
Activities and societies: Topics include Oracle/SQL Server and T-SQL, SQL Server Integration Services, IBM DataStage, Power BI, and Python; data visualization and integration.
Master’s program in Business Analytics and Big Data Systems at НИУ ВШЭ (2025–2027).
РГУ им. А.Н. Косыгина
Language course (B1), Russian Language
2024 - 2025
Studied Russian language at B1 level from 2024 to 2025 at РГУ им. А.Н. Косыгина.
Британско-перуанский культурный центр
Language course (B2–C1), English Language
2017 - 2020
Studied English at B2–C1 level from 2017 to 2020.
РГУ им. А.Н. Косыгина
Language course (B1), Russian Language
2020 - 2021
Completed a Russian language course at B1 level at РГУ им. А.Н. Косыгина.
Cibertec
Specialization, Big Data
2021 -
Completed a specialization in Big Data at Cibertec.
Universidad de Lima
Degree not specified, Computer Engineering
2015 - 2020
Studied Computer Engineering at Universidad de Lima from 2015 to 2020.
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Frank?
You can contact Frank and 90k+ other talented remote workers on Himalayas.
Message FrankFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
