BALU GORLE
@balugorle
Experienced Sr. Data Engineer specializing in ETL and data warehousing.
What I'm looking for
I am a Sr. Data Engineer with over 4 years of experience in the finance and healthcare sectors. My expertise lies in developing ETL/ELT pipelines, data acquisition, and data warehousing solutions. I have a strong background in utilizing cloud services such as AWS and Azure to create robust data processing applications. My work has focused on leveraging technologies like Spark, Databricks, and various NoSQL databases to ensure efficient data handling and compliance with industry standards.
Throughout my career, I have successfully designed and deployed data pipelines that enhance data accessibility and usability for business intelligence. I have collaborated with cross-functional teams to gather requirements and deliver solutions that meet organizational needs. My commitment to continuous learning and adapting to new technologies has allowed me to contribute to machine learning initiatives and improve data processing performance.
Experience
Work history, roles, and key accomplishments
Senior Data Engineer
Conifer Health Solutions
Jul 2024 - Present (1 year)
Collaborated with Business Analysts and SMEs to gather business requirements, applying problem-solving and decision-making to prioritize tasks. Developed and deployed Spark applications using Scala, PySpark, Spark Core, Spark SQL, and Spark Streaming within AWS EMR clusters, integrating Databricks Delta Lake for ACID compliance and data reliability.
Data Engineer
Cognizant
Aug 2021 - Present (3 years 11 months)
Developed highly complex Python, Scala, and Go code, which is maintainable, easy to use, and satisfies application requirements for financial data processing and analytics. Utilized Azure Data Factory for ETL processes, focusing on data transformation, cleansing, validation, and quality assurance, complemented by complex SQL queries using Spark SQL dataframes within Azure Databricks and BigQuery.
Associate Data Engineer
Cognizant
Jan 2020 - Present (5 years 6 months)
Conducted detailed analysis of data issues, mapping data from source to target, and performing data cleansing on the Data Warehouse. Designed ETL specification documents and implemented pipelines using Informatica, Azure Data Factory, and Apache Sqoop to load data into target systems.
Education
Degrees, certifications, and relevant coursework
St. Thomas University
Master of Science, Computer and Information Systems
Currently pursuing a Master of Science in Computer and Information Systems. The program focuses on advanced topics in computer science and information systems.
Tech stack
Software and tools used professionally
Azure HDInsight
Azure Synapse
Apache Spark
AWS Glue
DOMO
Azure RBAC
Google Cloud Platform
Google Cloud Storage
GitHub
Kubernetes
Azure Kubernetes Service
Jenkins
Salesforce
NumPy
Pandas
PySpark
dbt
DB
Sqoop
MySQL
PostgreSQL
MongoDB
Cassandra
Hadoop
HBase
Gmail
Yarn
Google Analytics
Databricks
Figma
Terraform
Azure Resource Manager
Azure DevOps
Jira
Java
TensorFlow
scikit-learn
Kafka
RabbitMQ
Amazon Kinesis
AWS Lambda
Azure Functions
Airflow
Time Analytics
s3-lambda
SQL
Availability
Location
Authorized to work in
Skills
Interested in hiring BALU?
You can contact BALU and 90k+ other talented remote workers on Himalayas.
Message BALUFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
