Sr. Data Engineer

What’sthe role

We are looking for a highly skilledSr.Data Engineerto join our team and help design,buildandmaintainthe infrastructurerequiredforoptimalextraction ,transformation and loading of data from various sources (which include streaming and batch data). The candidate is expected to work closely with multiple business stakeholders and teams to support data initiatives and ensure business value generation. 

Accountabilities:

• Closely workingwith product / project team and stakeholders to understand the requirement

• Solution consultation and developmentin accordance withthe enterprise technology principles, methods, standards, and practices. 

• Estimation, solution & detailed technical design, implementation ofhigh performancedata pipelines which is secure and scalable 

• To define data models and schemas to support data analytics 

• Integrate different kind of datasources(database, API, streams) into unified data platform

• Implement solutions for near-real-time data access. 

• Maintain and improve data quality,consistencyand data governance throughout the ETL/ELT process 

• application technical deliverables including code, associated tests, and documentation 

• To automatethe dataworkflows and reduce manual intervention. 

• To collaborate with multiple teams to integrate data solutions into other applications

• To build the reusable solutions which can be reused across multiple projects

• Toidentifyareas, for improving efficiency in data operations 

• To innovate solutions for complex data and to ensure scalability and performance 

Whatyou bring

• Must have legal authorization to work in the US on a full-time basis for anyone other than current employer

• Degree in Software Engineer ordemonstratedcapability, applied experience, and role-relevant skills

• 10 + Years of relevant data engineering experience whichincludesolutioning,design,planning and implementingend-to-enddata solutions. Have in-depthhands-onexperience in multiple complex implementations which include different tools and technologies

• Good understanding of Energy Trading Business Domain and experience in transformation, orchestration of data in Energy Trading area

• Proficient in Azure Cloud Technologies: Hands-on experience with a wide range of Azure services including Azure Data Factory (ADF), Azure Databricks (ADB), Azure Active Directory, Azure Storage, Azure Data Lake Services (ADLS), Azure Key Vault, Azure SQL Database, Azure Logic Apps and Azure DevOps

• Data Engineering Expertise: Implemented several end-to-end data solutions using Azure Databricks Delta Lake for optimized storage, processing, and analytics over Azure Data Lake Storage (ADLS)

• Azure Data Integration & Orchestration: Extensive experience in using Azure Data Factory (ADF) to orchestrate complex ETL/ELT pipelines, integrating with various data sources and destinations across Azure ecosystem

• Advanced Knowledge in Data Processing & Analytics: Strong skills in Apache Spark andPySpark, leveraging Databricks for large-scale data processing and transformation

• Azure Functions & Event-Driven Architectures: Experience developing serverless solutions using Azure Functions for data integration, real-time message consumption, and event-driven architectures

• Python Programming:Expertisein developing data engineering pipelines, automation scripts, and data transformations using Python.

• Data Storage Solutions: Hands-on experience with Azure SQL Database, SQL Warehouse, and Blob Storage/ADLS for structured, semi-structured data storage

• DevOps, GitHub & CI/CD Pipelines: Skilled in Azure DevOps/GitHub for implementing continuous integration and continuous deployment (CI/CD) pipelines and managing source control and project workflows

Note: This role is a virtual position based in the US

What we offer

The base salary range for thisposition is$124,000- $186,000per year. Individualpay will be based onvarious factors, such as relevant work experience, education, certifications, skill level, seniority, and internal equity.

For regular full-time or regular part-time employees of the Company (participating companies as listed in the Summary Plan Description), insurance coverage options include medical, dental, vision coverage, life Insurance, Business Travel Accident Insurance, and Occupational Accidental Death Benefit programs. Employees alsoparticipatein a company pension plan anda 401(k) plan. Paid leave includes up to 6 weeks of paid vacation time, up to 11 paid holidays, and parental leave offering 16 weeks of paid leave for birthing parents, and 8 weeks of paid leave for non-birthing parents.

Additionally, employees are eligible for short-term disability leave for up to 26 weeks at 100% or 50% of base pay as well as Long-Term Disability insurance. Shell also offers other compensation such financial reimbursement for adoption, wellness, education, and personal learning expenses, and some roles are eligible for discretionary long-term incentives.  For interns, eligible benefits include medical, dental, and vision coverage, life insurance, Business Travel Accident Insurance, and Occupational Accidental Death Benefit programs; participation in a 401(k) plan; and paid leave for up to 11 paid holidays. Additionalinformation on Shell’s US benefit programs can be found athttps://www.shell.us/careers/about-careers-at-shell/rewards-and-benefits.html.

You bring your skills and experience to Shell and in return you work with talented, committed people on one of the most important challenges facing our planet.You’llhave the opportunity to develop the skills you need to grow in an environment where we value honesty, integrity, and respect for one another.You’llbe able to balance your priorities as you become the best version of yourself.

• Progress as a person as we work on the energy transition together

• Continuously grow the transferable skills you need to get ahead

• Work at the forefront of technology, trends, and practices

• Collaborate with experienced colleagues with uniqueexpertise

• Achieve your balance in a values-led culture that encourages you to be the best version of yourself

• Benefit from flexible working hours, and the possibility of remote/mobile working

• Perform at your best with a competitive starting salary and annual performancerelated salary increase – our pay and benefits packagesare considered to beamong the best in the world.

• Take advantage of paid parental leave, including for non-birthing parents

• Join anorganizationworking to become one of the most diverse and inclusive in the world. We strongly encourage applicants of all genders, ages, ethnicities, cultures, abilities, sexual orientation,and life experiences to apply

• Grow as you progress through diverse career opportunities in national and international teams

• Gain access to a wide range of training and developmentprograms

We'dlike you to know that Shell has a bold goal: to become one of the world’s most diverse and inclusive companies. You can get to know more about howwe'reworking towards that goal,click here.

Shell inThe United States

Shell has been in the US for more than 100 years, leading the sector in energy,petrochemicalsand refined products. Today, we provide millions of Americans with the energy needed to heat and cool their homes and power the economy.

Weoperatein all 50 states, from our Deepwater platforms in the Gulf ofAmericato the Pennsylvania Chemicals complex and our miles of pipelines throughout the US.

We reach our customers through our 13,000 branded retail stations, and we are number 1 in gasoline sales. We also own the #1 brand of motor oil in the U.S. – Pennzoil® – made from natural gas.

We are excited to play a key role in the move to net carbon emissions while providing the oil and gas needed by society for many decades to come.