Looking for a job

Sai ram

@sairam2

Message

Experienced Senior Data Engineer specializing in Big Data technologies.

India

Message

What I'm looking for

I am looking for a challenging role that fosters growth, innovation, and collaboration in a dynamic environment.

I am a Senior Data Engineer with over 9 years of experience in the IT industry, including more than 6 years focused on Big Data technologies. My expertise lies in the Hadoop ecosystem, where I have successfully implemented solutions using Cloudera distribution. I have a strong background in data ingestion, storage, querying, processing, and analysis, which has allowed me to contribute significantly to various projects.

Throughout my career, I have worked with renowned organizations such as Wells Fargo, Micron Technology, and CGI. My achievements include receiving multiple awards for my contributions, including the Bravo Award and Manager Spotlight Award. I am proficient in a variety of tools and technologies, including Spark, Scala, and Azure, and I am always eager to embrace new challenges and advance my skills in the ever-evolving tech landscape.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Wells Fargo India

Oct 2021 - Present (3 years 8 months)

Led ETL data ingestion pipeline design using Azure Data Factory and Databricks for the Wholesale Lending Data Services project. Extracted and ingested data from various sources into ADLS, developing PySpark/Scala transformations and creating Hive tables. Managed job scheduling with Autosys and tracked issues using JIRA in an Agile environment.

Azure Data Factory Databricks Hive Spark Scala Oracle Unix Talend Teradata Autosys

Data Engineer

Micron Technology Operation India, INC

Sep 2019 - Sep 2021 (2 years)

Contributed to Micron's Global Data Warehouse (GDW) project, integrating data from multiple sources for analytics and reporting. Ingested data from MySQL/Oracle into Hadoop using Nifi and created/queried Hive tables with partitions and buckets. Utilized Spark and Scala to load and process structured data, including loading data into Snowflake tables.

Hadoop Hive NiFi Spark Scala Splunk Oracle MySQL Snowflake Unix

Software Engineer

CGI Information Systems And Management Consultants Private L

Feb 2016 - Sep 2019 (3 years 7 months)

Worked on health insurance projects for CIGNA, including producing health reports (Facets) and maintaining a claim engine (PMHS). Involved in requirement analysis, design, development, and testing for both Hadoop-based and AS400/Cobol systems. Imported data from RDBMS to HDFS using Sqoop and analyzed with Spark/Scala, while also handling change requests and defects for the AS400 system.