AS

Looking for a job

Arnab Sengupta

@arnabsengupta1

Data Engineer at WIPRO TECHNOLOGIES building Azure Databricks reports and ADF CI/CD pipelines with YAML in GitHub.

At WIPRO TECHNOLOGIES, I develop reports in Azure Databricks using data from ADLS and Azure SQL, with PySpark and SQL. I also work on Azure Data Factory pipeline development and built ADF CI/CD with YAML code in GitHub.

Previously, I developed Azure Data Factory pipelines to bring data from CSV, databases, and Parquet files into Azure Database and Azure Data Lake. On a Hana-to-Azure migration, I wrote PySpark reports and optimized long-running notebook calculations.

Experience

Work history, roles, and key accomplishments

WT

Current

Developer and Data Engineer

Current

Wipro Technologies

Jun 2015 - Present (11 years 4 months)

Developed and maintained SQL databases, implemented business logic, and wrote critical stored procedures. Built Azure Data Factory pipelines and Azure Databricks reports using PySpark and SQL.

SQL Stored Procedures Azure Data Factory Azure Databricks PySpark Azure Data Lake Azure SQL MSSQL ADF CI CD YAML GitHub Unity Catalog

Education

Degrees, certifications, and relevant coursework

FM

Future Institute of Engineering and Management

Master of Computer Application, Computer Application

Master of Computer Application with specialization in Computer Application.

Tech stack

Software and tools used professionally

PySpark

SQL

Unity Catalog

Availability

Looking for a job

Location

India

Authorized to work in

Salary expectations

2546k+ INR

Job categories

Skills

Azure Databricks Azure Data Factory Azure SQL Azure Data Lake SQL Development PySpark SQL Stored Procedures Data Pipelines Pipeline Execution Query Optimization CI CD YAML Unity Catalog SQL Server Management Studio

Interested in hiring Arnab?

You can contact Arnab and 90k+ other talented remote workers on Himalayas.

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!