Shivamani Thati

Data Engineer with 2.2 years of overall experience in IT industry, with good hands-on experience in designing, debugging and deployment of data ingestion in Azure Cloud and having good working knowledge on SQL SERVER. Having 2.0 Years of experience in Azure Cloud services like Azure Data Factory, Azure Synapse Analytics and Azure Data Lake Storage. Having more than one year experience in MS SQL SERVER (SSMS 2016). Proficient in creating Azure Data Factory pipelines for Extraction, Transformation and Loading process Hands on experience in creating Datasets and Data factories for transferring data from on-premise to cloud and vice versa by using ADF Hands on Experience in using the different activities like Copy, Stored procedure, Get Metadata, For Each, Append Variable activities etc., while creating the Azure data factories. Transformed structured and semi-structured data from various sources using Mapping Dataflow Transformations like Join, Conditional Split, Lookup, Union All, Sort, Aggregation, Derived Column, pivot, parse, rank, window etc. Implemented Stored Procedure Activities and Script Activity to perform SQL operations in Azure Data Factory. Implemented incremental data loading for multiple sources and transferred data from the sources to the staging area. Implemented Slowly Changing Dimensions (SCD Type1, SCD Type2, SCD Type3, SCD Type4) in ADF for capturing and loading delta load into the Datawarehouse. Experience in maintaining pipelines, understanding errors and solving pipeline execution failures. Worked with the Business Analyst and the other Developers throughout the lifecycle of the project Published, Scheduled and Triggered the Pipelines on the daily basis and weekly basis based on the business requirement of the client. Knowledge in Implementation of CI/CD pipelines for ADF. Knowledge in data transfer from Amazon S3 and Snowflake to Azure