ankit vishwakarma
@ankitvishwakarma3
I build reliable cloud data pipelines for analytics and identity products.
IndiaWhat I'm looking for
At Publicis Sapient, I build automated streaming and batch deduplication frameworks that prevent redundant records from reaching identity-generation workflows and protect downstream identity graph accuracy. I also consolidate, cleanse, reconcile, and deduplicate data from 15 upstream tables for cross-product attribution.
Previously at LTIMindtree and IHS Markit, I automated survey and analytics data ingestion into ADLS, built API pipelines for Mixpanel events, and delivered PySpark migration pipelines from Hadoop to AWS S3. I've also automated reconciliation and PGP encryption workflows through scheduled EMR jobs.
My work spans PySpark, Spark SQL, Azure Databricks, ADLS, AWS, Hive, Airflow, and SAS. I bring consistent ownership of production-grade ETL pipelines while collaborating across analytics, engineering, and client teams.
Experience
Work history, roles, and key accomplishments
Engineered an automated streaming/batch deduplication framework to eliminate redundant file records before transmitting identity generation keys to IDM on a 15-minute cadence. Extracted, cleansed, and reconciled heterogeneous data across 15 upstream tables to generate a consolidated, attribution-ready unified table.
Automated store-level customer experience survey data ingestion from client SFTP servers into Azure Data Lake Storage (ADLS), implementing schema mapping and validation. Architected automated API ingestion fetching analytics event payloads from Mixpanel REST endpoints into ADLS and executed transformations to match existing schema structures.
Sr. Data Analyst (Automotive)
IHS Markit
Jan 2019 - Jun 2022 (3 years 5 months)
Delivered an integrated data pipeline using PySpark, ingesting five legacy source datasets from Hadoop, performing transformations and data cleansing, and outputting consolidated results to AWS S3. Constructed automated pipeline security routines to encrypt outbound deliverables into PGP format using Python cryptographic libraries, eliminating manual bottlenecks via scheduled EMR jobs.
Processed multi-source client datasets across varying raw structures, handling missing value imputation, identifying duplicate records, executing business cleansing rules, and staging final datasets within SAS repositories.
Configured and validated employee medical and welfare benefit eligibility frameworks based on jurisdiction state codes, employment status categories, full-time/part-time work indicators, and contractual criteria.
Education
Degrees, certifications, and relevant coursework
CSJM University
Bachelor of Computer Applications, Computer Applications
Completed a Bachelor of Computer Applications degree in 2013.
Christ Church Inter College
Intermediate, General Studies
Completed Intermediate (Class XII) education.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Salary expectations
Skills
Interested in hiring ankit?
You can contact ankit and 90k+ other talented remote workers on Himalayas.
Message ankitGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
