ARIJIT KUMAR
@arijitkumar
Data engineer building Spark pipelines for near real-time analytics and operational monitoring.
IndiaWhat I'm looking for
At Tata Consultancy Services, I engineered distributed Spark ETL workflows for Cisco Secure Firewall telemetry, cutting runtime from 4 hours to 2.4 hours and reducing shuffle overhead.
I design and optimize batch and near real-time pipelines with PySpark, SparkSQL, Databricks, and AWS, including data cleaning, transformation, validation, and feature engineering for downstream analytics and ML-ready datasets.
I built operational dashboards and analytics reporting so teams get proactive monitoring and executive-level visibility across 60K+ enterprise customers.
I also integrate Airflow-orchestrated Spark workflows with Git-based CI/CD for automated deployment, testing, and monitoring, and I’ve helped improve system reliability enough to support infrastructure savings.
Experience
Work history, roles, and key accomplishments
Engineered high-performance distributed Spark ETL workflows for large-scale telemetry data processing, reducing pipeline runtime by 40%. Designed operational dashboards and analytics reporting solutions for Cisco Secure Firewall telemetry systems.
Education
Degrees, certifications, and relevant coursework
International Institute of Information Technology (IIIT), Bangalore
Post Graduate Diploma, Machine Learning & AI
2025 -
Pursuing a Post Graduate Diploma in Machine Learning & AI.
Indira Gandhi Institute of Technology, Sarang
Bachelor of Technology, Electronics & Telecommunication Engineering
2019 - 2023
Grade: 8.56/10
Bachelor of Technology in Electronics & Telecommunication Engineering with a CGPA of 8.56/10.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Job categories
Skills
Interested in hiring ARIJIT?
You can contact ARIJIT and 90k+ other talented remote workers on Himalayas.
Message ARIJITGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
