
Biprajit Dhar Chowdhury
@biprajitdharchowdhur
Data Engineer at Cognizant building PySpark and Databricks pipelines processing 10M+ records daily.
What I'm looking for
At Cognizant, I built scalable ETL pipelines with PySpark and Databricks, processing 10M+ records per day with 30% faster execution. I also automated workflows with Apache Airflow, reducing manual effort by 40%.
Earlier at Cognizant, I supported production data pipelines and databases, using Airflow, StreamSets, SQL, and PL/SQL to troubleshoot issues and improve reliability. I’m seeking opportunities to contribute to data engineering projects involving big data and modern data platforms.
Experience
Work history, roles, and key accomplishments
o Built scalable ETL pipelines using PySpark and Databricks, processing 10M+ records/day with 30%
faster execution.
o Automated workflows using Apache Airflow, reducing manual effort by 40% and improving
scheduling reliability.
o Optimized complex SQL queries, cutting query runtime by 25% and improving data retrieval
efficiency.
o Improved system performance through code optimization, reducing pro
o Delivered production support using SQL & PL/SQL, resolving 95%+ incidents within SLA timelines.
o Analyzed and fixed data issues using complex SQL queries, improving data accuracy to 99.9%.
o Monitored database performance and optimized queries, improving overall system efficiency by
20%.
o Handled ad hoc data requests and reporting, ensuring 100% accuracy in deliverables.
o Provided production support for data pipelines using Airflow ensuring a 99.9% job success rate.
o Monitored and managed workflow orchestration in Airflow, reducing job failures by 30%.
o Resolved data pipeline and ingestion issues using StreamSets and Data Loader, improving data
availability by 25%.
o Wrote SQL queries for troubleshooting and data validation, achieving 100% data accuracy.
Education
Degrees, certifications, and relevant coursework
Nava Nalanda
Higher secondary , Science
Amazon Web Services (AWS)
AWS Certified Cloud Practitioner
Issued Dec 2023
St. Thomas' College of Engineering & Technology 122
Bachelor of Technology - BTech, Electronic and Communication Engineering
2018 - 2022
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Salary expectations
Social media
Job categories
Interested in hiring Biprajit?
You can contact Biprajit and 600K+ other talented remote workers on Himalayas.
Message BiprajitGet matched with your dream remote job
Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
