At Ecolabrize Technology Pvt. Ltd., I design and maintain scalable data pipelines on GCP using BigQuery and Dataproc. I build and support ETL workflows for structured and unstructured data with PySpark and SQL.
I also automated data ingestion and transformation with Apache Airflow and supported batch processing in the healthcare domain, applying data cleansing and consistency checks. In my E-Commerce Sales Analytics Pipeline project, I processed sales data and stored it in BigQuery, using partitioning and clustering to optimize query performance.
