Full-time remote Cloud & Data Platform / Data Engineer role (Databricks, PySpark, SQL, Airflow, AWS). Open to worldwide remote and EU/UK/UAE relocation. Target $60k–$90k USD. Not looking for pure SRE or network-only roles.
Looking for a job
Pankaj Prajapathi
@pankajprajapathi
Cloud & Data Platform Engineer | Databricks, PySpark, SQL, AWS. Amgen lakehouse, 500 KPIs. Open to remote worldwide.
IndiaWhat I'm looking for
Cloud & Data Platform Engineer with 4+ years on AWS and Databricks. At QuantZig I own Amgen Rare Disease lakehouse delivery: Redshift to Databricks Metric Engine across 30+ tables (10M+ rows), multiple PySpark/SQL pipelines, and ~500 production KPIs in Q1 vs ~150 from the incumbent. Live KPI platform (lineage, DQ, self-serve) on Airflow.
Before that: AWS data platform (S3, Lambda, MWAA, Athena) and, at Diligent, Python ETL (~40% less manual work) plus GRC apps on Amazon EKS with Terraform and CI/CD.
I also ship production apps: Zaavero (SSO + AgentOps + DataWhisper NL-to-SQL) and Sanjana Stone Arts. Open to remote worldwide.
Experience
Work history, roles, and key accomplishments
QR
Current
Senior Analytics Consultant — Data Platform
QuantZig (Infiniti Research)
Jan 2026 - Present (8 months)
Owns Amgen Rare Disease lakehouse delivery, migrating production Redshift SQL into Databricks Metric Engine KPIs on 30+ tables. Converted and shipped ~500 production KPIs in Q1, achieving ~3x throughput compared to the incumbent partner.
QR
Senior Network Engineer — AWS Cloud & Data Platform
QuantZig (Infiniti Research)
Sep 2025 - Dec 2025 (3 months)
Built the AWS data platform layer including S3 CDN, Lambda Spot Fleet cost controls, IAM automation, and cross-account S3. Orchestrated Airflow (MWAA) to Athena and developed API Gateway + Lambda APIs into Databricks.
DI
Associate Solution Developer
Diligent
Nov 2023 - Sep 2025 (1 year 10 months)
Built Python ETL into PostgreSQL that cut manual compliance processing by ~40%, running on a serverless AWS pipeline. Deployed GRC toolkits on Amazon EKS with Docker, Terraform, and GitHub Actions/Jenkins CI/CD.
VS
Cloud Associate and DevOps Engineer
Valuepoint Systems
Aug 2022 - Oct 2023 (1 year 2 months)
Provisioned AWS resources (EC2, S3, IAM, VPC) with Terraform and CI/CD. Dockerized Flask on EC2 and used Python/Boto3 for S3 media processing and Windows EC2 to S3 backups.
Education
Degrees, certifications, and relevant coursework
DA
Databricks
Databricks Certified Data Engineer Associate, Data Engineering
Earned the Databricks Certified Data Engineer Associate certification in May 2026.
AS
Amazon Web Services
AWS Certified Solutions Architect – Associate, Cloud Architecture
Earned the AWS Certified Solutions Architect – Associate certification in May 2023.
RU
REVA University
Bachelor of Science, Cloud Computing and Big Data
2018 - 2022
Grade: 8.2/10
Pursued a B.Sc. in Cloud Computing and Big Data, achieving a CGPA of 8.2 out of 10.
Tech stack
Software and tools used professionally
Availability
Looking for a job
Location
IndiaAuthorized to work in
Website
zaavero.comPortfolio
github.com/pankaj779Salary expectations
60k-100k USD
Job categories
Interested in hiring Pankaj?
You can contact Pankaj and 90k+ other talented remote workers on Himalayas.
Message PankajGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
