Haikal Hilmi
@haikalhilmi
I’m a Data Engineer and Web Scraping Specialist building reliable ETL, extraction, and monitoring pipelines for large-scale web data.
What I'm looking for
I’m a Data Engineer and Web Scraping Specialist focused on building reliable extraction, ETL, and monitoring systems for large-scale public web and social-media data. In my current contract role, I built and operated ingestion pipelines used in analytics, sentiment analysis, and named-entity recognition—covering approximately 2,900 news portals and processing 226,000+ articles per week, including JavaScript-heavy sources.
I bring a strong hands-on workflow from scraping to dependable delivery: Playwright-based collection for dynamic pages, pagination and authenticated sessions, resilient validation and deduplication, queue-based processing with RabbitMQ/Docker workers, and failure alerting. I also implemented Grafana and Prometheus monitoring to surface silent failures when collectors stopped producing data without errors, improving reliability by 25% while optimizing HPC resource allocation across an 8-server environment to reduce processing time by 40%.
Experience
Work history, roles, and key accomplishments
• Led a team to design and implement scalable social media data crawling pipelines, managing high-volume data collection across Twitter, Instagram, and YouTube, processing over 150,000 tweets, 100,000 posts, 2,000,000 comments, and 10,000+ videos daily, while adhering to Agile methodologies for iterative development and team collaboration.
• Spearheaded the integration of advanced automation tools
Data Engineer - Contract
PT Semesta Data Digital
Jan 2024 - Present (2 years 7 months)
Built and operated large-scale ingestion pipelines for public news and social-media data used for analytics, sentiment analysis, and named-entity recognition. Developed queue-based collection workflows with validation, deduplication, Elasticsearch/PostgreSQL delivery, and Grafana/Prometheus monitoring to improve reliability.
Remote Data Engineer & Web Scraping
Independent / Upwork
Jan 2024 - Present (2 years 7 months)
Delivered production-ready Python and Playwright scraping solutions for public and dynamic websites with repeatable structured exports. Built APIs, automated workflows, and client-facing analytics interfaces, including delivery of large extraction engagements.
Full Stack Software Engineer
Eric UGM
Jul 2025 - Jan 2026 (6 months)
Engineered automated data and document workflows for event platforms, including QR validation, registration processing, and document generation. Deployed scalable event infrastructure with zero downtime and low validation latency.
Backend Engineer Intern
ByteDance Ltd.
Feb 2025 - Jun 2025 (4 months)
Developed and optimized a Go microservice to process high-volume internal enterprise workflows. Integrated internal services and contributed to an internal development kit to improve observability and operational efficiency.
• Built and optimized core platforms and enterprise systems using Go and Cloud technologies, handling 100,000+ requests/sec.
• Contributed to IT Consumer & Commercial solutions by integrating Tokopedia and TikTok-Shop ecosystems, ensuring high reliability for retail partners.
• Implemented automated monitoring to support Operational Excellence, reducing log spam by 60%.
Served as Engineering Program Manager for Gadjah Mada Aerospace Team in a seasonal role.
• Collaborated with cross-functional teams, including engineering, marketing, and design, to enhance product development strategies for Digital Connectivity Services.
• Conducted penetration testing on critical web platforms such as the SDWAN Portal and NeuCentrix, identifying vulnerabilities and recommending actionable solutions to improve security.
• Contributed to the development and refinement
Datacomm Product Development Intern
PT Telkom Indonesia
Jan 2024 - Mar 2024 (2 months)
Supported product analysis and operational reporting for datacom and SD-WAN initiatives. Conducted penetration testing and vulnerability assessments on web platforms and communicated actionable findings.
• Developed dynamic and interactive frontend analytics charts using NextJS 14, Tanstack, and TailwindCSS, ensuring responsive and visually engaging user interfaces through continuous iterations and user feedback loops following Agile principles.
• Integrated features and functionalities from multiple projects through seamless API integration, enabling cohesive and efficient workflows while conduct
• Led and supervised a frontend development team to design and build project dashboards and reusable components using React TypeScript, NextJS 13, Tanstack, and TailwindCSS, ensuring responsive and high-performance applications.
• Directed the development of interactive data visualizations with Chart.JS and implemented real-time API communication using WebSocket, providing seamless data synchroniz
Technical Lead - Narantaka
Gadjah Mada Aerospace Team
Jan 2023 - Nov 2023 (10 months)
Led the team’s participation in an international satellite development competition in Blacksburg, Virginia (2023), achieving 3rd place in Asia among 40+ global teams. Managed a $20,000+ budget, coordinated a multidisciplinary team of 17 experts, and oversaw development of a satellite prototype successfully tested before the competition.
Technical Lead & Project Manager – Narantaka
Jan 2023 - Nov 2023 (10 months)
• Led the team’s participation in an international satellite development competition in Blacksburg, Virginia, USA (2023), achieving 3rd place in Asia among 40+ global teams, showcasing innovative aerospace solutions.
• Facilitated brainstorming sessions over a 5-month development period to design and build a cutting-edge satellite model, integrating the latest advancements in research and technolo
HumPubIT Team Leader
PPSMB UGM
Feb 2023 - Sep 2023 (7 months)
Led a team of 7 specialists in UI/UX design, frontend development, and AR development to build an interactive website for the new student orientation program. Applied SCRUM to manage the lifecycle and delivered a responsive NextJS 12 + TailwindCSS site with Strapi, Tawk.to support, and a task management application used by 300+ committee members.
• Led a team of 7 specialists in UI/UX design, Frontend development, and AR development, coordinating efforts to create an innovative and interactive website for the new student orientation program. Acted as a liaison between IT and other divisions, including Event, Public Relations, Design, and Publications, ensuring smooth communication and alignment of goals across teams.
• Applied SCRUM method
• Led a team of 6 frontend developers as subcoordinator in designing and implementing key features while mentoring new team members to ensure skill development and alignment with project goals.
• Developed a responsive and interactive website within 4 months using NextJS 12 and TailwindCSS, delivering a seamless user experience across multiple devices and platforms.
• Implemented authentication mi
• Guided the team in understanding and solving competitive programming problems, improving their performance in competitions through structured mentoring and practice.
• Designed and developed competitive programming problems for events, ensuring diverse challenges that tested algorithmic thinking and problem-solving skills.
• Set up and maintained the competition server using DOMJudge, enabling e
• Contributed to company projects by developing dynamic web applications using React TypeScript, focusing on modular and maintainable code architecture.
• Utilized the Ant Design library to create consistent and user-friendly UI components, aligning with best practices in design and usability.
• Collaborated closely with senior developers and cross-functional teams, gaining foundational experience
• Designed and developed a Ground Control System Interface for the Model Satellite Competition Teknofest 2022 using ReactJS, enabling real-time monitoring and control of satellite operations while displaying over 7 distinct types of telemetry data, including altitude, velocity, temperature, and gyroscope.
• Built advanced frontend features, such as real-time charts, interactive maps, and 3D modell
• Helping team to understanding about a problem used for competition.
• Develop a competitive programming problem for the competition.
Develop a Website with the team for study orientation at Engineering UGM using React Js and TailwindCSS.
• Helping develop UI UX Design for SGDs Google Solution Challenge 2022
• Build mobile apps about mapping and data using Flutter and Google Maps API.
IT Team Lead
PIONIR UGM
Jan 2023 - Present (3 years 7 months)
Led a team of developers and delivered a platform that reached 1.3 million views in one month.
Hack-A-Day Runner-Up (PwC)
PwC Hong Kong
Led an AI-powered asset-management solution with LLM integration to reach the 1st runner-up position.
Engineering Project Manager
Gadjah Mada Aerospace Team
Coordinated a team of engineers and managed budgets exceeding $30,000.
Education
Degrees, certifications, and relevant coursework
Universitas Gadjah Mada
Bachelor of Engineering - BE, Teknologi Informasi
2021 - 2025
Universitas Gadjah Mada
Bachelor of Engineering, Teknologi Informasi
2021 - 2025
Bachelor of Engineering in Teknologi Informasi at Universitas Gadjah Mada from 2021 to 2025.
Universitas Gadjah Mada
Bachelor of Information Engineering, Information Engineering
Grade: GPA: 3.52/4.0 (159 credits)
Activities and societies: Assistant Lecturer (NLP/ML course materials) and Junior Project Lab Assistant Coordinator; coordinated teaching assistant schedules and supported 80+ students with programming and database management guidance.
Earned a Bachelor of Information Engineering (GPA 3.52/4.0, 159 credits). Served as an assistant lecturer and a junior project lab assistant coordinator supporting NLP/ML course materials and student programming/database guidance.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Haikal?
You can contact Haikal and 90k+ other talented remote workers on Himalayas.
Message HaikalGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
