Shawn Chen

I'm a Senior Data Engineer with 10 years of experience building scalable data platforms, cloud-native pipelines, and analytics solutions across technology, ecommerce, fintech, and payments companies. Most recently, I worked at TikTok, where I led large-scale data initiatives supporting TikTok Studio and TikTok Shop analytics. I helped migrate analytics workloads to Snowflake and Databricks, built real-time and batch data pipelines, standardized data models, and delivered trusted datasets used by product, business, analytics, and data science teams.

Throughout my career at TikTok, AWS, PayPal, and Cureasoft, I've worked extensively with Python, SQL, PySpark, Spark, Snowflake, Databricks, Airflow, dbt, AWS, Kafka, and modern cloud data architectures. I've designed end-to-end ETL and ELT solutions, built streaming and batch processing systems, implemented data quality frameworks, and optimized large-scale data platforms that support millions of users and transactions.

What I enjoy most is turning complex data into reliable products that help teams make better decisions. I like working closely with engineers, product managers, analysts, and business stakeholders to understand problems and build practical solutions. I'm known for being hands-on, detail-oriented, and collaborative, and I enjoy mentoring engineers, improving engineering standards, and helping teams scale both technically and operationally.

Some of my key achievements include leading the migration and standardization of more than 25 analytics datasets and 12 dashboards at TikTok, improving analytics adoption by 30%, scaling real-time commerce pipelines that process millions of daily transactions, improving Databricks processing performance by 3x while reducing costs, and optimizing Redshift analytics workloads at AWS to achieve 11x faster query performance.

Outside of work, I'm passionate about data architecture, cloud technologies, distributed systems, and AI-driven analytics. I enjoy continuously learning new technologies, sharing knowledge with others, and solving challenging business problems through data. I'm currently looking for a long-term fully remote opportunity where I can contribute as a Senior Data Engineer, continue growing technically, and help build impactful data products at scale.