Website Testing & Optimization Analyst III

Work Schedule

Environmental Conditions

Job Description

In this Analyst III role, you will be a key contributor to our Website A/B Testing & Optimization Program—working hand-in-hand with the Program Manager to run tests, craft actionable insights, and drive continuous improvement across our flagship websites. Make a real impact on our customer's website experiences by putting your strong analytics, testing, and teamwork skills to work!

Key Responsibilities

• Support the complete process of split testing and optimization.
• Work closely with the T&O Program Manager and various teams (product, UX, web analytics, marketing) to identify testing priorities, establish key performance indicators, and implement vitals tracking.
• Extract and transform analytics data from online platforms (e.g., Adobe Analytics, Google Analytics/GA4, Amplitude, etc.), ensuring data accuracy, appropriate segmentation, and accurate attribution.
• Perform statistical analysis of experiments: calculate lift, confidence, segmentation, and interaction effects.
• Develop actionable insights and recommendations from test outcomes in clear, business-relevant terms; track post-test impact; and embed lessons into future experiments and optimization roadmap.
• Stay current on digital testing & optimization industry standards and propose improvements to our framework to help elevate the organization’s testing maturity.

Qualifications (Typical)

Minimum Requirements

• Bachelor’s degree in Statistics, Mathematics, Economics, Business Analytics, Digital Marketing Analytics or related field
• 4+ years of experience in a digital analytics or experimentation role (or similar)
• Strength in quantitative analysis, understanding of statistical concepts (e.g., hypothesis testing, confidence intervals, sample size)
• Strong skills in Excel and experience with analytics tools / data visualization (e.g., Power BI) and data query (SQL) or willingness to learn
• Proficiency in using web analytics tools like Google Analytics/GA4, Adobe Analytics, and platforms for conducting split tests such as Optimizely, VWO, and Google Optimize
• Ability to clearly communicate analytic results and recommendations to non-technical audiences and influence cross-functional partners
• Strong attention to detail, interpersonal skills, ability to run multiple test streams and priorities

Preferred Qualifications

• Familiarity with causal inference and incrementality testing beyond A/B (e.g. holdout).
• Familiarity with scripting (R, Python) or automated data pipelines.
• Understanding of digital conversion optimization.
• Experience in eCommerce or B2B website environments.
• Knowledge of data privacy/consent frameworks (GDPR, CCPA) and implications on digital analytics.