Sr. Manager, Test and Learn COE

THE ROLE: 

 

This role entails the strategic management and implementation of innovative testing frameworks and methodologies to improve the company's digital projects and marketing efforts. The position demands a proactive leader with robust optimization and analytical proficiencies, extensive knowledge of digital products and initiatives, and the capacity to collaborate with interdisciplinary teams in the corporate and regions. The role also requires competence in both digital and in-person collaboration, seamlessly integrating with teams across various locations to ensure the effective exchange of ideas and the successful implementation of testing strategies. The ideal candidate will possess a demonstrable history of formulating, coordinating, and instilling the subject area vital to establish a successful Test and Learn Center of Excellence, driving commercial achievements through informed decision-making and meticulous risk evaluation. The candidate should have hands-on experience with A/B testing, multivariate testing, and other pertinent techniques for optimizing digital products and marketing campaigns. In addition, broad knowledge and understanding of the underlying marketing technologies used is a must.

Reporting directly to the Senior Director of Digital Data & Analytics, this role is charged with the regular communication of program progress and strategic advice.

 

HOW YOU WOULD CONTRIBUTE: 

Experimentation and Execution: 
•    Drive A/B testing, multivariate testing, and other optimization efforts as part of measurement road map. Iterate and recommend strategies based on test results. Nurture a culture of data-driven decision-making.
•    Design and implement robust testing frameworks to evaluate the efficiency of various digital initiatives and strategies.
•    Analyze test results to derive actionable insights and make data-driven recommendations for optimizing digital campaigns and platforms.
Optimization and Scalability: 
•    Find opportunities for optimization and scalability of successful digital initiatives, ensuring they deliver sustained commercial value.
•    Stay abreast of industry trends in digital testing and analytics, incorporating ground breaking methods and technologies into the COE’s practices. 
•    Lead a team of test designers and developers. Present findings and recommendations to senior and product leadership.
Cross-Functional Collaboration: 
•    Work closely with product management, and business team members to understand their goals and challenges, ensuring tests are aligned with broader digital objectives.

 

WHAT’S SPECIAL ABOUT THE TEAM: 

 

You will be joining a multi-faceted and dynamic team that is charged with leading the development of measurement, analytics and insights for Herbalife’s digital transformation. Our team is based in the US, Mexico and India but works cross-functionally with Global teams. 

SKILLS AND BACKGROUND REQUIRED TO BE SUCCESSFUL: 

•    Testing/Analytics Software Expertise: In-depth knowledge of Adobe Analytics and Adobe Target preferred or industry equivalent, including experience with A/B testing, multivariate testing, optimization and personalization strategies. Proficiency in setting up and leading experiments to optimize user experiences. 
•    Data Analysis and Interpretation: Strong analytical skills to interpret test results, identify trends, and make data-driven decisions. Familiarity with statistical analysis tools and techniques is crucial.
•    Technical Proficiency: Experience with web technologies such as HTML, CSS, JavaScript, and APIs. Understanding of how to integrate Adobe Target with other marketing and analytics tools. Ability to efficiently communicate tagging requirements and collaborate with digital analytics implementation teams to ensure accurate data collection and tracking.
•    Project Management: Ability to handle multiple testing projects simultaneously, ensuring timely delivery and alignment with business objectives. Proficiency in project management tools and methodologies.
•    Customer Experience Focus: A deep understanding of customer behavior and user experience principles to craft effective tests that improve the overall digital experience.
•    Communication and Collaboration: Excellent communication skills to work effectively with cross-functional teams, including marketing, product management, and IT. Proficient in both written and verbal communications, with the capability to build clear and impactful memos, PowerPoint presentations, live demos, leadership readouts, and any other written or verbal results needed.
•    Agile Experience: Proven experience working in Agile environments, including participation in Agile ceremonies (e.g., sprint planning, daily stand-ups, retrospectives). Familiarity with Azure Dev Ops (ADO) and its tools to adapt testing strategies to Agile workflows and ensure continuous delivery of high-quality software.
•    Statistical Testing Methodologies: Proficiency in various statistical testing methodologies, such as t-tests, ANOVA, and regression analysis. Ability to apply these methods to evaluate the significance of test results and make informed decisions based on data.

 

SUPERVISORY RESPONSIBILITIES: 

•    Leads team of test engineers and test designers (Analysts, Managers)

 

Education: 

•    A bachelor’s degree in Statistics, Business, Data Science, or a technical field is required.
•    A master’s degree in a related field or an MBA preferred.
•    Certifications in optimization, digital marketing, data analysis, data science or a related field desired.

 

#LI-AR1
 
 
 

Herbalife offers a variety of benefits to eligible employees in the U.S. (limited to the 50 States and the District of Columbia), which includes Group Health Programs, other Voluntary Benefit Programs, and Paid Time Off. Group Health Programs include Medical, Dental, Vision, Health Savings Account (HSA), Flexible Spending Accounts (FSA), Basic Life/AD&D; Short-Term and Long-Term Disability, and an Employee Assistance Program (EAP). Other Voluntary Benefit Programs include a 401(k) plan, Wellness Incentive Program, Employee Stock Purchase Plan (ESPP), Supplemental Life/Critical Illness/Hospitalization/Accident Insurance, and Pet Insurance. Paid time off includes Company-observed U.S. Holidays, Floating Holidays, Vacation, Sick Time, a Volunteer Program, Paid Maternity and Paternity Leave, Bereavement Leave, Personal Leave and time off for voting.