This wiki page captures our AB experiment’s hypothesis, goals, supporting data/findings, test screenshot previews, and results once available.

Experiment Name: 
New.22.015 PLP Auto-Ship Toggle Location (Yankee) About this wiki: This wiki page is designed to summarize and capture our AB experiment goals, screen shot previews, and results after a test concludes.

...

Experiment Design:

v0 Control (current experience)	v1 variant (relocate toggle to top)
Image Added	Image Added
	v1 Notes Repositioned Auto-Ship toggle to top of PLP page for increased visibility. Image Added

Hypothesis:  

• By moving the Auto-Ship toggle next to the sort drop down, we will increase toggle interaction and increase purchases with subscriptions.

...

Findings:

...

Goals:

• ↑ Toggle Interaction

• ↑ Purchases

• ↑ Add to Cart Clicks

Target:  

• Yankee DTC website ( YankeeCandle.com )

• PLP Flow

• All Users       

Results:

• ( pending )

Recommendation:

• ( pending )

By The Numbers: ABTasty Data & Insights

• ( pending )

AB Experiment Previews:
Screen Shots, Video Capture, & Preview links

Screenshot Preview: 

pending

Video Capture Preview:

pending

Note: This screen capture video is helpful in providing a quick preview to understand the nature and purpose of the test, but may not be as up-to-date as the below preview links.

...

AB Tasty Test Preview Link(s):  

• v1 link pending

// Sept15 content recieved from CXPerts (adding to above in progress…)

Image Removed

...

Image Removed

...

...

Image RemovedImage Removed

Notes:

...

Notes:

• Findings & Supporting Data: FullStory data identified to support hypothesis.

...

Results, RECs, & Next Steps:

Results:

• Test Verdict: after 13 daysruntime, the test proved inconclusive.

  • Engagement: Auto-ship toggle clicks in V1 - Toggle Top were down 21% with stat sig. However, interestingly auto-ship radio clicks on PDP were up 15% with 91% stat sig. Potential explanation for this is that since the toggle is not in the sidebar filter, users who sought auto-ship and clicked the toggle had a higher intent to transact with auto-ship whereas users may hit the toggle in the sidebar filter regardless of intent.
    

  • Conversions: Transaction rate is down for V1 with control winning nearly at stat sig, but there is indication that AOV could increase under V1 with a 0.1 increase in average quantity (however, not at stat sig).

...

Recommendation:

• End test and move on to more fruitful experimentation opportunities.

...

Results: By The Numbers: data from ABTasty

...

...

Appendix / Notes

• ABT Jira ticket: ABT-115
  

  Jira Legacy
  server System JIRA serverId 8dc78667-a808-3fa8-89c9-9cd03218340f key ABT-115

  
  

CXPerts slides

...