About this wiki: This wiki page is designed to summarize and capture our AB experiment goals, screen shot previews, and results after a test concludes.

Yankee's Email Capture Pop Up timing test ⭐️ Winner!

• Our MarTech AB Partners recently shared some great insights that suggest it can be worth the wait regarding how & when we launch the email capture modal.   

• The experiment proved higher CVR when waiting until the 2nd page visit before triggering the popup and asking for a user’s email. Nice work MarTech team! (Wiki updates coming soon. Also feel free to ping your fav MarTech friend for details).   

Page in draft mode.

Details below coming soon. Thanks! @Alex Alesio (Deactivated)
cc @Dan Graham / @Soloman Hussain (Unlicensed)

Experiment Design & Details:

AB MarTech Collaboration | Email PopUp Show on 1st vs 2nd page view

• About Test:

• The experiment tested showing the Email capture PopUp modal on the 1st vs 2nd page view.

• This will help us understand how the email capture modal is impacting CVR & Sign-ups as we vary the display logic.

• This test went live 10/4 ran for ~3 weeks.

Hypothesis:  

Goals:

• ↑ Continue to Checkout CTA

• ↑ Transaction

Target:  

• Yankee DTC website ( YankeeCandle.com )

• All Users       

Results:

Added 2022-Nov-04

Results:

Recommendations & Next Steps:

Results, by The Numbers:

AB Experiment Previews:
Screen Shots, Video Capture, & Preview links

Screenshot Preview: 

Video Capture Preview:

• Note: This screen capture video is helpful in providing a quick preview to understand the nature and purpose of the test, but may not be as up-to-date as the below preview links.
  
  

Related info / links:

• UX’s ABT Jira:
  Email PopUp Show on 1st vs 2nd page view (Yankee) MarTech (ABT-71)
  https://newellbrands.atlassian.net/browse/ABT-71
  
  

• MarTech Jira ticket(s): ___tbd_____

Subject: Re: Yankee Candle Popup AB 1st page v 2nd page 

From: Morrison, John <John.Morrison@newellco.com>
Sent: Thursday, November 3, 2022 08:23
To: Graham, Daniel <Daniel.Graham@newellco.com>; Gibson, Jordan <Jordan.Gibson@newellco.com>; Marunninal, Deepthy <Deepthy.Marunninal@newellco.com>; Harris, Allison <Allison.Harris@newellco.com>; Alesio, Alexander <Alexander.Alesio@Newellco.com>; Hussain, Soloman <Soloman.Hussain@newellco.com>; Sallee, Hanna <Hanna.Sallee@newellco.com>

More raw sign ups on but not relative to sessions, right? I might be missing something. 

Sign-ups per Session:

• 1st Page: 13%

• 2nd page: 15%

From: Graham, Daniel <Daniel.Graham@newellco.com>
Date: Wednesday, November 2, 2022 at 5:29 PM

2^nd page is the winner based on CVR, but 1^st page wins based on signups. 
@Marunninal, Deepthy the 1^st page seems to be about 33% higher in signups.  What would your signup estimate be for 2023?