About This doc: This page is designed to help capture and share AB Test information.

Note: This is a draft / work in progress and we welcome your feedback as we nail down our format. Let Alex Alesio (Deactivated) know if you have any questions or are looking info that is not included here.

Hello Team—   
We're Excited to inform you all that AB Tasty has been setup and installed on production, and we are ready to get things rolling for CX Optimization with the below first test. 

Experiment Name: 

new-22-001 Add-to-Cart CTA Color variation on Yankee PDP 

Hypothesis: 

• By changing the add-to-cart button color, we can increase the number of add-to-cart clicks and conversions.

Goals of Experiment:

• ↑ Add to Cart Clicks 

• ↑ Conversions

• ↑ Conversion Funnel (Bag visits, checkout visits)
  

Target:  

• Yankee DTC website ( YankeeCandle.com )

• All Users

• All PDP pages      
  

Dates & Timing: 

• (todo Alex Alesio (Deactivated) to add updated dates/timing from cxperts)
  
• 2022 xxxxxx: Report / share results
• 2022 xxxxxx: Finalize / close test
• 2022 Jul 12: launch
• 2022 Jul 11: finalized / approved

AB Experiment: Preview & Test Links:

Screenshot Preview: 

AB Tasty Preview Links: 

• v1 Green

• v2 Blue 

Video Capture Preview:

• Note: This screen capture video is helpful in providing a quick preview to understand the nature and purpose of the test, but may not be as up-to-date as the below preview links.

• Video captured 2022-July-11 11am EST
  

Review & Approval Tracker

• TBD: in conversations to determine the best way to support AB Experimentation Reviews, Feedback, & Approvals. Alex Alesio (Deactivated) is actively working through this process.
  

• Current thinking us to use a hybrid approach of;

  • Email (with URL for ab-test-info-wiki),
    where all required for approvals must reply to email with their feedback / approval for an efficient and easy to follow process for our BIZ & AB Testing partners.

  • Email text:
    Please give us your 👍 thumbs-up / approvals by xxxxx COB so we can launch our AB experiment on time and begin collecting insights.  

Thanks,
Digital Tech UX, Alex Alesio (Deactivated)

005

From: Rohan Prabhu <rohan.prabhu@cxperts.io>

Sent: Friday, July 22, 2022 14:22
To: Alesio, Alexander <Alexander.Alesio@Newellco.com>; Good, Benjamin <Benjamin.Good@newellco.com>
Subject: Test Update: new.22.005 _ PLP | Filter Order | A/B Test 

This Message originated outside of the Newell Brands organization. Please exercise caution when opening attachments or clicking on links.

Hey Alex and Ben,

We have an update with this test, recording linked at the bottom: 

Test Code: new.22.005

Test Name: PLP | Filter Order | A/ B Test

Hypothesis: 

By changing the order of the filters in the sidebar, we can help users find their preferred product more easily, increasing PDP visits, add to bag CTA clicks, and conversions.

Goals:

1. ↑ PDP Visits

2. ↑ Add to Carts

3. ↑ Conversions

Quick video preview: RecordIt.co/wy0lW5gF67 

Test Variation(s):

1. v1 PLP Filter Order 

   PREVIEW LINK

Preview Instructions:

1. Close other tabs that are the main site domain

2. Click the link above, which will take you to the test preview landing page (so not in private browser to allow cookies)

3. Click the test preview link and verify you are getting the variation

4. Verify on desktop and mobile breakpoints (collapsed desktop browser is fine)

Action Item:

Please review the above test preview and provide any comments, feedback, and/or approval.

005 rationale //merge with above

Sent: Friday, July 22, 2022 15:41

To: Alesio, Alexander <Alexander.Alesio@Newellco.com>
Cc: Ken Lilly <ken.lilly@cxperts.io>; Good, Benjamin <Benjamin.Good@newellco.com>; Steven Shyne <steven@cxperts.io>
Subject: Re: Test Update: new.22.005 _ PLP | Filter Order | A/B Test 

Hey Alex, We based the order of V1 based on a CX Insight that detailed the popularity of each filter. The order of the filters is based on popularity from top to bottom. So putting those toggles that get less interaction shouldn't be a problem as not too many people interact with them in the first place. Attached are Fullstory metrics.As for the number of changes, with this test we're trying to transform this filter rather than iterate on every small change within the filter bar, if that makes sense.We should be fine to make this amount of change.

FullStory SShot:

Thanks,
Rohan

003 xxxxxx

From: Rohan Prabhu <rohan.prabhu@cxperts.io>

Sent: Friday, July 22, 2022 14:37
To: Khan, Imran <Imran.Khan@newellco.com>; Molamusa, Natasha <Natasha.Molamusa@newellco.com>; Good, Benjamin <Benjamin.Good@newellco.com>; Alesio, Alexander <Alexander.Alesio@Newellco.com>
Cc: Ken Lilly <ken.lilly@cxperts.io>; Steven Shyne <steven@cxperts.io>
Subject: Final Test Update: new.22.003 _ Checkout | Guest CTA | A/B Test 

This Message originated outside of the Newell Brands organization. Please exercise caution when opening attachments or clicking on links.

Hey Natasha and Imran,

We have an update with this test, reminder that this test replaced the PayPal test:

Test Code: new.22.003

Test Name: Checkout | Guest CTA | A/B Test

Hypothesis: By changing the color of the primary sign-in CTA for guests in the Checkout, we will increase conversions via guest checkout.

Goals:

1. ↑ Continue as Guest CTA Clicks

2. ↑ Conversions

Targeting: Checkout, all users

Quick Test Preview: Screen capture video: https://recordit.co/ywDtAtnhjB

Test Variation(s):

1. V1 - Green - PREVIEW LINK

2. V2 - Blue - PREVIEW LINK

Preview Instructions:

1. Close other tabs that are the main site domain

2. Click the link above, which will take you to the test preview landing page (so not in private browser to allow cookies)

3. Click the test preview link and verify you are getting the variation

4. Verify on desktop and mobile breakpoints (collapsed desktop browser is fine)