To help ensure that your itinerary conversion value rules (iCVRs) are optimized for success, follow the guidelines below when setting up your campaign rules.
Set up a beta testing timeline
The ideal testing timeline is a total of 5 weeks:
- 2 weeks learning time (no target shifts): Provides time to become familiar with the new features or changes.
- 2 weeks evaluation time: Allows time to analyze data, make adjustments, and ensure the beta is performing as expected.
- 1 week conversion capture time: Provides time to gather final data and measure the overall impact of the beta.
Simplify your experiment
- Focus on iCVRs: Choose a simple structure of iCVRs to analyze during the beta.
- Avoid overlapping iCVRs: This can make it difficult to pinpoint the impact of specific changes.
- Limit optimization: Keep optimization to a minimum during the initial beta phase to ensure you're accurately testing the core features.
Avoid mixing beta trials
If you plan to test iCVRs, avoid running other beta tests simultaneously. This could lead to conflicting signals and make it challenging to analyze the results effectively.
