We’ve made major improvements to A/B testing reporting in Crazy Egg, making it easier for you to compare results for different conversion goals and see how your test performance changes over time.
First: Improved A/B testing dashboard Now display the page variations that performed best for each test based on your primary conversion goal and the statistical significance of the results.
At a glance, you can see how your test has performed so far and how confident you are that the results are not just the result of chance or statistical noise.
Tests on the dashboard can now also be sorted by date created, name, or number of visitors, making it easy to find the test results you’re looking for.
Second: We have completely Redesigned A/B test results page For each test, you can easily visualize how the test performed during any given date range.
These improvements include:
- Track multiple conversion goals — View the results of different conversions by selecting the target menu in the upper left corner.
- Date range filter — Filter all test results by start and end date.
- time series diagram — Visualize how your test metrics perform against one or more conversion goals on a daily basis.
- Result table — View metrics and edit settings for page variations, all in a table. You can sort the list of page variations by clicking on any column heading.
- take notes —Store notes in the same view to help keep track of your work so far. Record test comments by clicking the “Comments” button to the left of the date filter. Edit the variant description by clicking the test variant’s gear icon and then clicking “Edit Description.”
Early access users are already using this improved reporting to take some of the following actions on their A/B testing programs:
- Decided to fully implement the new test variant designbased on whether the test achieves statistically significant results.
- See if page variations improve performance over timecompared to previous tests. This is useful if you have made adjustments to your test settings before and want to make adjustments without adding entirely new variations, or if you see a lot of seasonality in user behavior.
- See if page variations perform better on different conversion goalscompared to your original target.
These redesigned reports are now available for all A/B tests, whether new or existing. Happy analyzing!
