Kentico CMS 6.0 Developer's Guide

Analyzing MVT test results

Analyzing MVT test results

Previous topic Next topic Mail us feedback on this topic!  

Analyzing MVT test results

Previous topic Next topic JavaScript is required for the print function Mail us feedback on this topic!  

The data gathered during the course of MVT testing may be viewed in reports that display various types of conversion metrics. To access the main interface containing these reports, go to CMS Desk -> On-line marketing -> Web analytics and expand the Optimization -> MVT tests category.

 

devguide_clip1760

 

When viewing a report, the From and To fields on the right can be used to enter a time period. Only conversion hits that were logged for the selected MVT test during the specified interval will be included in the data.

 

The following options allow you to choose which unit of time should be used in the report:

 

WebAnalyticsHour Hour

WebAnalyticsDay Day

WebAnalyticsWeek Week

WebAnalyticsMonth Month

WebAnalyticsYear Year

 

This selection determines the length of time which is represented by individual units in the report's graphs and the precision that can be specified in the From and To fields.

 

The Conversions drop‑down list may be used to select which conversion's statistics should be displayed. Please note that the system logs all conversion hits generated by visitors who have passed through a page where an MVT test is running. If there are many conversions defined on your website, only those that can somehow be affected by the differences between the tested content combinations will have relevant data.

 

Data in the reports is represented by two possible types of graphs. The line charts show the progress of a certain conversion statistic over time and display combined data for all of the tested combinations. The bar graphs contain details for individual units of time according to the selected report type (hours, days, months etc.). You may also view the conversion data in a table located between the graphs. Each row in the table shows the data logged for a specific combination, both for the time period currently displayed by the report and the entire duration of the test.

 

The following reports are available for MVT testing:

 

Overview

This report can be used to view the progress of the primary metrics measured for the site's MVT tests from a single location.

Conversions count

Displays the number of conversion hits logged for the selected MVT test during the specified time interval.

 

In the bar graph, the number of conversion hits is divided into categories that represent individual content combinations. This allows you to compare the tested combinations and determine which one generated the most conversions (in absolute terms).

Conversions value

Displays the sum of the conversion values logged for the selected MVT test during the specified time interval.

 

In the bar graph, the conversion values are divided into categories that represent individual content combinations, which allows you to determine which one generated the highest total conversion value. This way you can easily evaluate the results of the MVT test when using weighted conversions that have a different level of importance.

Conversions rate

Used to indicate how many visitors who access the tested page perform a conversion. The conversion rate is calculated as the amount of logged conversion hits divided by the total number of visitors on the given page.

 

If you select the (all) option from the Conversions drop‑down list, then the rate will be measured for all possible conversions, i.e. as the percentage of visitors who generated at least one conversion hit of any type.

 

The conversion rate in the bar graph is displayed for individual content combinations. This allows you to compare the tested combinations and determine which one encouraged the highest share of its visitors to perform a conversion.

Conversions by combinations

Displays details about the number of conversion hits logged for individual content combinations defined on the page associated with the selected MVT test.

 

You can select the combination that you wish to evaluate from the Combinations drop‑down list. If the MVT test is used for multiple culture versions of the page, you can also specify the culture.

 

The hits logged for the chosen combination are divided into categories that match individual conversions. This allows you to easily measure which conversions are performed most commonly by visitors assigned to the selected content combination.

 

 

 

Reports for individual MVT tests

 

These reports can also be viewed when working with the tested page in CMS Desk -> Content -> Edit by editing the given MVT test in Analytics -> MVT tests and switching to its Reports tab.

 

The same options are available as described for the web analytics interface, but statistics are only displayed for the currently edited MVT test.

 

The following actions may also be performed for the reports:

 

Save Save - saves the report in its current state (according to the selected time interval). To view saved reports at a later time, go to CMS Desk -> Tools -> Reporting, select the matching report under the M/V testing category and switch to the Saved reports tab. This action is only available for users who have the Save reports permission for the Web analytics module.

Print Print - allows the report to be printed. The available options depend on the used browser.

DeleteData Delete data - can be used to clear all conversion hits logged during the specified time period for the selected MVT test. Please note that this permanently removes the data from the database. This action is only available for users who have the Manage data permission for the Web analytics module.

 

The data displayed in the reports can be exported into external files using various formats. This can be done by right‑clicking on a specific graph, which will open a context menu offering the following options:

 

ExcelExport Export to Excel - exports the data displayed by the given object to an XLSX spreadsheet.

csvexport Export to CSV - exports data to a CSV file.

XMLExport Export to XML - exports data to an XML file.

 

After you select an action from the menu, your browser's standard file download dialog will pop up, letting you open or save the file with the exported data just like when downloading any other type of file. For more details on the data export feature, please refer to the Modules -> UI data export chapter.