Is this really the version you are looking for? Kentico Xperience 8 Documentation is no longer updated. Use the switcher in the header to choose your product version.
Kentico EMS required
Features described on this page require the Kentico EMS license.
The sections below describe the steps you need to take to set up a multivariate test on your website.
To start optimizing a page on your website via multivariate testing, create and configure an MVT test object:
Open the Pages application.
Click on a document.
Switch to the Analytics -> MVT tests tab.
Click New MVT test and fill in the following properties:
Property | Description |
|---|---|
Display name |
The name of the MVT test displayed in the administration interface. |
Code name | Sets a code name that serves as an identifier for the test. It is also used in the name of the browser cookie used to store which of the test's variant combinations was assigned to a visitor. |
Description | Can be used to enter a text description for the test in order to give information about its purpose, goals etc. |
Culture | Used to select which culture version(s) of the document should be included in the test. |
Enabled | This property may be used to manually start or stop the test. |
Target number of conversions | Sets the number of conversion hits that must be logged to complete the test. Once this number is reached, the MVT test automatically stops working and switches to the Finished status. If the total option is selected, then the number will be compared with the total amount of conversion hits logged for all of the test's combinations. If any combination is chosen, then the test will be concluded when the specified number is reached by one combination (the one with the most conversion hits). Leaving this property empty or setting it to 0 means that there will be no conversion hit limit for the test. |
Start/End | Sets the time interval during which the test should occur. You can use the Calendar button () to select the exact date and time. |
Click Save.
The system creates the MVT test and assigns it to the document.
Managing all MVT tests from a single location
You can use the MVT tests application to manage all tests assigned to different pages from a single location.
Here you can manage all MVT tests defined on the current website. The only difference is that you need to assign tests to specific pages through the Page property.
Once a page contains an MVT test, you can start creating the content options that you wish to evaluate. This is done by defining variants for the elements that make up the content of the page. You can use the following objects as variables:
Multivariate testing and Content personalization
You cannot create multivariate testing variants of web parts, zones or widgets that already have variants defined for Content personalization.
To add an MVT variant to a web part or zone:
Open the page on the Design tab.
Right-click the header of the given object (or click the icon), hover over the MVT variants option and select Add <object type> variant.
Fill in the following properties for the variant:
Click Save.
Click OK once you have configured the variant's properties to generate the content that you wish to test.
Each object for which testing variants are created has a slider in its header.
This slider can be used to switch between individual variants as needed (including the original). The content specified by the current selection on the page's variant sliders is displayed in the Pages application on the Design and Page tabs, and in Preview mode. You can also switch between different versions of the page's content by using the combination panel. If you wish to view the content of variants while cycling through the slider on the Design tab, make sure that you have the Web part content checkbox selected in the page header.
The buttons on the right of the slider allow you to:
At any time, you can Configure () the properties of the variant currently chosen on the slider.
When configuring variants, you can access the properties that affect the content on the General tab. The settings related to the MVT testing functionality of the specific variant are available on the additional Variant properties tab.
In the case of editor widgets, you can handle multivariate testing variants using a similar approach. The only difference is that you edit the widget variants on the Page tab of the Pages application. The slider and actions for variant management are located on the pop‑up menu of individual widgets.
You can access a list of all multivariate testing variants defined on a given document (page), by selecting it from the content tree of the Pages application and going to Analytics -> MVT variants. The variants of all three object types are included here, and they can be removed or edited as necessary.
The following rules apply to all MVT variants:
Managing widget variants under workflow
MVT variants of editor widgets are NOT included within the scope of workflow. Changes made to widget variants can have an effect on the live website, and are not recorded in the document version history.
To strictly enforce the workflow publishing process, you need to prevent editors from creating widget variants — define editor roles without the Manage permission for the MVT testing module.
Individual testing scenarios are represented by combinations of the MVT variants created on the page. By default, all possible combinations of the page's content are included in multivariate tests, but you may perform additional configuration to fine‑tune your test as required.
Combinations can be managed for documents that have an MVT test defined via a panel located at the top of the page editing interface in the Pages application. This panel is available on both the Page and Design tabs, and in the Preview mode.
You can choose any of the available combinations through the Combination selector. Doing so causes the page to display the content defined by the variants that make up the given combination. The selection made through the combination panel is linked with the positions set on the MVT sliders of variable objects on the page. If you switch to a different variant through an object's slider, the current combination also changes accordingly and vice versa.
Pages where there are several variants for multiple objects have a large amount of possible combinations. For this reason, it is recommended to carefully choose which combinations should be included in the page's MVT test. You can include or exclude a combination by toggling the Enabled checkbox located on the panel next to the selector. There is a close relationship between the status of a combination and its variants. If you disable a variant through its properties, all combinations that include the variant also become disabled. If a disabled combination is enabled at a later point, the system automatically enables all of its variants.
A good way to evaluate potential combinations is to check them in the Preview mode of the Pages application, and disable those where the variants clash visually, have conflicting logic or are otherwise incompatible. We recommend leaving the Default page combination enabled, so you can compare any improvements with the baseline statistics of the original page.
Another best practice is to set a descriptive custom name for each active combination, so that you can easily differentiate between combinations in the editing interface and identify them in the test's result reports. To do this, simply select a combination through the panel, enter the appropriate text into the Custom name field and click the Change button. The default names assigned to new combinations are composed of a number indicating their order, followed by a list of the display names of all variants that are included in the given combination.
Once the page's variants and combinations are all configured as needed, you can enable your MVT test on the Analytics -> MVT tests tab of the document. Making further modifications on the page while an MVT test is running is not recommended, since this may affect the accuracy and relevance of the measured statistics.
The Set as result action should only be used after the conclusion of the test, once you have analyzed the logged conversion data and identified the combination that provides the best results. The action allows you to easily set the winning combination as the permanent content of the page. Simply select the given combination via the combination panel, then click the button and confirm the action. This replaces the original web parts, zones and widgets with the variants included in the currently selected combination and removes all other MVT variants from the page.
You need to use conversions to track the behavior and actions of the website's visitors in order to get MVT testing results. Conversions work on a site‑wide level and are not assigned to MVT tests in any way. You only need to define conversion objects and link them with the actions that you wish to log for the test.
There are many ways to specify that an action should be logged as a conversion. For example, you can have the system log a conversion hit whenever users view a specific page:
When an action designated as a conversion is performed anywhere on the website, the system checks if the given user has passed through a page with a running MVT test (according to the presence of a cookie). If this is the case, the conversion hit is logged for the content combination that was assigned to the user.
Once you enable the MVT test and it starts running on the live site, you can monitor the conversion statistics for individual combinations using predefined reports.