• About us
  • Meet INTREN
  • Services
    • Digital Analytics
      • Trainings
      • Digital Consulting
      • Measurement Strategy
      • Testing & Optimization
      • 360 Suite
  • Case studies
  • Jobs
  • Zoo
  • Contact us
  • Hungarian
INTREN
  • About us
  • Meet INTREN
  • Services
    • Digital Analytics
      • Trainings
      • Digital Consulting
      • Measurement Strategy
      • Testing & Optimization
      • 360 Suite
  • Case studies
  • Jobs
  • Zoo
  • Contact us
  • Hungarian

Telenor Blue – Google Optimize A/B test case study

DATE
2017-11-28
CLIENT
Telenor
CATEGORY
CRO
SHARE
VISIT WEBSITE

ABOUT THE PROJECT

Telenor and INTREN

One of the main business focuses of Telenor is to increase the share of online channel among sales of devices and subscriptions. In order to reach this, they simultaneously work on developing and improving capabilities, traffic management, and conversion rate optimization.

INTREN is providing various digital services to Telenor, including Google Analytics and Google Tag Manager maintenance, management of PPC advertisements, reporting, and conversion rate optimization with various tools. This particular A/B-testing was focusing on the flow on online sales, which often start on tariff pages.

Telenor Blue – the flagship tariff

Telenor has been already using Google Analytics across their website. The current flagship product of Telenor is Blue tariff, which has its own product page, and it’s the second most used landing page, besides the main page of their website.

One of the insights gained from the page navigation reports was, that visitors preferred to buy devices along with tariffs, and therefore rarely used so-called SIM-only related CTA buttons, where no device is purchased. Also, the majority of visitors don’t select featured devices, but rather look for device related information in the main navigation, which leads to unnecessary navigation steps, or above-average exit rate on tariff pages.

“The hypothesis we’ve built from this, is that we need to make it easier to find a device to a selected tariff version, which will finally lead to more online sales transactions.”

The Test

We assumed, that if preferred options are easier to reach on the page, then number of sales could be increased, and share of users, who quit the page, could be decreased.

We have chosen Google Optimize to test our hypothesis. This tool supports changing relevant elements on the web page, without the need to alter the base code of the website, so testing can be started quickly and easily. On top of this, by integrating Google Optimize and Google Analytics, we are able to keep track of the whole sales journey, and to monitor actual sales transactions.

“During our test we were able to decide if our hypothesis had been correct. The test had run for 3 weeks, during which we were monitoring the visibility and performance of different variations. By the end of the test, we could compare the test variations, and Google Optimize could easily announce a winner.”

Original page version, with tariff only CTA

Test version, with more visible handset offering

Results

The test was running for 20 days, and reached 94% probability for the tested variant to be able to outperform the baseline, by 19%, considering the main target KPI, which was ecommerce transaction. We have also been able to verify in Analytics, using experiment and variant dimensions, that customers were more likely to progress through the sales journey step, like selecting device for the tariff, and filling the checkout form.

As formed in our hypothesis, tested variant helped customers to reach device lists and device product pages, compared to original version, where they relied on page navigation, resulting lower exit rate on the page involved in this testing. As a longterm effect, tariff and device recommendations are structured in a different way. Although both products are featured along the sales flow, device recommendations are now better differentiated from tariff selection, which earlier could have been perceived as a limitation of available bundles, and divert customers from reaching the overall device offering.

Post navigation

Come to learn!

Related projects

INTREN - Digital by Nature

INTREN is a full service, data driven, digital agency. We plan, create, operate, measure and optimize complex digital marketing ecosystems.

  • Privacy policy
  • Cookie Policy
  • Impressum
Newsletter
CONTACT

+36 1 201 5468

sales@intren.hu

1036 Budapest, Lajos street 78. 3rd. floor

Marketing Gyémánt Google Marketing Platform - Sales Partner Google Marketing Platform - Certified CEE Digital Alliance
  • Facebook
  • linkedin
  • youtube
© INTREN 2020.

We are using cookies to give you the best experience on our website.

You can find out more about which cookies we are using or switch them off in settings.

X
INTREN
Privacy Overview

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.

Strictly Necessary Cookies

Strictly Necessary Cookie should be enabled at all times so that we can save your preferences for cookie settings.

If you disable this cookie, we will not be able to save your preferences. This means that every time you visit this website you will need to enable or disable cookies again.

3rd Party Cookies

This website uses Google Analytics to collect anonymous information such as the number of visitors to the site, and the most popular pages.

Keeping this cookie enabled helps us to improve our website.

Please enable Strictly Necessary Cookies first so that we can save your preferences!

Cookie Policy

More information about our Cookie Policy