Testing on Tes: New customer promotion code

Find out more about the current test for the new customer promotion, as part of a wider group of tests to improve the Tes Resources site for our users

Tes Author Team

Testing on Tes

Here at Tes Resources, we are always striving to make the site as effective and efficient as it can be for our users, so that they can quickly find the resources they need to teach great lessons. It's exciting to think about future changes to the site but in order to explore what is the best next step, we have to test a few variants and let the data tell us which is the most successful. We would only ever implement a permanent change if we find a new way of doing something that is significantly better than the original. 

We know that change makes most people uneasy, so we're keen to share what we are working on and let you know when we have winning variants that will be changed permanently.

What does this test focus on? 

To encourage more of ours users to convert from only downloading free resources to trying out a paid resource, and hopefully continuing to purchase paid resources, we wanted this test to make the new customer promotion more prominent.

The existing deal, which offers new buyers only 60% off a resource worth up to £10 (or equivalent in other currencies), could be consumed more widely if it is clearer to those who are eligible that it exists. The hypothesis is that if a customer has a positive experience with their first purchase, they are more likely to purhcase again. This test will focus on highlighting this deal on the resource page, with one variation displaying permanently above the price of the resource and one variation showing a pop in when a user goes to exit the page. 

What does it mean in practice? 

As well as keeping a control version, where users will not see either resource page advert, we are testing two variations. You are likely to only see one of these when you are looking at the site. We keep a very close eye on the tests as they run to make sure that nothing dramatic is happening. Currently, tests only happen on desktop. 

You can have a look at the variations here:

Variation 1 (reminder above price)

Variation 2 (pop in displayed before exiting resource page)

When will we know the results? 

This test ran from 22nd October to 7th November. During this time, the data did not provide a clear winner enough winner so the control will be left at this time. We may review testing in this space in the future.