The Sun, The Times and The Sunday Times, owned by News UK, reach millions of readers every week. To help engage their growing readership, News UK requires a cutting-edge solution that matches articles to readers - all in real-time and at scale. Alongside the News UK Data Science team, Datatonic have been turning this need into a reality by developing and productionising state-of-the-art Recommender Systems on Google Cloud Platform. These systems incorporate the latest advances in AI, including content recommenders, natural language processing and image processing. As a key requirement throughout the project, Explainable AI features have also been included in the design to understand why recommendations are served to each reader at any given time.
Key objectives to develop state-of-the-art recommender systems to contribute to the titles' digital viewership, user engagement and reader satisfaction
To develop cutting-edge features, such as automated real-time systems for model retraining, and implement custom metrics to drive meaningful engagement
To improve transparency with explainable AI methods to help to understand why each article recommendation is being served
News Corp declared in their 2019 Annual Report that their mission was to “deliver content in a more engaging, timely and personalised manner”. As a key step in this direction, News UK requires greater control in personalising article recommendations for The Sun, The Times and The Sunday Times. These recommendations will be used in key parts of the user experience – alongside editorial curation – to help readers discover relevant stories.
Their key requirements are:
“We have experimented with personalisation in the past, however, we were always left frustrated with the opaque and inflexible nature of the solutions. We need to cater for a broad range of user experiences across our different titles, where different levels and types of personalisation are appropriate.” – Dan Gilbert, Director of Data, NewsUK.
“At NewsUK, we wanted to develop a set of capabilities that we could control, experiment with, and which provide the transparency we need to explain and monitor how the recommender system is working and why recommendations are being made.”
Datatonic has helped with the first step in transforming this need into a reality by designing, developing and productionising content recommender systems with AI explainability on GCP.
Example of Article Recommenders – The Sun and The Times
The team kickstarted the engagement by conducting exploratory data analysis on the user, context and content trends for The Sun and The Times and The Sunday Times. As a result, a suite of features were engineered to use in the Machine Learning models. Advanced feature engineering was additionally tested, such as image processing with the Google Cloud Vision API and text processing with natural language processing techniques.
In the design phase, the models were constructed to maximise business objectives such as readership, user engagement and satisfaction catering to advertisement and subscription-based revenue models for The Sun and The Times and The Sunday Times respectively. For this purpose, a list of the latest Machine Learning methods were surveyed and tested, such as deep learning, the attention mechanism and generalised matrix factorisation.
To speed up model evaluation, the most significant features were prioritised – for example, reader interests and reading behaviours were more relevant than demographics. For the final recommender, adjustable levers were included to prioritise factors such as popularity and diversity.
In order to automate the recommender system (including periodic re-training of the model), Datatonic used an open-source, cloud-agnostic software tool known as Terraform. User and content features were processed with an architecture comprising tools such as Dataflow, Pub/Sub, cloud functions, Compute Engine and Memorystore.
News UK is now experimenting with the recommendation capabilities Datatonic helped to develop on The Sun and will shortly be rolling out the first experiment on The Times and The Sunday Times. Once the initial positive results have been assessed, the capability will be rolled out more widely across Sun and Times products. The News UK team is also looking at how they can bring personalisation into their Wireless radio station products such as Virgin Radio, Times Radio and talkSPORT.
“Datatonic brought a wealth of expertise and experience to our team, and collaborated with our engineers and data scientists, working to their standards, so that we can continue to evolve the system they developed.”
If there’s data, we can optimise, innovate with and automate it to drive business value. Find out how we’ve supported the biggest brands across industries.
With your own data sets, convince your business of the value of migrating your data warehouse, data lake and/or streaming platform to the cloud in four weeks.
With your own data, see how Looker can modernise your BI needs
with Datatonic’s two-week Showcase.
Know exactly where and how to start your AI journey with Datatonic’s
three-week AI Innovation Jumpstart.
If you are a retail business and want to better understand your customers to provide them with personalised content and recommendations, get in touch to discuss a free trial to jumpstart your personalisation journey in four weeks.