Radio – seeking the truth
An interview with BRC CEO, Clare O’Neil
Written by: Britta Reid, independent media consultant
Earlier this month, I wrote enthusiastically about my first glimpse of the new BRC RAM (Radio Audience Measurement) data, shared by the BRC (Broadcast Research Council of South Africa) and TNS with the Advertising Media Forum. Excited by this brand new approach to monitoring radio listening habits, I decided to visit Clare O’Neil, CEO of the BRC, to ask her to tell me more about what we should expect to see from the new study.
With her customary passion, O’Neil started by pointing out to me, that the objective of this new approach was nothing less than the transformation of the audience measurement system. The word “transformation” deserves some reflection, if we are to understand the implications of this new research. The Collins English Dictionary defines it as: “a change or alteration, especially a radical one.” Indeed, radical difference is what the industry must prepare itself for; all comparisons with the data of the past will be irrelevant. Of course, in our South Africa, “transformation” has greater implications: it is about the meaningful change we need to make to successfully build our country and its people.
The first step in delivering appropriately transformed data was developing a new sampling frame. The sampling frame lists and describes the units from which the sample for a survey will be drawn. As such, it is the absolute bedrock of trustworthy and reliable research Working with guidance and input from specialist demographers IHS, TNS developed a new sample frame for this survey. O’Neil proudly explained to me that, 22 years after the end of apartheid, the BRC RAM sample frame truly reflects the South African population:
SA Population | BRC RAM sample frame | |
Black | 78% | 76% |
Coloured | 9% | 12% |
Indian/Asian | 3% | 4% |
White | 10% | 8% |
100% | 100% |
Of course, whilst we want to be future facing, we do have to cast a look backwards if we are to understand the sort of change that we will find in the new data. The fact is that the previous SAARF RAMS sample looked very different and did not correspond particularly closely with the realities of our country:
SA Population | SAARF RAMS sample | |
Black | 78% | 56% |
Coloured | 9% | 17% |
Indian/Asian | 3% | 7% |
White | 10% | 21% |
100% | 100% |
There are arguments for disproportionate sampling – often most compellingly based on cost. For example, rural interviews are more expensive and arduous to undertake, so a decision might be taken to under sample in rural areas. After all, we have become accustomed to hearing that there is always the panacea of applying weightings, to pull the distorted picture back into alignment. However, when weighting efficiency is low, the error range in the data is significantly increased.
Poor weighting efficiency is familiar territory for O’Neil, and an issue which she determinedly solved. When the BRC took over the task of restoring the TAM (Television Audience Measurement) panel to health, the audit showed that weighting efficiency had fallen to an abysmal 39%. Working with Nielsen, and the BRC television research committee, O’Neil oversaw the overhauling of the panel, which now runs well ahead of the global gold standard of 70%. There were numerous other remedies applied to improve the TAM panel, but weighting was one of the significant benchmarks the international auditor, Robert Ruud examined, before stating that in his 2015 report that SA now has a “high quality well-functioning TAM panel.”
The new BRC RAM sample frame, together with national PPS (probability proportionate to size) sampling, will give the media industry a new and more realistic view of the structure of the South African population. Looking at the familiar metric of LSMs, we should expect to see a smaller proportion of the population falling into the upper end and a wider spread across the middle sectors:
These changes will be the equivalent of the media industry having the “scales removed from our eyes”. With our new sight, we should expect the world to look different. It was too soon for O’Neil to share a preview of individual station audiences as TNS is carrying out a reassuringly thorough validation processes before revealing the figures. However, to me, logic would suggest that this revised and real population structure will produce solid listenerships for stations with mid LSM audiences. Conversely, station which appeal to the higher end of the LSM spectrum should see “smaller” audiences.
O’Neil also reminded me that another transformation objective of the new BRC RAM, was to ensure that the dynamism of radio listening could be captured and analysed for the first time. The new BRC RAM diary has been designed to explicitly capture cross device and cross location listenership. Respondents are not merely reminded that it does not matter how they listened; they now have to actually fill in where and on what they are listening to the radio.
Before sharing the results of the cross device and location questions, O’Neil stressed that we were only looking at the first wave of the study comprising data from some 7500 households, collected between 7th January and 31st.
The first data, comprising the first two waves will be released on 25 August. The field work for the full study, based on a 30 000 sample will only completed in December this year. The industry will, therefore, only have the complete data set in the first quarter of 2017.
With this caveat in mind, it seems that he first results of cross device listening look eminently sensible. 75% of the seven-day audience claim to listen on a radio, whilst 40% listen on a cell-phone – testament to the wide distribution of affordable FM enable hand-sets. In fact, some 8% now listen exclusively on a cell-phone. 28% claim to listen on a vehicle radio and 9% to listen on the television. The results of the location questions also seemed understandable. The bulk of listeners (87%) still tune in at home, but over a third (35%) listen “on the go”. 12% listen at either their place of work or at university
The detailed device and location prompts in the diary should help respondents to more accurately recall and record their listening experiences. This, in turn, could lead us to see more listening than we we were accustomed to recording in the past. Indeed, O Neil pointed out that this first tranche of data had shown that people were listening for longer periods than had been recorded in the past: roughly half the radio audience are “heavy listeners”.
This heavier and longer listenership recorded is also expressed in a different daily curve from what we are accustomed to seeing. As I mentioned in my previous column the daily curve is now a “sleeping lion” shape, as Jennie Beck – Director of Media at TNS Global and Kantar Media, memorably describes it. Overall quarter hour listenership is higher, especially in the mornings and is more evenly spread across the day. Reassuringly, this shape of listenership is similar to that seen internationally.
With mobile listenership allowing people to make their personalised choices, rather than having to accommodate someone else’s listening preference, it struck me we could see listeners engaging with their chosen stations for longer periods.
O’Neil also showed me the results of overall listenership by province. This data showed uniformly healthy listenership across all nine provinces. There were, however, some interesting differences which pointed to the sensitivity of the study. A good example was the shape of the daily curve in Limpopo, which showed a pronounced evening peak – understandable in a more rural and poorer province. Limpopo was also the province with the highest proportion of listeners tuned in on their mobile devices, again a phenomenon that seems intuitively correct.
After looking at this data, O’Neil and I talked about the likely impact of the of the new study. This early data suggests to me that the new BRC RAM should occasion the reassessment of the value of the medium of radio. The deeply loyal and habitual nature of the relationship that listeners have with the medium will become clearer. The higher average quarter hour ratings for the medium underscore this. Better knowledge of the listener’s commitment to the medium, will help planners appreciate the value of the radio audience better. These metrics should strengthen radio’s place in the overall media mix, as media planners and clients understand the depth of this relationship.
It is my impression that radio will benefit hugely from being in the limelight. Recent chats that I had with a few media planners led me to believe that the medium receives less attention than it deserves, perhaps because there has been so little new to be said about it in recent years.
Currently the default radio plan is drive-time dominated, as that is when planners and clients will hear their spots. The new radio curve shows that radio is relevant through the day. Broadcasters will have the ammunition to more effectively sell their inventory. Having higher quarter hour listenerships, and longer listening hours means that the broadcasters have more contact opportunities to offer advertisers. With better understanding of the way in which people are listening, there will be new ways to for them to package inventory based on device and location listening habits. The development of “on the go” packages, perhaps with an outdoor component, seems an obvious example.
Certainly, the broad picture looks very positive for the medium. The challenge is that we are walking into completely uncharted territory. Few of us in the media industry have had any experience of dealing with a completely new currency. Some of us remember transitioning from TV diaries to the first TAM measurement, but the media landscape was simpler then. The challenge for us now is adjust to a new and more truthful picture of our environment, without constantly comparing it with what we thought we knew to be true.
BRC RAM Fact Sheet
BRC RAM fact sheet presented by TNS
BRC RAM opens up the world of radio to broadcasters and advertisers
By Clare O’Neil, BRC CEO
Following an open tender process, the BRC appointed TNS as its research company to run the BRC RAM (radio audience measurement) programme. From the outset, and during the set-up phase, the BRC and TNS worked together with a single purpose: to design, build, and test a bespoke radio survey which will capably and transparently deliver fresh data for the broadcasting, advertising, and marketing industries.
To this end a new format has been established and months of intensive work have gone into ensuring that the new measurement instruments are effective and capable, all of which has culminated in the new BRC RAM.
The BRC will release transparent, stand-alone radio audience survey data four times a year based on six months’ worth of data collection, which began from 7 January, 2016.
So, what’s new?
The BRC’s fresh and honest approach has signalled a new era in radio audience measurement for South Africa, seeking to accommodate the unique and (more importantly) diverse South African market, while raising the bar on how the needs of the radio broadcasters and advertisers will be met.
To achieve this an improved survey was required, one that is multiplatform, intuitive, and respondent-friendly across all walks of South African life. As such this new tool collects the most accurate data across different geographies and locations, across different languages, and across different socio-economic landscapes.
Essentially, the new survey tool consists of two elements:
- A placement interview: to collect information about each individual in the household, as well as about the household itself.
- A radio diary: To collect radio listening for all Commercial and Community South African radio stations and to ensure accuracy and transparency only those diaries which have been properly completed are included.
A fresh take on sampling
Nothing mires a survey quite like outdated sampling, which is why a rigorous sampling approach was demanded in order to deliver a fresh sampling frame.
The sampling approach therefore includes:
- An increased survey sample: 30 000 households (which is a 20% increase from the standard 25 000), achieving a 9% overall improvement in precision.
- Improved interview scope: employing comprehensive interviewer training to ready interviewers for fieldwork. Further, interviews are conducted continuously 50 weeks of the year in all area types and provinces, thereby covering all periods in a year and ensuring consistent and stable
- ‘Household flooding’: placing diaries with every individual in each household over the age of 15, which amounts to around 70 000 individual diaries a year.
- Widespread measurement: using IHS, who delivered the master sample frame and provide annual population updates, including latest boundary information, adds further dimension to the quality of the sampling and weighting, and therefore, the data itself, especially given the fluid migration patterns (both rural-urban and intra-urban) in South Africa.
All new measures for the better
BRC RAM is a brand new currency with new measures, each of which is part and parcel of the BRC’s vision to deliver the most comprehensive, transparent radio audience survey.
These measures include:
- Quality assurance: the highest priority for the survey is to ensure that every element of the programme is transparent.
- Improved accuracy: the diary was thoroughly tested and will deliver greater accuracy in terms of station listening, especially as respondents are able to enter up to three stations in any quarter hour and record shorter periods of listening.
- Improved design: the diary is well designed, carries clear instructions for completion (making it easy to use), and personalised so all the stations that individuals listen to are pre-listed.
- Innovative: for the first time, the locations of listening, as well as each device used per occasion, will be collected.
From the ease of use and comprehensive transparency measures to the new reach and rigour, the new approach of the BRC RAM survey has opened up a door to worlds hitherto unexplored, providing broadcasters, advertisers and marketers with the information that they need to chart their way forward in a constantly changing broadcasting environment.
All signs point to the exciting times ahead for broadcasters and advertisers alike in the radio industry.
The launch of the ALL NEW BRC RAM dataset (January – June 2016) is scheduled for 25 August, 2016.