| Driver risk assessments seem a simple way to
pin point problems – but do they actually work? Dr Will
Murray, Research Director at Interactive Driving Systems, examines
the results from a Napier University study into such tools and
analyses their impact on road safety |
 |
| “From a more general organisational
or business perspective, safety is a core activity” |
Road safety is a major burden on global wellbeing. In fact, World
Health Organisation data suggests that approximately 1.2 of the
5 million injury deaths around the world each year are road safety
related. Governments all over the world have implemented a whole
range of engineering, educational, enforcement and evaluation-based
programmes – some of which have been more effective than others.
In recent years, one increasingly important element of road safety
has emerged as that of work-related road safety. This includes people
involved in crashes while working by the roadside, or driving as
part of their work, either in their own vehicle or a vehicle provided
by their employer. In fact, there are a wide range of societal,
business, legal and cost reasons why work-related road safety has
emerged as an important issue.
Why is work-related road safety important?
From a societal perspective, there is only limited data at present
because few jurisdictions around the world maintain any “purpose
of journey information” in relation to road crashes. The best
data currently available is for Queensland in Australia, where at
least 16% of hospitalisation crashes and 24% of fatal crashes over
the period 1998-2002 involved someone driving for work. In the UK
there is some data emerging from police trials and estimated studies
that in the region of three of the nine road fatalities per day
involve someone driving for work.
| 
“A conventional approach to defensive driver-training
is unrealistic for the number of drivers we employ. We needed
something that could filter those drivers assessed as being
at high risk. “We can then look at the identified weakness
and tailor courses. VFRM.net offered us a cost-effective solution
to driver assessment, rather than the usual generic approach
of on-road training. “Initial results suggest there
is a strong correlation between driver scores and accident
rates, so we are correct in using VFRM.net as a tool in accident
reduction.”
Dave Wallington, group safety adviser
at BT
|
From a more general organisational or business perspective, safety
is a core activity and there are many quality, efficiency, environmental,
marketing, business development, corporate responsibility and brand
enhancement or brand protection reasons why work-related road safety
is important. At the simplest level, it’s much better to be
promoting a good news safety story than it is to be trying to suppress
the outcomes of a major incident. Legally, many jurisdictions around
the world – including the UK, Australia and New Zealand in
the last year or so – have tightened up their Occupational
Health and Safety regulations to include work-related driving. This
means that not only do organisations have to ensure that their workers
drive with the road traffic rules, but also the organisations themselves
must have clearly risk assessed and documented safe systems of work
in place for their vehicles, drivers, journeys, sites and processes.
From a cost perspective, the implications of workrelated road
safety can be massive. One company we worked with recently had damage
costs of £3m per year; they estimated that their hidden costs
were approximately as much again – and their return on sales
figure was 8%. This meant that just to pay for the £3m of
“metal bashing costs” they had to generate £75m
in revenues. Although government agencies do not have to make a
profit in this way, they are using the public’s money and
should be seen to lead by example in all of these areas –
but how can they do it?
How can work-related road safety be improved?
It is generally agreed by researchers and managers around the world
that “there are clear indications that fleet safety is most
likely to be improved by the introduction of an integrated set of
measures based on the safety culture within the organisation”.
The joint UK Health and Safety
Executive and Department for Transport guidance on “Work-related
Road Safety”, issued in September 2003, suggested that this
can be achieved by taking a risk assessment-led approach to managing
drivers, vehicles and the journeys they undertake. With this in
mind, Napier University undertook research on one particular web-based
driver risk assessment tool called RoadRISK.
 |
| “A common question and criticism
of driver assessment and training programmes is ‘do they
really work?’” |
RoadRISK is one element of the Virtual Fleet Risk Manager (VFRM.net)
developed by Interactive Driving Systems, in collaboration with
universities in the UK and Australia, as well as a wide range of
partner organisations around the globe. RoadRISK assesses a driver’s
attitude, behaviour, knowledge, hazard perception and personal exposure
to the risks of the road through a series of questions and interactive
computer-based exercises. A common question and criticism of driver
assessment and training programmes is “do they really work?”
Apart from some anecdotes and customer quotes used in their sales
literature by the driver-training industry, there is very little
clear, well-researched evidence about what works from a safety improvement
perspective.
Therefore, the research was undertaken because, although driver
assessment and training is intuitively the right thing to do, there
is very little hard research evidence that it actually improves
road safety outcomes. For this reason, Napier University was commissioned
to undertake an independent statistical comparison of the results
from over 13,000 drivers assessed against their reported crash outcomes.
This was groundbreaking, in that it was the first known study of
its type by the UK fleet industry and a university. It focused on
three main areas.
1. Identifying drivers most at risk
2. The relationship between the assessment score and crash involvement
3. Predicting the likelihood of a driver being involved in a crash
Identifying the drivers most at risk
The first finding from the Napier University study data was that the
system could be used to identify the most at risk drivers in an organisation.
In the table below for example, the system identified the 1% of drivers
responsible for 10% of crashes.
Relationship between assessment score and crash
involvement
The Napier analysis showed that the RoadRISK assessment has some
potential to predict crash involvement. This is highlighted in the
graph below, where low scores on the assessment are clearly linked
to higher crash rates by the two trend lines. For example, 3.7%
of drivers with no crashes scored <70%, whereas 34% of drivers
with four crashes scored <70%.
What Graph 1 means for road safety is that drivers with good (>80%)
scores on the assessment are less likely to have crashes than those
with average (70-80%) and poor (<70%) scores.
Graph 2 (opposite) from the Napier study shows a clear relationship
between the scores on the individual elements of the assessment
and driver crash history.
| 
“Changing attitudes is not just about influencing drivers
– it’s about changing the culture within the organisation
and within depot.”
Lynne Beale, Group Risk Manager, Arriva Passenger
Service
|
Predicting the likelihood of a driver being
involved in a crash
More detailed statistical analysis in the form of a logistic regression
was then undertaken on the data by Napier University. The results
are shown in the following table. In simple terms, what this means
for road safety is that a driver scoring <70% on the assessment
is 3.3 times more likely to report four crashes than a driver scoring
>80%. When the personal risk exposure element of the assessment
is included a driver scoring <70% is 16.8 times more likely to
report four crashes than a driver scoring >80%.
 |
| “An increase in the average RoadRISK
ssessment score of 10% could reduce incidents by at least 300
for every 10,000 drivers assessed” |
This can be equated to fleet costs by taking an average crash cost
of £765. An increase in the average RoadRISK assessment score
of 10% could reduce incidents by at least 300 and costs by £229,500
for every 10,000 drivers assessed. The implications of identifying
high-risk drivers and the practical benefits for the industry are
best shown through case studies. The largest user of the RoadRISK
assessment tool to date is BT, whose accident rate has reduced by
30% over the past four years as part of an on-going commitment to
improve driver safety. During that time, it has put almost 25,000
of its 70,000 driving staff through the RoadRISK assessment.
With such high numbers of drivers employed, a conventional approach
to defensive driver training is unrealistic. BT therefore uses RoadRISK
to filter those drivers assessed as being at high risk. It then
looks at the identified areas of weakness and tailors programmes.
In this case, RoadRISK offers a cost-effective solution to driver
assessment, rather than the usual generic approach of on-road training.
The outcomes from the Napier study give BT and other users, such
as TNT Logistics and Arriva buses, confidence that there is a strong
correlation between assessment scores and crash rates – allowing
them use the RoadRISK assessment for the following tasks:
Pre-employment:
- Part of recruitment pre-screen, interview or induction process
Current staff:
- Annual assessment in conditions of employment
- Remote sites
- Selection of instructors and assessors
- Evaluate training needs and review success of training
- Post-crash investigation
Other uses:
- Allocation of company cars
- High employee turnover, agency drivers
- Risk assessments for insurance, underwriting, health and safety
due diligence and vehicle hire
Conclusion
Work-related road safety is important to government and industry
for a range of societal, business, legal and cost reasons. A risk-assessment-led
approach has been identified by the UK government as an effective
approach to managing the drivers, vehicles and journeys involved.
The Napier University study described has shown the potential benefits
that can be achieved by applying this methodology to driver risk
assessment.
www.ufrm.net
 |
| “The main focus of each of the
six central scenarios in SenseAbility has been taken from an
insurance company’s records” |
| 
“RoadRISK assisted TNT to reduce its at-fault motor
collision claim by 25% and contributed to a £500,000
cost reduction during the same period.”
Neil Griffiths, Director of Health, Safety
and Environmental at TNT
|
|
Off the road to assess the risks
Rather than taking their drivers on to the road for risk
assessments, many companies are using online or CD-ROM-based
tools. We take a look at some of the examples available
INDIVIDUAL DRIVER RISK ASSESSMENT
This management tool from Drive and Survive places its emphasis
on analysing the driver’s attitude and driving environment,
rather than his or her knowledge about the business of safe
driving. Responses to key questions are mathematically weighted.
Clients then receive a comprehensive report on how their drivers
reacted to the assessment. Although in many cases there are
no right or wrong answers to the questions, some are more
right than others and are weighted accordingly. The back office
system can, therefore, analyse the results and calculate a
risk profile for each driver. They are then categorised into
low, medium and high risk, with the latter being identified
as needing on-road driver training.
Costs
Individual Driver Risk Assessment: £15 per driver
For more information, visit: www.driveandsurvive.com
DESKTOP DRIVING ASSESSMENT
This an on-line tool from Driving Monitor that assesses a
driver’s skill, attitude and knowledge in hazard perception;
general driving; Highway Code/road traffic law; attitude.
The DDA also produces a complete driver risk assessment for
other key risk exposures related to driving, which are age,
driving experience, driving licence violations, number of
crashes, driving disqualification, annual mileage and hours
worked. Taking no more than 25 minutes, the result is available
immediately, with an e-mail confirmation shortly thereafter.
A formal driver risk assessment report will also be produced.
The system does not auto generate reports, but looks at the
bigger picture and makes practical recommendations.
Cost
DDA: £25 + VAT per assessment
Fixed price unlimited usage packages are available
For more information, visit drivingmonitor.com
RISK MAPPING ONLINE
This assessment system judges hazards perception, general
knowledge and decision-making, and generates two fourpage
reports – one for the driver and one for the fleet manager.
Designed to be part of an on-going assessment process –
repeated after say nine or 12 months and then regularly after
that – the system is internet-based, which means it
won’t repeat questions, is connected to a regularly-updated
central database, and can compare company departments/ divisions
with one another or to a national average.
Costs
RMO: £20 per driver
For more information, visit: www.rmo-l-com
SENSEABILITY
Developed by RoSPA, this system aims to pick out areas of
weakness for certain target groups and the need for further
training. The assessment consists of a virtual technology
sequence lasting approximately 20 minutes. The main focus
of each of the six central scenarios has been taken from an
insurance company’s records of the six most commonlyreported
incidents, such as collision on roundabout and changing lanes.
There are also two or three minor potential hazards unfolding
in each of the six scenarios so that the driving experience
is more realistic and the hazards not too easy to detect.
Scores are logged on a central database that can be accessed
by the line manager, as well as the score appearing at the
end of the assessment so that the individual knows how well
he/she did.
Cost
From £10
For more information, visit www.rospa.com/drivertraining
DATA PROGRAMMES
The DATA CD offers a comprehensive assessment and training
experience. The process is designed to take between 20 and
30 minutes and is divided into sections that address the driver’s
background, their attitude and driving style and their driving
knowledge. The driver is then presented with their results
in the form of an overall risk rating, coupled with individual
ratings for each section. Assessments are adaptive, which
allows the DATA CD to probe topics in depth where the driver
shows a particular risk exposure. With DATA Online, meanwhile,
a similar process to DATA CD is used. It does not offer the
same level of video or audio training content as DATA CD,
but is highly customisable. Online reporting tools are available
to allow customers’ management teams to gain real-time
results, both for statistical overviews and detail reports
on individuals.
Cost
Varies depending on the number of drivers, the degree of customisation
required and the level of management and support required
For more information, contact www.dataprogrammes.com
|
|