Introducing stats19
R Lovelace, M Morgan, L Hama and M Padgham
2024-10-24
Introduction
stats19 enables access to and processing of Great
Britain’s official road traffic casualty database, STATS19.
A description of variables in the database can be found in a guidance
provided by the UK’s Department for Transport (DfT). The datasets are
collectively called STATS19 after the form used to report them, which
can be found here.
This vignette focuses on how to use the stats19 package
to work with STATS19 data.
Note: The Department for Transport used to refer to
‘accidents’, but “crashes” may be a more appropriate term, as emphasised
in the “crash not accident” arguments of road safety advocacy groups
such as RoadPeace.
We use the term collision only in reference to nomenclature within the
data as provided.
The development version is hosted on GitHub and can be
installed and loaded as follows:
# from CRAN
install.packages("stats19")
# you can install the latest development (discoraged) using:
remotes::install_github("ITSLeeds/stats19")
library(stats19)
#> Data provided under OGL v3.0. Cite the source and link to:
#> www.nationalarchives.gov.uk/doc/open-government-licence/version/3/
Functions
The easiest way to get STATS19 data is with
get_stats19(). This function takes 2 main arguments,
year and type. The year can be any year
between 1979 and 202x where x is the current year minus one or two due
to the delay in publishing STATS19 statistics. The type can be one of
accidents, casualties and
vehicles, described below. get_stats19()
performs 3 jobs, corresponding to three main types of functions:
Download: A dl_stats19() function
accepts year, type and filename
arguments to make it easy to find the right file to download
only.
Read: STATS19 data is provided in a particular
format that benefits from being read-in with pre-specified column types.
This is taken care of with read_*() functions providing
access to the 3 main tables in STATS19 data:
read_collisions() reads-in the crash data (which has
one row per incident)read_casualties() reads-in the casualty data (which has
one row per person injured or killed)read_vehicles() reads-in the vehicles table, which
contains information on the vehicles involved in the crashes (and has
one row per vehicle)
Format: There are corresponding
format_*() functions for each of the read_*()
functions. These have been exported for convenience, as the two sets of
functions are closely related, there is also a format
parameter for the read_*() functions, which by default is
TRUE, adds labels to the tables. The raw data provided by
the DfT contains only integers. Running
read_*(..., format = TRUE) converts these integer values to
the corresponding character variables for each of the three tables. For
example, read_collisions(format = TRUE) converts values in
the accident_severity column from 1,
2 and 3 to Slight,
Serious and Fatal using
fromat_collisions() function. To read-in raw data without
formatting, set format = FALSE.
Multiple functions (read_* and format_*)
are needed for each step because of the structure of STATS19 data, which
are divided into 3 tables:
- “accident circumstances, with details about location, severity,
weather, etc.;
- casualties, referencing knowledge about the victims; and
- vehicles, which contains more information about the vehicle type and
manoeuvres, as well the some information about the driver.”
Data files containing multiple years worth of data can be downloaded.
Datasets since 1979 are broadly consistent, meaning that STATS19 data
represents a rich historic geographic record of road casualties at a
national level.
Download STATS19 data
stats19 enables download of raw STATS19 data with
dl_* functions. The following code chunk, for example,
downloads and unzips a .zip file containing STATS19 data from 2022:
dl_stats19(year = 2022, type = "collision", ask = FALSE)
#> Files identified: dft-road-casualty-statistics-collision-2022.csv
#> https://data.dft.gov.uk/road-accidents-safety-data/dft-road-casualty-statistics-collision-2022.csv
#> Data already exists in data_dir, not downloading
Note that in the previous command, ask = FALSE, meaning
you will not be asked. By default you are asked to confirm, before
downloading large files. Currently, these files are downloaded to a
default location of tempdir which is a platform independent
“safe” but temporary location to download the data in. Once downloaded,
they are unzipped under original DfT file names. The
dl_stats19() function prints out the location and final
file name(s) of unzipped files(s) as shown above.
dl_stats19() takes three parameters. Supplying a
file_name is interpreted to mean that the user is aware of
what to download and the other two parameters will be ignored. You can
also use year and type to “search” through the
file names, which are stored in a lazy-loaded dataset called
stats19::file_names.
You can find out the names of files that can be downloaded with
names(stats19::file_names), an example of which is shown
below:
stats19::file_names$DigitalBreathTestData2013.zip
#> NULL
To see how file_names was created, see
?file_names. Data files from other years can be selected
interactively. Just providing a year, for example, presents the user
with multiple options (from file_names), illustrated
below:
Multiple matches. Which do you want to download?
1: dft-road-casualty-statistics-casualty-2022.csv
2: dft-road-casualty-statistics-vehicle-2022.csv
3: dft-road-casualty-statistics-accident-2022.csv
Selection:
Enter an item from the menu, or 0 to exit
When R is running interactively, you can select which of the 3
matching files to download: those relating to vehicles, casualties or
accidents in 2022.
Read STATS19 data
In a similar approach to the download section before, we can read
files downloaded using a data_dir location of the file and
the filename to read. The code below will download the
dftRoadSafetyData_Accidents_2022.zip file from the DfT
servers and read its content. Files are saved by default in
tempdir(), but this can be overridden to ensure permanent
storage in a user-defined location.
crashes_2022_raw = get_stats19(year = 2022, type = "collision", format = FALSE)
#> Files identified: dft-road-casualty-statistics-collision-2022.csv
#> https://data.dft.gov.uk/road-accidents-safety-data/dft-road-casualty-statistics-collision-2022.csv
#> Data already exists in data_dir, not downloading
#> Reading in:
#> ~/data/stats19/dft-road-casualty-statistics-collision-2022.csv
stats19 imports data with
readr::read_csv() which results in a ‘tibble’ object: a
data frame with more user-friendly printing and a few other
features.
class(crashes_2022_raw)
#> [1] "spec_tbl_df" "tbl_df" "tbl" "data.frame"
dim(crashes_2022_raw)
#> [1] 106004 36
There are three read_*() functions, corresponding to the
three different classes of data provided by the DfT: 1.
read_collisions() 2. read_casualties() 3.
read_vehicles()
In all cases, a default parameter read_*(format = TRUE)
returns the data in formatted form, as described above. Data can also be
imported in the form directly provided by the DfT by passing
format = FALSE, and then subsequently formatted with
additional format_*() functions, as described in a final
section of this vignette. Each of these read_*() functions
is now described in more detail.
Crash data
After raw data files have been downloaded as described in the
previous section, they can then be read-in as follows:
crashes_2022_raw = read_collisions(year = 2022, format = FALSE)
#> Reading in:
#> ~/data/stats19/dft-road-casualty-statistics-collision-2022.csv
crashes_2022 = format_collisions(crashes_2022_raw)
#> date and time columns present, creating formatted datetime column
#> Warning in format_stats19(x, type = "Accident"): NAs introduced by coercion
#> Warning in format_stats19(x, type = "Accident"): NAs introduced by coercion
#> Warning in format_stats19(x, type = "Accident"): NAs introduced by coercion
nrow(crashes_2022_raw)
#> [1] 106004
ncol(crashes_2022_raw)
#> [1] 36
nrow(crashes_2022)
#> [1] 106004
ncol(crashes_2022)
#> [1] 37
What just happened? We read-in data on all road crashes recorded by
the police in 2022 across Great Britain. The dataset contains
32 columns (variables) for
129,982 crashes.
This work was done by read_collisions(format = FALSE),
which imported the “raw” STATS19 data without cleaning messy column
names or re-categorising the outputs. format_collisions()
function automates the process of matching column names with variable
names provided by the DfT. This means crashes_2022 is much
more usable than crashes_2022_raw, as shown below, which
shows some key variables in the messy and clean datasets:
crashes_2022_raw[c(7, 18, 23, 25)]
#> # A tibble: 106,004 × 4
#> latitude first_road_class junction_control second_road_number
#> <dbl> <chr> <chr> <chr>
#> 1 51.5 3 4 0
#> 2 51.5 3 2 0
#> 3 51.5 3 4 0
#> 4 51.6 6 -1 -1
#> 5 51.6 3 4 0
#> 6 51.5 3 4 0
#> 7 51.4 6 4 0
#> 8 51.6 3 -1 -1
#> 9 51.5 3 2 0
#> 10 51.6 4 4 0
#> # ℹ 105,994 more rows
crashes_2022[c(7, 18, 23, 25)]
#> # A tibble: 106,004 × 4
#> latitude first_road_class junction_control second_road_number
#> <dbl> <chr> <chr> <chr>
#> 1 51.5 A Give way or uncontrolled first_road_class is C…
#> 2 51.5 A Auto traffic signal first_road_class is C…
#> 3 51.5 A Give way or uncontrolled first_road_class is C…
#> 4 51.6 Unclassified Data missing or out of range Unknown
#> 5 51.6 A Give way or uncontrolled first_road_class is C…
#> 6 51.5 A Give way or uncontrolled first_road_class is C…
#> 7 51.4 Unclassified Give way or uncontrolled first_road_class is C…
#> 8 51.6 A Data missing or out of range Unknown
#> 9 51.5 A Auto traffic signal first_road_class is C…
#> 10 51.6 B Give way or uncontrolled first_road_class is C…
#> # ℹ 105,994 more rows
By default, format = TRUE, meaning that the two stages
of read_collisions(format = FALSE) and
format_collisions() yield the same result as
read_collisions(format = TRUE). For the full list of
columns, run names(crashes_2022).
Note: As indicated above, the term collision is only
used as directly provided by the DfT; “crashes” is a more appropriate
term, hence we call our resultant datasets crashes_*.
Format STATS19 data
It is also possible to import the “raw” data as provided by the DfT.
The packaged datasets stats19_variables and
stats19_schema provide summary information about the
contents of this data guide. These contain the full variable names in
the guide (stats19_variables) and a complete look up table
relating integer values to the .csv files provided by the
DfT and their labels (stats19_schema). The first rows of
each dataset are shown below:
stats19_variables
#> # A tibble: 98 × 5
#> # Groups: table [4]
#> table variable note column_name type
#> <chr> <chr> <chr> <chr> <chr>
#> 1 Accident accident_index uniqu… accident_i… char…
#> 2 Accident accident_index uniqu… accident_i… char…
#> 3 Accident accident_index uniqu… accident_i… char…
#> 4 Accident accident_reference In ye… accident_r… char…
#> 5 Accident accident_severity <NA> accident_s… char…
#> 6 Accident accident_year <NA> accident_y… nume…
#> 7 Accident carriageway_hazards <NA> carriagewa… char…
#> 8 Accident date <NA> date char…
#> 9 Accident day_of_week <NA> day_of_week char…
#> 10 Accident did_police_officer_attend_scene_of_accident <NA> did_police… char…
#> # ℹ 88 more rows
stats19_schema
#> # A tibble: 914 × 7
#> table variable code label note variable_formatted type
#> <chr> <chr> <chr> <chr> <chr> <chr> <chr>
#> 1 Accident police_force 1 Metropolitan Poli… <NA> police_force char…
#> 2 Accident police_force 3 Cumbria <NA> police_force char…
#> 3 Accident police_force 4 Lancashire <NA> police_force char…
#> 4 Accident police_force 5 Merseyside <NA> police_force char…
#> 5 Accident police_force 6 Greater Manchester <NA> police_force char…
#> 6 Accident police_force 7 Cheshire <NA> police_force char…
#> 7 Accident police_force 10 Northumbria <NA> police_force char…
#> 8 Accident police_force 11 Durham <NA> police_force char…
#> 9 Accident police_force 12 North Yorkshire <NA> police_force char…
#> 10 Accident police_force 13 West Yorkshire <NA> police_force char…
#> # ℹ 904 more rows
The code that generated these small datasets can be found in their
help pages (accessed with ?stats19_variables and
?stats19_schema respectively). stats19_schema
is used internally to automate the process of formatting the downloaded
.csv files. Column names are formatted by the function
format_column_names(), as illustrated below:
format_column_names(stats19_variables$variable[1:3])
#> [1] "accident_index" "accident_index" "accident_index"
Previous approaches to data formatting STATS19 data
involved hard-coding results. This more automated approach to data
cleaning is more consistent and fail-safe. The three functions:
format_collisions(), format_vehicles() and
format_casualties() do the data formatting on the
respective data frames, as illustrated below:
crashes_2022 = format_collisions(crashes_2022_raw)
#> date and time columns present, creating formatted datetime column
#> Warning in format_stats19(x, type = "Accident"): NAs introduced by coercion
#> Warning in format_stats19(x, type = "Accident"): NAs introduced by coercion
#> Warning in format_stats19(x, type = "Accident"): NAs introduced by coercion
# vehicle data for 2022
dl_stats19(year = 2022, type = "vehicle", ask = FALSE)
#> Files identified: dft-road-casualty-statistics-vehicle-2022.csv
#> https://data.dft.gov.uk/road-accidents-safety-data/dft-road-casualty-statistics-vehicle-2022.csv
#> Data already exists in data_dir, not downloading
vehicles_2022_raw = read_vehicles(year = 2022)
#> Warning: The following named parsers don't match the column names:
#> accident_severity, carriageway_hazards, date, day_of_week,
#> did_police_officer_attend_scene_of_accident, first_road_class,
#> first_road_number, junction_control, junction_detail, Latitude,
#> light_conditions, local_authority_district, local_authority_highway,
#> local_authority_ons_district, location_easting_osgr, location_northing_osgr,
#> longitude, lsoa_of_accident_location, number_of_casualties, number_of_vehicles,
#> pedestrian_crossing_human_control, pedestrian_crossing_physical_facilities,
#> police_force, road_surface_conditions, road_type, second_road_class,
#> second_road_number, special_conditions_at_site, speed_limit, time,
#> trunk_road_flag, urban_or_rural_area, weather_conditions, age_band_of_casualty,
#> age_of_casualty, bus_or_coach_passenger, car_passenger, casualty_class,
#> casualty_home_area_type, casualty_imd_decile, casualty_reference,
#> casualty_severity, casualty_type, pedestrian_location, pedestrian_movement,
#> pedestrian_road_maintenance_worker, sex_of_casualty, vehicle_text
#> Warning in asMethod(object): NAs introduced by coercion
vehicles_2022 = format_vehicles(vehicles_2022_raw)
# casualties data for 2022
dl_stats19(year = 2022, type = "casualty", ask = FALSE)
#> Files identified: dft-road-casualty-statistics-casualty-2022.csv
#> https://data.dft.gov.uk/road-accidents-safety-data/dft-road-casualty-statistics-casualty-2022.csv
#> Data already exists in data_dir, not downloading
casualties_2022 = read_casualties(year = 2022)
#> Warning: The following named parsers don't match the column names: accident_severity, carriageway_hazards, date, day_of_week, did_police_officer_attend_scene_of_accident, first_road_class, first_road_number, junction_control, junction_detail, Latitude, light_conditions, local_authority_district, local_authority_highway, local_authority_ons_district, location_easting_osgr, location_northing_osgr, longitude, lsoa_of_accident_location, number_of_casualties, number_of_vehicles, pedestrian_crossing_human_control, pedestrian_crossing_physical_facilities, police_force, road_surface_conditions, road_type, second_road_class, second_road_number, special_conditions_at_site, speed_limit, time, trunk_road_flag, urban_or_rural_area, weather_conditions, vehicle_text, vehicle_type, age_band_of_driver, age_of_driver, age_of_vehicle, driver_home_area_type, driver_imd_decile, engine_capacity_cc, first_point_of_impact, generic_make_model, hit_object_in_carriageway, hit_object_off_carriageway, journey_purpose_of_driver, junction_location, propulsion_code, sex_of_driver, skidding_and_overturning, towing_and_articulation, vehicle_direction_from, vehicle_direction_to, vehicle_leaving_carriageway, vehicle_left_hand_drive, vehicle_location_restricted_lane, vehicle_manoeuvre
#> NAs introduced by coercion
The package automates this two-step read_* and
format_* process by defaulting in all cases to
data_year = read_*(year, format = TRUE).
read_* functions return, by default, formatted data. The
two-step process may nevertheless be important for reference to the
official nomenclature and values as provided by the DfT.
A summary of the outputs for each of the three tables is shown
below.
summarise_stats19 = function(x) {
data.frame(row.names = 1:length(x),
name = substr(names(x), 1, 19),
class = sapply(x, function(v) class(v)[1]),
n_unique = sapply(x, function(v) length(unique(v))),
first_label = sapply(x, function(v) substr(unique(v)[1], 1, 16)),
most_common_value = sapply(x, function(v)
substr(names(sort(table(v), decreasing = TRUE)[1]), 1, 16)[1])
)
}
knitr::kable(summarise_stats19(crashes_2022),
caption = "Summary of formatted crash data.")
Summary of formatted crash data.
| accident_index |
character |
106004 |
2022010352073 |
2022010352073 |
| accident_year |
integer |
1 |
2022 |
2022 |
| accident_reference |
character |
106004 |
010352073 |
010352073 |
| location_easting_os |
numeric |
85481 |
525199 |
533653 |
| location_northing_o |
numeric |
85711 |
177928 |
180088 |
| longitude |
numeric |
103897 |
-0.198224 |
-3.099017 |
| latitude |
numeric |
102680 |
51.486454 |
51.442218 |
| police_force |
character |
44 |
Metropolitan Pol |
Metropolitan Pol |
| accident_severity |
character |
3 |
Slight |
Slight |
| number_of_vehicles |
character |
14 |
2 |
2 |
| number_of_casualtie |
character |
16 |
1 |
1 |
| date |
Date |
365 |
2022-01-05 |
2022-11-04 |
| day_of_week |
character |
7 |
Wednesday |
Friday |
| time |
character |
1440 |
16:40 |
17:00 |
| local_authority_dis |
character |
1 |
-1 |
-1 |
| local_authority_ons |
character |
365 |
E09000013 |
E08000025 |
| local_authority_hig |
character |
207 |
E09000013 |
E10000016 |
| first_road_class |
character |
6 |
A |
A |
| first_road_number |
character |
3110 |
3218 |
first_road_class |
| road_type |
character |
6 |
Single carriagew |
Single carriagew |
| speed_limit |
character |
6 |
30 |
30 |
| junction_detail |
character |
10 |
Crossroads |
Not at junction |
| junction_control |
character |
6 |
Give way or unco |
Give way or unco |
| second_road_class |
character |
8 |
Unclassified |
Not at junction |
| second_road_number |
character |
2364 |
first_road_class |
first_road_class |
| pedestrian_crossing |
character |
5 |
None within 50 m |
None within 50 m |
| pedestrian_crossing |
character |
8 |
No physical cros |
No physical cros |
| light_conditions |
character |
6 |
Darkness - light |
Daylight |
| weather_conditions |
character |
9 |
Fine no high win |
Fine no high win |
| road_surface_condit |
character |
7 |
Dry |
Dry |
| special_conditions_ |
character |
10 |
None |
None |
| carriageway_hazards |
character |
8 |
None |
None |
| urban_or_rural_area |
character |
3 |
Urban |
Urban |
| did_police_officer_ |
character |
3 |
Yes |
Yes |
| trunk_road_flag |
character |
3 |
Non-trunk |
Non-trunk |
| lsoa_of_accident_lo |
character |
26849 |
E01001883 |
-1 |
| datetime |
POSIXct |
79890 |
2022-01-05 16:40 |
2022-07-14 18:00 |
knitr::kable(summarise_stats19(vehicles_2022),
caption = "Summary of formatted vehicles data.")
Summary of formatted vehicles data.
| accident_index |
character |
106004 |
2022010352073 |
2022371220504 |
| accident_year |
integer |
1 |
2022 |
2022 |
| accident_reference |
character |
106004 |
010352073 |
371220504 |
| vehicle_reference |
character |
24 |
1 |
1 |
| vehicle_type |
character |
22 |
Van / Goods 3.5 |
Car |
| towing_and_articula |
character |
8 |
No tow/articulat |
No tow/articulat |
| vehicle_manoeuvre |
character |
20 |
Turning right |
Going ahead othe |
| vehicle_direction_f |
character |
10 |
East |
South East |
| vehicle_direction_t |
character |
10 |
North West |
South East |
| vehicle_location_re |
character |
12 |
On main c’way - |
On main c’way - |
| junction_location |
character |
11 |
Approaching junc |
Not at or within |
| skidding_and_overtu |
character |
8 |
None |
None |
| hit_object_in_carri |
character |
14 |
None |
None |
| vehicle_leaving_car |
character |
11 |
Did not leave ca |
Did not leave ca |
| hit_object_off_carr |
character |
14 |
None |
None |
| first_point_of_impa |
character |
7 |
Front |
Front |
| vehicle_left_hand_d |
character |
3 |
Yes |
No |
| journey_purpose_of_ |
character |
6 |
Commuting to/fro |
Not known |
| sex_of_driver |
character |
3 |
Male |
Male |
| age_of_driver |
integer |
99 |
48 |
30 |
| age_band_of_driver |
character |
12 |
46 - 55 |
26 - 35 |
| engine_capacity_cc |
character |
1015 |
1461 |
Data missing or |
| propulsion_code |
character |
10 |
Heavy oil |
Petrol |
| age_of_vehicle |
integer |
86 |
4 |
-1 |
| generic_make_model |
character |
701 |
RENAULT KANGOO |
Data missing or |
| driver_imd_decile |
character |
11 |
Less deprived 30 |
Data missing or |
| driver_home_area_ty |
character |
4 |
Urban area |
Urban area |
| lsoa_of_driver |
character |
32838 |
E01002687 |
-1 |
knitr::kable(summarise_stats19(casualties_2022),
caption = "Summary of formatted casualty data.")
Summary of formatted casualty data.
| accident_index |
character |
106004 |
2022010352073 |
2022010356595 |
| accident_year |
integer |
1 |
2022 |
2022 |
| accident_reference |
character |
106004 |
010352073 |
010356595 |
| vehicle_reference |
character |
17 |
2 |
1 |
| casualty_reference |
character |
19 |
1 |
1 |
| casualty_class |
character |
3 |
Driver or rider |
Driver or rider |
| sex_of_casualty |
character |
4 |
Male |
Male |
| age_of_casualty |
integer |
103 |
17 |
18 |
| age_band_of_casualt |
character |
12 |
16 - 20 |
26 - 35 |
| casualty_severity |
character |
3 |
Slight |
Slight |
| pedestrian_location |
character |
12 |
Not a Pedestrian |
Not a Pedestrian |
| pedestrian_movement |
character |
11 |
Not a Pedestrian |
Not a Pedestrian |
| car_passenger |
character |
5 |
Not car passenge |
Not car passenge |
| bus_or_coach_passen |
character |
7 |
Not a bus or coa |
Not a bus or coa |
| pedestrian_road_mai |
character |
4 |
No / Not applica |
No / Not applica |
| casualty_type |
character |
23 |
Motorcycle 125cc |
Car occupant |
| casualty_home_area_ |
character |
4 |
Urban area |
Urban area |
| casualty_imd_decile |
character |
11 |
Most deprived 10 |
More deprived 10 |
| lsoa_of_casualty |
character |
31105 |
E01001364 |
-1 |
For testing and other purposes, a sample from the accidents table is
provided in the package. A few columns from the two-row sample is shown
below:
| Serious |
30 |
Control by other authorised person |
Daylight |
| Slight |
30 |
None within 50 metres |
Darkness - no lighting |
| Slight |
30 |
None within 50 metres |
Daylight |
Casualties data
As with crashes_2022, casualty data for 2022 can be
downloaded, read-in and formatted as follows:
dl_stats19(year = 2022, type = "casualty", ask = FALSE)
#> Files identified: dft-road-casualty-statistics-casualty-2022.csv
#> https://data.dft.gov.uk/road-accidents-safety-data/dft-road-casualty-statistics-casualty-2022.csv
#> Data already exists in data_dir, not downloading
casualties_2022 = read_casualties(year = 2022)
#> Warning: The following named parsers don't match the column names:
#> accident_severity, carriageway_hazards, date, day_of_week,
#> did_police_officer_attend_scene_of_accident, first_road_class,
#> first_road_number, junction_control, junction_detail, Latitude,
#> light_conditions, local_authority_district, local_authority_highway,
#> local_authority_ons_district, location_easting_osgr, location_northing_osgr,
#> longitude, lsoa_of_accident_location, number_of_casualties, number_of_vehicles,
#> pedestrian_crossing_human_control, pedestrian_crossing_physical_facilities,
#> police_force, road_surface_conditions, road_type, second_road_class,
#> second_road_number, special_conditions_at_site, speed_limit, time,
#> trunk_road_flag, urban_or_rural_area, weather_conditions, vehicle_text,
#> vehicle_type, age_band_of_driver, age_of_driver, age_of_vehicle,
#> driver_home_area_type, driver_imd_decile, engine_capacity_cc,
#> first_point_of_impact, generic_make_model, hit_object_in_carriageway,
#> hit_object_off_carriageway, journey_purpose_of_driver, junction_location,
#> propulsion_code, sex_of_driver, skidding_and_overturning,
#> towing_and_articulation, vehicle_direction_from, vehicle_direction_to,
#> vehicle_leaving_carriageway, vehicle_left_hand_drive,
#> vehicle_location_restricted_lane, vehicle_manoeuvre
#> Warning in asMethod(object): NAs introduced by coercion
nrow(casualties_2022)
#> [1] 135480
ncol(casualties_2022)
#> [1] 19
The results show that there were
170,993 casualties reported by the police in the STATS19 dataset in
2022, and
16 columns (variables). Values for a sample of these columns are
shown below:
casualties_2022[c(4, 5, 6, 14)]
#> # A tibble: 135,480 × 4
#> vehicle_reference casualty_reference casualty_class bus_or_coach_passenger
#> <chr> <chr> <chr> <chr>
#> 1 2 1 Driver or rider Not a bus or coach pass…
#> 2 1 1 Driver or rider Not a bus or coach pass…
#> 3 1 1 Driver or rider Not a bus or coach pass…
#> 4 1 1 Driver or rider Not a bus or coach pass…
#> 5 1 2 Passenger Not a bus or coach pass…
#> 6 1 1 Driver or rider Not a bus or coach pass…
#> 7 2 2 Driver or rider Not a bus or coach pass…
#> 8 3 3 Driver or rider Not a bus or coach pass…
#> 9 1 1 Driver or rider Not a bus or coach pass…
#> 10 1 2 Passenger Not a bus or coach pass…
#> # ℹ 135,470 more rows
The full list of column names in the casualties dataset
is:
names(casualties_2022)
#> [1] "accident_index" "accident_year"
#> [3] "accident_reference" "vehicle_reference"
#> [5] "casualty_reference" "casualty_class"
#> [7] "sex_of_casualty" "age_of_casualty"
#> [9] "age_band_of_casualty" "casualty_severity"
#> [11] "pedestrian_location" "pedestrian_movement"
#> [13] "car_passenger" "bus_or_coach_passenger"
#> [15] "pedestrian_road_maintenance_worker" "casualty_type"
#> [17] "casualty_home_area_type" "casualty_imd_decile"
#> [19] "lsoa_of_casualty"
Vehicles data
Data for vehicles involved in crashes in 2022 can be downloaded,
read-in and formatted as follows:
dl_stats19(year = 2022, type = "vehicle", ask = FALSE)
#> Files identified: dft-road-casualty-statistics-vehicle-2022.csv
#> https://data.dft.gov.uk/road-accidents-safety-data/dft-road-casualty-statistics-vehicle-2022.csv
#> Data already exists in data_dir, not downloading
vehicles_2022 = read_vehicles(year = 2022)
#> Warning: The following named parsers don't match the column names:
#> accident_severity, carriageway_hazards, date, day_of_week,
#> did_police_officer_attend_scene_of_accident, first_road_class,
#> first_road_number, junction_control, junction_detail, Latitude,
#> light_conditions, local_authority_district, local_authority_highway,
#> local_authority_ons_district, location_easting_osgr, location_northing_osgr,
#> longitude, lsoa_of_accident_location, number_of_casualties, number_of_vehicles,
#> pedestrian_crossing_human_control, pedestrian_crossing_physical_facilities,
#> police_force, road_surface_conditions, road_type, second_road_class,
#> second_road_number, special_conditions_at_site, speed_limit, time,
#> trunk_road_flag, urban_or_rural_area, weather_conditions, age_band_of_casualty,
#> age_of_casualty, bus_or_coach_passenger, car_passenger, casualty_class,
#> casualty_home_area_type, casualty_imd_decile, casualty_reference,
#> casualty_severity, casualty_type, pedestrian_location, pedestrian_movement,
#> pedestrian_road_maintenance_worker, sex_of_casualty, vehicle_text
#> Warning in asMethod(object): NAs introduced by coercion
nrow(vehicles_2022)
#> [1] 193545
ncol(vehicles_2022)
#> [1] 28
The results show that there were
238,926 vehicles involved in crashes reported by the police in the
STATS19 dataset in 2022, with
23 columns (variables). Values for a sample of these columns are
shown below:
vehicles_2022[c(3, 14:16)]
#> # A tibble: 193,545 × 4
#> accident_reference vehicle_leaving_carriageway hit_object_off_carriageway
#> <chr> <chr> <chr>
#> 1 010352073 Did not leave carriageway None
#> 2 010352073 Did not leave carriageway None
#> 3 010352573 Nearside Road sign or traffic signal
#> 4 010352573 Did not leave carriageway None
#> 5 010352575 Did not leave carriageway None
#> 6 010352575 Did not leave carriageway None
#> 7 010352578 Did not leave carriageway None
#> 8 010352578 Did not leave carriageway None
#> 9 010352580 Did not leave carriageway None
#> 10 010352580 Did not leave carriageway None
#> # ℹ 193,535 more rows
#> # ℹ 1 more variable: first_point_of_impact <chr>
The full list of column names in the vehicles dataset
is:
names(vehicles_2022)
#> [1] "accident_index" "accident_year"
#> [3] "accident_reference" "vehicle_reference"
#> [5] "vehicle_type" "towing_and_articulation"
#> [7] "vehicle_manoeuvre" "vehicle_direction_from"
#> [9] "vehicle_direction_to" "vehicle_location_restricted_lane"
#> [11] "junction_location" "skidding_and_overturning"
#> [13] "hit_object_in_carriageway" "vehicle_leaving_carriageway"
#> [15] "hit_object_off_carriageway" "first_point_of_impact"
#> [17] "vehicle_left_hand_drive" "journey_purpose_of_driver"
#> [19] "sex_of_driver" "age_of_driver"
#> [21] "age_band_of_driver" "engine_capacity_cc"
#> [23] "propulsion_code" "age_of_vehicle"
#> [25] "generic_make_model" "driver_imd_decile"
#> [27] "driver_home_area_type" "lsoa_of_driver"
Creating geographic crash data
An important feature of STATS19 data is that the collision table
contains geographic coordinates. These are provided at ~10m resolution
in the UK’s official coordinate reference system (the Ordnance Survey
National Grid, EPSG code 27700). stats19 converts the
non-geographic tables created by format_collisions() into
the geographic data form of the sf package
with the function format_sf() as follows:
crashes_sf = format_sf(crashes_2022)
#> 22 rows removed with no coordinates
The note arises because NA values are not permitted in
sf coordinates, and so rows containing no coordinates are
automatically removed. Having the data in a standard geographic form
allows various geographic operations to be performed on it. Spatial
operations, such as spatial subsetting and spatial aggregation, can be
performed, to show the relationship between STATS19 data and other
geographic objects, such as roads, schools and administrative zones.
An example of an administrative zone dataset of relevance to STATS19
data is the boundaries of police forces in England, which is provided in
the packaged dataset police_boundaries. The following code
chunk demonstrates the kind of spatial operations that can be performed
on geographic STATS19 data, by counting and plotting the number of
fatalities per police force:
library(sf)
library(dplyr)
crashes_sf %>%
filter(accident_severity == "Fatal") %>%
select(n_fatalities = accident_index) %>%
aggregate(by = police_boundaries, FUN = length) %>%
plot()
#> old-style crs object detected; please recreate object with a recent sf::st_crs()
#> old-style crs object detected; please recreate object with a recent sf::st_crs()
#> old-style crs object detected; please recreate object with a recent sf::st_crs()
#> old-style crs object detected; please recreate object with a recent sf::st_crs()
#> old-style crs object detected; please recreate object with a recent sf::st_crs()
#> old-style crs object detected; please recreate object with a recent sf::st_crs()
#> old-style crs object detected; please recreate object with a recent sf::st_crs()
#> old-style crs object detected; please recreate object with a recent sf::st_crs()
#> old-style crs object detected; please recreate object with a recent sf::st_crs()
Of course, one should not draw conclusions from such analyses without
care. In this case, denominators are needed to infer anything about road
safety in any of the police regions. After suitable denominators have
been included, performance metrics such as ‘health risk’ (fatalities per
100,000 people), ‘traffic risk’ (fatalities per billion km, f/bkm) and
‘exposure risk’ (fatalities per million hours, f/mh) can be calculated
(Feleke et al. 2018; Elvik et al.
2009).
The following code chunk, for example, returns all crashes within the
jurisdiction of West
Yorkshire Police:
west_yorkshire =
police_boundaries[police_boundaries$pfa16nm == "West Yorkshire", ]
#> old-style crs object detected; please recreate object with a recent sf::st_crs()
#> old-style crs object detected; please recreate object with a recent sf::st_crs()
crashes_wy = crashes_sf[west_yorkshire, ]
nrow(crashes_sf)
#> [1] 105982
nrow(crashes_wy)
#> [1] 4400
This subsetting has selected the
4,371 crashes which occurred in West Yorkshire.
Joining tables
The three main tables we have just read-in can be joined by shared
key variables. This is demonstrated in the code chunk below, which
subsets all casualties that took place in West Yorkshire, and counts the
number of casualties by severity for each crash:
library(tidyr)
library(dplyr)
sel = casualties_2022$accident_index %in% crashes_wy$accident_index
casualties_wy = casualties_2022[sel, ]
cas_types = casualties_wy %>%
select(accident_index, casualty_type) %>%
group_by(accident_index) %>%
summarise(
Total = n(),
walking = sum(casualty_type == "Pedestrian"),
cycling = sum(casualty_type == "Cyclist"),
passenger = sum(casualty_type == "Car occupant")
)
cj = left_join(crashes_wy, cas_types)
What just happened? We found the subset of casualties that took place
in West Yorkshire with reference to the accident_index
variable. Then we used the dplyr function
summarise(), to find the number of people who were in a
car, cycling, and walking when they were injured. This new casualty
dataset is joined onto the crashes_wy dataset. The result
is a spatial (sf) data frame of crashes in West Yorkshire,
with columns counting how many road users of different types were hurt.
The joined data has additional variables:
base::setdiff(names(cj), names(crashes_wy))
#> [1] "Total" "walking" "cycling" "passenger"
As a simple spatial plot, we can map all the crashes that have
happened in West Yorkshire in 2022, with the colour related to the total
number of people hurt in each crash. Placing this plot next to a map of
West Yorkshire provides context:
plot(
cj[cj$cycling > 0, "speed_limit", ],
cex = cj$Total[cj$cycling > 0] / 3,
main = "Speed limit (cycling)"
)
plot(
cj[cj$passenger > 0, "speed_limit", ],
cex = cj$Total[cj$passenger > 0] / 3,
main = "Speed limit (passenger)"
)
The spatial distribution of crashes in West Yorkshire clearly relates
to the region’s geography. Car crashes tend to happen on fast roads,
including busy Motorway roads, displayed in yellow above. Cycling is as
an urban activity, and the most bike crashes can be found in near Leeds
city centre, which has a comparatively high level of cycling (compared
with the low baseline of 3%). This can be seen by comparing the previous
map with an overview of the area, from an academic paper on the social,
spatial and temporal distribution of bike crashes (Lovelace, Roberts, and Kellar 2016):
In addition to the Total number of people hurt/killed,
cj contains a column for each type of casualty (cyclist,
car occupant, etc.), and a number corresponding to the number of each
type hurt in each crash. It also contains the geometry
column from crashes_sf. In other words, joins allow the
casualties and vehicles tables to be geo-referenced. We can then explore
the spatial distribution of different casualty types. The following
figure, for example, shows the spatial distribution of pedestrians and
car passengers hurt in car crashes across West Yorkshire in 2022:
library(ggplot2)
crashes_types = cj %>%
filter(accident_severity != "Slight") %>%
mutate(type = case_when(
walking > 0 ~ "Walking",
cycling > 0 ~ "Cycling",
passenger > 0 ~ "Passenger",
TRUE ~ "Other"
))
crashes_types$speed_limit = as.integer(crashes_types$speed_limit)
table(crashes_types$speed_limit)
#>
#> 20 30 40 50 60 70
#> 100 848 155 30 75 63
ggplot(crashes_types, aes(size = Total, colour = speed_limit)) +
geom_sf(show.legend = "point", alpha = 0.3) +
facet_grid(vars(type), vars(accident_severity)) +
scale_size(
breaks = c(1:3, 12),
labels = c(1:2, "3+", 12)
) +
scale_color_gradientn(colours = c("blue", "yellow", "red")) +
theme(axis.text = element_blank(), axis.ticks = element_blank())
It is clear that different types of road users tend to get hurt in
different places. Car occupant casualties (labelled ‘passengers’ in the
map above), for example, are comparatively common on the outskirts of
cities such as Leeds, where speed limits tend to be higher and where
there are comparatively higher volumes of motor traffic. Casualties to
people on foot tend to happen in the city centres. That is not to say
that cities centres are more dangerous per unit distance (typically
casualties per billion kilometres, bkm, is the unit used) walked: there
is more walking in city centres (you need a denominator to estimate
risk).
To drill down further, we can find the spatial distribution of all
pedestrian casualties, broken-down by seriousness of casualty, and light
conditions. This can be done with tidyvers functions
follows:
table(cj$light_conditions)
#>
#> Darkness - lighting unknown Darkness - lights lit
#> 81 1136
#> Darkness - lights unlit Darkness - no lighting
#> 40 117
#> Daylight
#> 3026
cj$speed_limit = as.integer(cj$speed_limit)
cj %>%
filter(walking > 0) %>%
mutate(light = case_when(
light_conditions == "Daylight" ~ "Daylight",
light_conditions == "Darkness - lights lit" ~ "Lit",
TRUE ~ "Other/Unlit"
)) %>%
ggplot(aes(colour = speed_limit)) +
geom_sf() +
facet_grid(vars(light), vars(accident_severity)) +
scale_color_continuous(low = "blue", high = "red") +
theme(axis.text = element_blank(), axis.ticks = element_blank())
Time series analysis
We can also explore seasonal and daily trends in crashes by
aggregating crashes by day of the year:
crashes_dates = cj %>%
st_set_geometry(NULL) %>%
group_by(date) %>%
summarise(
walking = sum(walking),
cycling = sum(cycling),
passenger = sum(passenger)
) %>%
gather(mode, casualties, -date)
ggplot(crashes_dates, aes(date, casualties)) +
geom_smooth(aes(colour = mode), method = "loess") +
ylab("Casualties per day")
#> `geom_smooth()` using formula = 'y ~ x'
Different types of crashes also tend to happen at different times of
day. This is illustrated in the plot below, which shows the times of day
when people who were travelling by different modes were most commonly
injured.
library(stringr)
crash_times = cj %>%
st_set_geometry(NULL) %>%
group_by(hour = as.numeric(str_sub(time, 1, 2))) %>%
summarise(
walking = sum(walking),
cycling = sum(cycling),
passenger = sum(passenger)
) %>%
gather(mode, casualties, -hour)
ggplot(crash_times, aes(hour, casualties)) +
geom_line(aes(colour = mode))
Note that bike crashes tend to have distinct morning and afternoon
peaks, in-line with previous research (Lovelace,
Roberts, and Kellar 2016). A disproportionate number of car
crashes appear to happen in the afternoon.
Further work
There is much potential to extend the package beyond downloading,
reading and formatting STATS19 data. The greatest potential is to
provide functions that will help with analysis of STATS19 data, to help
with road safety research. Much academic research has been done using
the data, a few examples of which are highlighted below to demonstrate
the wide potential for further work.
- Research exploring the effectiveness of road safety policies such as
speed limits. An example in this area is this paper on 20 mph
zones who found that areas with 20mph speed limits were safer. This
raises the question: can the same result be repeated using reproducible
methods? Does the finding hold for more recent 20 mph zones? Is the
recent finding of the Department for Transport’s (2018)
research, that 20 mph zones alone do not reduce crash rates, supported
by reproducible analysis? What are the factors that make speed limits
more or less effective (see
sarkar_street_2018? for example)?
- Research into weather as a contributing factor to road traffic
casualties (e.g. Edwards 1998). This
raises the question: could matching crash data from the STATS19 data
with historic weather data from other R packages help advance knowledge
in this area?
- Assessment of crash rates normalised by estimated exposure rates
(risk). An example of this type of research by an author of the package
found substantial spatial variation in the number of cyclist casualties
across West Yorkshire (Lovelace, Roberts, and
Kellar 2016). This raises the questions: are similar spatial
differences found in other regions? What are the factors leading to
relatively high and low rates of different types of crash?
The broader point is that the stats19 package could
help road safety research, by making open access data on road crashes
more accessible to researchers worldwide. By easing the data download
and cleaning stages of research, it could also encourage reproducible
analysis in the field.
There is great potential to add value to and gain insight from the
data by joining the datasets with open data, for example from the
Consumer Data Research Centre (CDRC, which funded this research),
OpenStreetMap and the UK’s Ordnance Survey. If you have any suggestions
on priorities for these future directions of (hopefully safe) travel,
please get in touch on at github.com/ITSLeeds/stats19/issues.
References
Edwards, Julia B. 1998.
“The Relationship Between Road
Accident Severity and Recorded Weather.”
Journal of Safety Research 29 (4): 249–62.
https://doi.org/10.1016/S0022-4375(98)00051-6.
Elvik, Rune, Truls Vaa, Alena Erke, and Michael Sorensen. 2009. The
Handbook of Road Safety Measures. Emerald Group
Publishing.
Feleke, Robel, Shaun Scholes, Malcolm Wardlaw, and Jennifer S. Mindell.
2018.
“Comparative Fatality Risk for Different Travel Modes by
Age, Sex, and Deprivation.” Journal of Transport &
Health 8 (March): 307–20.
https://doi.org/10.1016/j.jth.2017.08.007.
Lovelace, Robin, Hannah Roberts, and Ian Kellar. 2016.
“Who,
Where, When: The Demographic and Geographic Distribution of Bicycle
Crashes in West Yorkshire.” Transportation
Research Part F: Traffic Psychology and Behaviour, Bicycling and
bicycle safety, 41, Part B.
https://doi.org/10.1016/j.trf.2015.02.010.
