Quality report for contextual information in Wellbeing of Wales 2018-19

The links provide details such as coverage, and strength and limitations of the data, and also the processes used to produce and publish the datasets behind the statistics quoted in the progress report.

Whilst most of the narrative in the Wellbeing of Wales report is drawn from national indicators, some of the contextual data is from other official statistics or other statistics and factual statements related to specific policies or programmes, where we have considered it relevant to the overall narrative.

The data not collected through official statistics sources are used in the Wellbeing for Wales report for context, but we cannot always provide assurance about data quality. As the data in the progress report have been sourced from a variety of datasets, the level of quality information available will differ in each case. Where the original data sources have detailed quality reports, we have provided links to those reports. Where quality reports do not exist for a source, additional information, where available, has been included in this document.

The 'Quality report for the National Indicators', which can be found on the Wellbeing of Wales webpages, contains information about the quality of the data used for the indicators. Therefore, those data sources are not covered in this document.

Adult lifestyle: National Survey for Wales (Welsh Government)

Data on healthy lifestyle behaviours among adults are taken from the National Survey for Wales. Adult lifestyle (National Survey for Wales): April 2018 to March 2019

Wales bathing water reports (Natural Resources Wales)

Information on quality and methodology can be found on the Natural Resources Wales’ bathing water quality page. These data are not published as official statistics.

Biodiversity: National Survey for Wales (Welsh Government)

See the National Survey technical report and quality report for more information on the survey methodology and data quality. These data are published as National Statistics

Births (Office for National Statistics (ONS))

Births summary tables, England and Wales: 2018 on the ONS website

See the Births QMI published by ONS for further information on quality and methodology. These data are published as official statistics.

Cancer survival in Wales (Public Health Wales)

See the Quality Assurance document on the Public Health website for further information on quality and methodology. These data are published as official statistics.

Carrier bag reuse: National Survey for Wales (Welsh Government)

Data on carrier bag use are taken from the National Survey for Wales. See the National Survey technical report and quality report for more information on the survey methodology and data quality. These data are published as National Statistics.

Changing trends in mortality (Office for National Statistics)

Unless otherwise indicated, sources use figures from the Office for National Statistics’ Health state life expectancies data. These are published as National Statistics. See the Health state life expectancies, UK QMI on the ONS website for further information on quality and methodology.

Deaths from selected causes, counts and age standardised rates, by sex, Wales, 2001 to 2016, ONS. See the Quality and methodology section included in the notes for more information.

Health state life expectancies, UK: 2015 to 2017, ONS

Health state life expectancies by national deprivation deciles, England and Wales: 2015 to 2017, ONS

Public Health Outcomes Framework for Wales reporting tool, Public Health Wales Observatory

Data on life expectancy at birth by deprivation quintile and rurality is presented using data from WIMD 2014 (Welsh Government), Public Health Mortality (ONS), Mid-year estimates (ONS) and Rural-Urban Classification (ONS). Quality information can be found in Technical guide for the Public Health Wales reporting tool.

Recent Trends in Mortality in England, Public Health England. This report summarises the findings of the Department of Health and Social Care’s (DHSC) commission to Public Health England to review official data to understand trends in life expectancy and mortality in England. Quality information can be found in the individual releases referenced in the report.

Socioeconomic inequalities in avoidable mortality, England and Wales: 2001 to 2017, ONS. See the 'Glossary', 'Measuring these data' and 'Strengths and Limitations' sections of the report for more information. These data are published as National Statistics.

Children's Omnibus Survey (Arts Council for Wales)

See the 'Methodology' section of the 2017 Children's Omnibus Survey (Arts Council Wales) for more information about the survey methodology. These data are published as official statistics. Please note that the survey is not currently available online, but is available from the Arts Council for Wales on request.

Climate change concern: National Survey for Wales (Welsh Government)

Data on attitudes towards climate change are taken from the National Survey for Wales. See the National Survey technical report and quality report for more information on the survey methodology and data quality. These data are published as National Statistics.

Crime in England and Wales (Office for National Statistics)

Unless otherwise indicated, sources use figures from the Office for National Statistics’ Crime Survey for England and Wales data, which are covered in Chapter 2 of the Crime Statistics User Guide (ONS). In these sources, the download ZIP contains a CSEW Open Table instructions document with more information on definitions.

Statistics based on police-recorded crime do not meet the definition of National Statistics. A full assessment report on Statistics on Crime in England and Wales can be found on the UK Statistics Authority website.

The Office for National Statistics have complied a data quality framework to help inform users about the quality of crime statistics for different types of crime. This can be found in Chapter 5 of the User Guide (ONS).

See the Crime in England and Wales QMI (ONS) for more information on the quality and methodology.

Perceptions Other data tables, Crime Survey for England and Wales, ONS

Personal Crime Incidence, Crime Survey for England and Wales, ONS

Personal Crime Prevalence, Crime Survey for England and Wales, ONS

Recorded crime data at Police Force Area level, ONS and Crime in England and Wales: Police Force Area data tables, ONS. These data are used as part of Crime in England and Wales: year ending March 2019 (ONS). The Crime Statistics User Guide (ONS) contains more information on the context of these statistics.

Deaths of homeless people in England and Wales (Office for National Statistics)

See the Quality and methodology section of the Deaths of homeless people in England and Wales, local authority estimates: 2013 to 2017 (ONS) release for more information. These data are published as experimental statistics.

Deaths related to drug poisoning in England and Wales (Office for National Statistics)

Deaths related to drug poisoning in England and Wales, 2018 registrations (ONS). See the Deaths related to drug poisoning in England and Wales QMI (ONS) for more information. These data are published as National Statistics.

Equality and diversity statistics (Welsh Government)

Equality and diversity statistics, 2015 to 2017

Data is taken from the Annual Population Survey (APS). The Annual Population Survey (APS) samples around 18,000 households in Wales every year. However, the sample sizes for people with ‘protected characteristics’ (as specified in the Equality Act 2010) can be relatively small. Therefore, to improve the evidence base on people with ‘protected characteristics’, more detailed analysis has been produced from a pooled dataset which combines 3 years of APS data.

As the data came from a survey, the results are sample-based estimates and therefore subject to differing degrees of sampling variability, i.e. the true value for any measure lies in a differing range about the estimated value. This range or sampling variability increases as the detail in the data increases, for example local authority data are subject to higher variability than regional data.

Estimating the mortality burden of air pollution in Wales (Public Health Wales)

See the Methods section of the Estimating the Mortality Burden of Air Pollution in Wales paper (Public Health Wales) for more information on methodology and quality.

Fair work: Skills and Employment Survey, Work in Wales (Welsh Government)

Information on methodology can be found in the Methodology section of the Skills and Employment Survey: Work in Wales, 2006 to 2017 report, and further technical information is available in the appendices. These data are not published as official statistics.

Food poverty: National Survey for Wales (Welsh Government)

National Survey for Wales headline results: April 2018 to March 2019

See the National Survey technical report and quality report for more information on the survey methodology and data quality. These data are published as National Statistics.

Fuel poverty: Welsh Housing Conditions Survey (Welsh Government)

See the quality information in the Fuel poverty estimates for Wales (headline results): 2018 release for more information on quality and methodology. These data are published as National Statistics.

Green Space Index (Fields in Trust)

See the Green Space Index technical notes (Fields in Trust) for more information on quality on methodology. These data are not published as official statistics.

Historical assets at risk (Cadw)

Data on scheduled monuments and listed buildings classified 'at risk' are supplied by Cadw. These data are not published as official statistics.

For scheduled monuments, data is collected through the Monuments at Risk survey, which is part of Cadw’s Scheduled Monument Monitoring Plan.

For information about listed buildings, see Managing Listed Buildings at Risk in Wales (Cadw).

Homelessness statistics (Welsh Government)

See the quality report accompanying this release for more information on quality and methodology. These data are published as National Statistics.

Immigration statistics (Home Office)

These are published as National Statistics. Please see the notes sections of the Immigration statistics table as 16q/20q (Home Office) for information on quality and methodology.

Job satisfaction: National Survey for Wales (Welsh Government)

Please see the National Survey technical report and quality report for more information on the survey methodology and data quality. These data are published as National Statistics.

Marriages in England and Wales (Office for National Statistics)

See the Quality and Methodology section of the Marriages in England and Wales, 2016 report (ONS), and the Marriages in England and Wales QMI (ONS) for more information. These data are published as National Statistics.

Maternity Statistics (Welsh Government)

See the Quality information section of Maternity Statistics, Wales 2017-18 for more information. These data are published as experimental statistics.

Measuring inequalities (Public Health Wales)

See the Technical Guide document accompanying the Measuring Inequalities 2016 report (Public Health Wales) for further guidance on how to interpret the figures, their limitations, and the methods and data sources used.

Modern slavery and human trafficking (National Crime Agency)

National Referral Mechanism Statistics End of Year Summary 2018 (National Crime Agency)

These are administrative data produced by the National Crime Agency who manage the National Referral Mechanism (NRM) for identifying victims of human trafficking or modern slavery. These data are not published as official statistics.

This report does not provide an analysis of the picture of modern slavery in the UK. It provides figures retailing to the number of potential victims that have been referred in to the NRM process. There are issues in terms of comparing referrals year on year due to changes in reporting mechanisms. Increased referrals may not indicate greater incidence of modern slavery or human trafficking.

In recent years there have been changes in how the data are recorded, which was probably partly the cause of the increase of referrals.

See the National Crime Agency website for more information about the National Referral Mechanism and how referrals are made to the National Crime Agency.

National Bat Monitoring Programme (Bat Conservation Trust)

These data are published as official statistics. The beginning of the National Bat Monitoring Programme Annual Report (Bat Conservation Trust) has information on the quality, methodology and survey design.

National diet and nutrition survey, Public Health England

For quality and methodology information, see the individual National Diet and Nutrition Survey reports (Public Health England).

National rough sleeper count (Welsh Government)

See the methodology and coverage and Quality information sections of the National rough sleeper count release for more information on quality and methodology. These data are published as official statistics.

On-entry assessments of pupils in reception class (Welsh Government)

See the On-entry assessments of pupils in reception class: September 2017 to August 2018 notes document for more information. These data are published as official statistics.

Overseas higher education students (Welsh Government analysis of Higher Education Statistics Agency (HESA) data)

More information is available in the HESA Student Record quality report. These data are published as National Statistics.

Personal and economic wellbeing (Office for National Statistics)

See the Quality and methodology section of the Personal and economic wellbeing: what matters most to our life satisfaction? (ONS) release for more information. These data are not published as National Statistics.

Personal wellbeing in the UK (Office for National Statistics)

Personal well-being in the UK: July 2017 to June 2018 (ONS)

See the Personal well-being in the UK QMI (ONS) for further information on data quality and methodology of the survey. These data are published as National Statistics.

Public Appointments Annual Report (The Commissioner for Public Appointments)

The Public Appointments Annual Report (The Commissioner for Public Appointments) provides data on the performance of government departments in recruiting to fill public appointments and take account of the contents of both the Governance Code and the Order in Council 2016. The data was gathered through departmental audits. More information can be found in the Performance Report section of the Annual Report. These data are not published as official statistics.

Regional and sub-regional productivity in the UK (Office for National Statistics)

See the Quality and methodology section of the Regional and sub-regional productivity in the UK: February 2019 (ONS) release for more information. These data are published as experimental statistics.

Regional labour market statistics in the UK (Office for National Statistics)

See the Quality and methodology section of the Labour market in the regions of the UK Statistical bulletins (ONS) for more information. As well as the Labour Force Survey Quality and Methodology Information document (ONS). These data are published as National Statistics.

Sports and Active Lifestyles (Sports Wales)

The Sports and Active Lifestyles surveys (Sports Wales) are now based on data from the National Survey for Wales. See the National Survey technical report and quality report for more information on the survey methodology and data quality. These data are published as official statistics.

State of Birds in Wales (British Trust for Ornithology(BTO))

The State of Birds in Wales 2018 (British Trust for Ornithology) was produced collaboratively by the British Trust for Ornithology (BTO), the Welsh Ornithological Society (WOS), Natural Resources Wales (NRW) and the Royal Society for the Protection of Birds (RSPB). The report uses evidence gained from monitoring schemes in Wales, undertaken by both specialists and volunteers, as well as structured surveys and other sources. The report also provides the highlights from an analysis of Wales-specific measures of range, change in range and change in relative abundance using data from the British Trust for Ornithology (BTO)/BirdWatch Ireland/Scottish Ornithologists’ Club (SOC) Bird Atlas 2007 to 2011. These data are not published as National Statistics.

State of Natural Resources Report (Natural Resources Wales)

The State of Natural Resources Report 2016 is created by Natural Resources Wales. These data are not published as official statistics. However Natural Resources Wales assign each piece of information a confidence assessment, which is recorded in an annex. The ratings are High (H), Medium (M) and Low (L).The methodology for assigning confidence assessments is explained in another annex (Natural resources Wales).

More information on the data behind the statements in Chapter 3 is available in The State of Natural Resources Report (SoNaRR): Assessment of the Sustainable Management of Natural Resources. Annex Technical Annex for Chapter 3 (Natural Resources Wales).

The confidence assessments for the data used in the Wellbeing report are:

Total carbon in soil (medium): Page 24 Assessment of the Sustainable Management of Natural Resources. Technical Report. Chapter 3. Summary of extent, condition and trends of natural resources and ecosystems in Wales (Natural Resources Wales) 

Ecosystem resilience (medium): Page 23 Assessment of the Sustainable Management of Natural Resources. Technical Report. Chapter 4. Resilient Ecosystems (Natural Resources Wales)

Suicide data (Office for National Statistics) 

See the Suicide Rates in the UK QMI (ONS) for more information. These data are not published as official statistics.

Suicide in Wales, ONS

Suicides in the UK: 2018 registrations, ONS

Trade Union Statistics (Department for Business, Energy & Industrial Strategy (BEIS))

See the Technical note in the annex of the Trade union statistics bulletin (BEIS) for more information on quality and methodology. These data are published as National Statistics.

Transport Statistics Great Britain (Department for Transport(DfT))

Information about the transport statistics can be found on the Transport Statistics Great Britain information page (DfT). The out-commuting statistics are sourced from the Labour Force Survey.

Labour Force Survey performance and quality monitoring reports (ONS)

Labour Force Survey: user guidance (ONS)

These data are published as National Statistics.

UNESCO World Heritage List (UNESCO)

The information in the report is based on the number of sites being given World Heritage status. There is also a section explaining the List of World Heritage in Danger. These data are not published as official statistics.

World Heritage List (UNESCO)

Global Strategy (UNESCO)

World Heritage in Danger (UNESCO)

Ultra-low emissions vehicles (Department for Transport(DfT))

See the Notes and definitions document on the Vehicles statistics information page (DfT) for more information on quality and methodology. These are published as National Statistics.

Vaccine update in children in Wales (Public Health Wales)

National immunisation uptake data (Public Health Wales)

Vaccination uptake data are provided by the Public Health Wales national COVER scheme. These data are not published as Official Statistics. This surveillance scheme, which is run by the Public Health Wales Vaccine Preventable Disease Programme (VPDP) and Communicable Disease Surveillance Centre (CDSC), calculates vaccine coverage using data from National Community Child Health Database (NCCHD). The NCCHD is maintained by NHS Wales Information Service (NWIS) and is comprised of extracted records of all health board Child Health office database across Wales. The NCCHD is refreshed on a quarterly basis.

The denominator of uptake calculations used in the annual COVER report is the number of children registered with Child Health offices who reached key measurement birthdays during the April to march year and were living and resident in Welsh health boards as at the end of this period. Children are deemed to be vaccinated by a measurement age if they have a documented vaccination date in their child health record, which is before the relevant birthday.

Data quality within the NCCHD may diminish for older children who receive less frequent contact from health care professionals, and whose child health records may be updated less frequently.

Welsh Baccalaureate (Welsh Joint Education Committee(WJEC))

Welsh Baccalaureate National/Foundation Skills Challenge Certificate (WJEC)

This data was provided by WJEC on request. Please contact WJEC for further information on quality and methodology. These data are not published as official statistics.

Welsh Housing Quality Standard (Welsh Government)

Welsh Housing Quality Standard: as at 31 March 2018

See the Welsh Housing Quality Standard quality report for further information on quality and methodology. These data are published as official statistics.

Welsh language data from the Annual Population Survey (Welsh Government)

See the Quality Information section of the Welsh language data from the Annual Population Survey: 2001 to 2018 bulletin for more information on quality and methodology. These data are published as National Statistics.