You are here

Measuring Uncertainty Qualitatively (MUQ)

The Measuring Uncertainty Qualitatively (MUQ) Working Party is developing reserve uncertainty thinking beyond percentiles and bootstrap style techniques

The 2014 GIROC survey (GIROC UK Reserving Survey 2014) highlighted the wide differences in approaches to measuring and communicating uncertainty in reserves that are currently employed in the UK and identified that this was an area the profession would benefit from focusing on. 

The MUQ working party was set up in the wake of this finding and has undertaken work in two stages.

Outputs:

Stage 1 - Bringing together work that has been done before

Stage 1 was carried out in 2015 and focused on reviewing the various qualitative methods already employed. This work has brought together information on current market practice (both in the UK and around the world) and previous research into one place - please see the reference materials section below.

Stage 2 - Development of a reserve uncertainty framework

Stage 2 commenced in 2016 and used the Stage 1 research to propose ideas for how the measurement of reserve uncertainty could be moved forward in the UK.  As a result, the MUQ working party has proposed a framework for assessing uncertainty beyond statistical techniques. 

The purpose of this framework is to provide actuaries with a best practice approach for thinking about aspects of uncertainty that are not covered by quantitative factors such as percentiles.  This will enable actuaries to take a wider view of uncertainty and identify qualitative issues that may be missed in a purely quantitative approach.  It has been developed with a focus on reserving uncertainty, but the principles could be applied to many other areas of actuarial work.  

Feedback from members of the profession is encouraged to help develop the framework further.  Please send feedback to professional.communities@actuaries.org.uk

For further information, including additional reading, resources on individual framework elements and ideas on how to deal with specific elements of uncertainty, please the ‘Reference Materials’ section below.

Chair Keith Brown
Membership 17
Established 2014

Reference Materials:

Contents

  1. Experience from other countries
    1. Australia
    2. Ireland
  2. Additional resources for framework elements
    1. Internal/Process – Data
    2. Internal/Process – Control Risk
    3. Internal/Process - Communication
    4. Human – Expert Opinion
    5. Statistical – Model risk
  3. Additional useful resources
    1. Beyond ‘Bootstrap’ measures of uncertainty
    2. Previous GIROC papers

1. Experience from other countries

1.1 Australia

1.2 Ireland

2. Additional resources for framework elements

2.1 Internal/Process – Data

  • Data uncertainty matrix - The Forest of Brocéliande has a Knowledge Quality Assessment module, which provides an uncertainty matrix.  This can serve as a high-level qualitative register for data uncertainties in a model and was used to inform the MUQ framework.
  • IAN on data for "CP73" – guidance from the Society of Actuaries in Ireland on questions a Signing Actuary could ask to help form a view on whether data used for providing a Statement of Actuarial Opinion is sufficiently accurate, complete and appropriate.

2.2 Internal/Process – Control Risk

  • S&P GI ERM Rating Criteria – pages 22-25 cover risk controls assessment from a general insurance perspective, where the extent (or level of detail) that this is in place may cause additional (or lower) degree of uncertainty on the reserves.

2.3 Internal/Process - Communication

Language used in communicating uncertainties:

  • The Intergovernmental Panel on Climate Change has various types of reports on climate change demonstrating good use of language: IPCC_summary-for-policymakers

2.4 Human – Expert Opinion

  • Expert judgement elicitation
    • Dr Joseph Lo, Dr Ed Tredger and Bernadette Hlavka discuss the tricks and possible pitfalls when conducting a successful expert judgment elicitation meeting, Article from The Actuary, 2013
  • Uncertain factors surrounding expert judgements:  Expert Judgement WP, 2015
    • Expert judgement process has long been in use in actuarial work, but it has lacked transparency. This paper aims to provide a practical framework regarding expert judgement processes, and how those processes may be validated.

2.5 Statistical – Model risk

  • ‘Ersatz model tests’ – Presented at the 2016 reserving seminar, it looks at ways of testing stochastic models, with an aim to developing deeper understanding of when and why different models are more or less appropriate.

Effectiveness of methods working party

3. Additional useful resources

3.1 Beyond 'Bootstrap' measure of uncertainty

3.2

More information on the work of GIROC.

Related documents

Contact Details

If you want more information about this research working party please contact the Communities Team.

professional.communities@actuaries.org.uk

Filter or search events

Start date
E.g., 19/09/2019
End date
E.g., 19/09/2019

Events calendar

  • KSS event – The Future of the Actuarial Profession with Alan Watson

    Willis Towers Watson 2 Lochrin Square, 96 Fountainbridge, Edinburgh EH3 9QA
    23 September 2019

    Spaces available

    This KSS talk will explore how the Actuarial Profession is changing by looking at the past, the current and the future; considering what will be the key issues impacting the Profession over the next 20 years and why this will be different from today. Why will areas like data science be important?  What does the future hold for reserved roles? What impact will the Profession have on other professionals?  And much more!

  • GIRO Conference 2019

    EICC, The Exchange, 150 Morrison St, Edinburgh EH3 8EE
    24-26 September 2019
    Spaces available

    GRIO 2019

  • Career Event - Count Me In, Edinburgh

    Heriot-Watt University, Edinburgh, EH14 4AS
    2 October 2019

    Spaces available

    Join us and leading actuarial employers at our free Count Me In STEM careers event in Edinburgh organised by the IFoA.

    Find out more about a range of rewarding careers in actuarial science and how we are supporting and promoting diversity in the profession. 

  • The Future of the Actuarial Profession

    Staple Inn Hall, High Holborn London WC1V 7QJ
    3 October 2019

    Fully booked.

     

    Three actuaries – and CEOs – discuss their views on how the business world is changing and what that might mean for actuaries in the future.

  • Spaces available

    Have you ever thought about working in wider fields? Would you like to play a role in the fight against climate change to make the planet better? 

    It can be difficult to do this - but seeing an example you can follow can make it more realistic. In this ‘green’ case study a template is outlined to show how actuaries can apply their skills more broadly - and in doing so, to make a difference.

  • RSS/IFoA Data Science Ethics: the role of practitioners

    Royal Statistical Society, 12 Errol St, London EC1Y 8LX
    7 October 2019

    Spaces available

    The Institute and Faculty of Actuaries and the Royal Statistical Society have worked together to develop joint ethics guidance on data science. This is the culmination of an 18 month programme of practitioner led work. 
     
    Join us for the launch of this new guidance, with a high-level panel discussion which will explore the role of data science practitioners and professional bodies in data ethics. 

  • SIAS Event: AGM and talk on a Monetary Approach to Economics

    Staple Inn Hall. High Holborn, London, WC1V 7QJ
    8 October 2019

    Spaces available

    The SIAS Annual General Meeting will commence at 5.45pm and be followed by a talk given by the well known economist and author, Steve Keen, at 6pm. A live webinar will be available. 

  • Career Event - Count Me In

    Staple Inn Hall, High Holborn, London, WC1V 7QJ
    10 October 2019

    Spaces available

    Join us and leading actuarial employers at our free Count Me In STEM careers event in London organised by the IFoA.

    Find out more about a range of rewarding careers in actuarial science and how we are supporting and promoting diversity in the profession. 

  • KSS Event – GAD: the 100 year life (Edinburgh)

    KPMG  Saltire Court 20 Castle Terrace Edinburgh EH1 2EG
    22 October 2019

    Spaces available

    The Government Actuary’s Department (GAD) marks its centenary this year. George Russell, formerly Deputy Government Actuary, who currently heads up GAD’s Edinburgh office, leading on GAD support to the devolved administrations in Scotland and Northern Ireland, will outline GAD’s development over that period and its range of work today. Having just “celebrated” his 25th anniversary of joining GAD, George will also reflect on some of the challenges and opportunities of advising at the interface of the actuarial and the political worlds.

  • KSS Event – Equity Release Mortgages: The Irish Experience

    Room CM S.01 (Second floor, Colin Maclaurin Building, building 22 on the campus map.) Campus maps can be found at https://www.hw.ac.uk/uk/edinburgh/map.htm
    23 October 2019

    Spaces available

    This is a co-branded KSS/Heriot-Watt University event.  Equity release mortgages (ERMs), also called lifetime mortgages, have played an increasing role in generating income for retired home-owners.  As new liquidity rules have reduced the supply of bank lending, so insurers have stepped in, encouraged by generous regulatory treatment for annuity writers.

  • KSS event – GAD: the 100 year life (Glasgow)

    Barnett Waddingham 163 West George Street, Glasgow, G2 2JJ
    24 October 2019

    Spaces available

    The Government Actuary’s Department (GAD) marks its centenary this year. George Russell, formerly Deputy Government Actuary, who currently heads up GAD’s Edinburgh office, leading on GAD support to the devolved administrations in Scotland and Northern Ireland, will outline GAD’s development over that period and its range of work today. Having just “celebrated” his 25th anniversary of joining GAD, George will also reflect on some of the challenges and opportunities of advising at the interface of the actuarial and the political worlds.

  • Sessional Meeting - Autonomous Vehicles and impacts on the wider insurance industry

    Staple Inn, High Holborn, London WC1V 7QJ         
    28 October 2019

    Spaces available

    The Sessional Meeting is now fully booked.

    Please click here to register on the waiting list.

     

    The Institute and Faculty of Actuaries is running a sessional meeting on autonomous vehicles on 28th October.  The session will showcase the work of the IFoA “Autonomous Vehicles” working party alongside a number of expert external presenters. 

  • ARC Event: Beyond Proportional Hazards

    Staple Inn Hall, High Holborn, London, WC1V 7QJ
    30 October 2019

    Spaces available

    ARC Event: Beyond Proportional Hazards: Statistical methods for assessment of the impact of medical advances and health interventions on longevity and population projections.

    This workshop is being delivered by the Actuarial Research Centre’s (ARC) ‘Big Health and Actuarial Data’ Research Programme.

  • Hot Topics in Health and Care: Networking and Drinks

    Staple Inn, 4 High Holborn, London WC1V 6DR
    4 November 2019

    Spaces available

    This evening will feature two new cases studies that highlight the implications for insurers of issues impacting on health and mortality for life, pensions, and health and care products; Impactability modelling: a worked example in Type II diabetes presented by Josephine Robertson, and Seasonal Mortality in England and Wales 1993-2016 presented by Mary Hall, Dublin City University.

  • SIAS Event: Introduction to the Mortality Research Steering Committee (MRSC)

    Staple Inn Hall, High Holborn, London, WC1V 7QJ
    5 November 2019

    Spaces available

    The MRSC is responsible for guiding the profession’s research in the areas of longevity, mortality and morbidity such that it is recognised as a thought leader in this area. It has recently been reviewing what the priorities and have identified 6 areas that we believe are the most important areas of research that should be the current focus and these are:

  • IFoA CPD Co-ordinators' Briefing

    Staple Inn Hall, High Holborn London WC1V 7QJ
    7 November 2019

    Spaces available

    The theme of this year’s annual briefing is: Lifelong Learning – providing continuous development for our members.

    This event is primarily for volunteer CPD Co-ordinators, who attend to represent their organisation. CPD Co-ordinators play a key role in effective engagement between organisations who employ our members and the Institute and Faculty of Actuaries (IFOA).

  • The challenges for AI in Autonomous driving – Professor Andrew Blake

    Royal College of Physicians of Edinburgh, 11 Queen Street, Edinburgh, EH2 1JQ
    11 November 2019

    Spaces available

    In conjunction with the Scottish Board and supporting the IFoA’s focus on data science.

    The IFoA’s Scottish Board have arranged for UK pioneer in Computer Vision and Machine Intelligence, Professor Andrew Blake to speak to delegates on the subject of AI in Autonomous driving. This lecture will focus on safety-critical operation and the computation of risk.  

  • Autumn Pension Seminar

    Grand Connaught Rooms, 61-65 Great Queen St, Holborn, London WC2B 5DA
    13 November 2019

    Spaces available

    Join us for this brand new seminar that brings together our Current Issues in Pensions, Pensions and the Law, and Investment for Pension Actuaries events. The seminar builds on the IFoA’s Annual Pension Conference with sessions covering CDC, TPR’s code of practice, investments, legal updates and Professional Skills Training with a focus on interactive discussion throughout.

  • KSS event: How is Scotland’s population changing and what are the implications?

    Barnett Waddingham, 163 West George Street, Glasgow, G2 2JJ
    14 November 2019

    Spaces available

    The National Records of Scotland (NRS) collects, preserves and produces information about Scotland's people and history to inform current and future generations - work that underpins the fabric of Scottish society and tells the story of our nation. This KSS talk will explore the following and other areas impacting Scotland’s changing population, and assess the potential implications of the changes:

    • population statistics
    • life expectancy
    • changes in age structure
    • birth and death rates, including causes of death statistics.
  • Life Conference 2019

    The Convention Centre Dublin, Spencer Dock, North Wall Quay, Dublin 1
    20-22 November 2019
    Spaces available

    The Life Conference is the premier event for professionals interested in life insurance.  Offering a wide range of workshops and plenary sessions it’s the perfect opportunity to discover what’s hot and current in life insurance ensuring you get up to date on the latest thinking and innovation whilst meeting and exchanging ideas with a broad range of professionals.

  • ARC Workshop: Modelling Socio-Economic Differences in English Mortality

    Staple Inn Hall, High Holborn, London, WC1V 7QJ
    2 December 2019

    Spaces available

    Purpose
    The workshop will give participants detailed insights into how a large and detailed dataset can be used to assess levels of mortality inequality in England, using a number of novel statistical methods. We will also address the question: are regional variations in mortality real or imaginary?

  • Autumn Lecture 2019, London - Rt Hon Nicky Morgan MP

    Lincoln's Inn The Treasury Office, London WC2A 3TL
    2 December 2019

    Fully booked.

    The IFoA is pleased to announce that this year’s Autumn Lecture will feature the Rt Hon Nicky Morgan MP as its guest speaker.  Nicky has previously served as Financial Secretary to the Treasury and Minister for Women. She now chairs the Treasury Select Committee whose remit is to examine the expenditure, administration and policy of HM Treasury, along with all of its agencies and associated bodies.

  • Autumn Lecture 2019: Live Streaming

    Webinar 
    2 December 2019

    Spaces available

    Watch the live stream of this year's Autumn Lecture with guest speaker Rt Hon Nicky Morgan MP. 

  • Behavioural Finance Research Launch- 14 January 2020

    Staple Inn, 4 High Holborn, Holborn, London WC1V 6DR
    14 January 2020

    Fully booked.

    We are delighted to announce the launch of the findings from our ARC funded Behavioural Finance research with a special evening event at Staple Inn on Tuesday 14th January 2020. Entitled Behavioural Aspects of Institutional Investment Decision-Making, this research programme is being delivered by City, University of London, Leeds University Business School and Ipsos.

    This event is now full. Please register for the waiting list.

  • Sessional: Impact of E-cigarettes Working Party

    Royal College of Physicians, 9 Queen St, Edinburgh EH2 1JQ
    24 February 2020

    Spaces available

    This sessional meeting will be of direct interest to actuaries and others working in the in the Health and Care, Life or Pensions sectors or indeed actuaries with an interest in morbidity or mortality.