You are here

Measuring Uncertainty Qualitatively (MUQ)

The Measuring Uncertainty Qualitatively (MUQ) Working Party is developing reserve uncertainty thinking beyond percentiles and bootstrap style techniques

The 2014 GIROC survey (GIROC UK Reserving Survey 2014) highlighted the wide differences in approaches to measuring and communicating uncertainty in reserves that are currently employed in the UK and identified that this was an area the profession would benefit from focusing on. 

The MUQ working party was set up in the wake of this finding and has undertaken work in two stages.

Outputs:

Stage 1 - Bringing together work that has been done before

Stage 1 was carried out in 2015 and focused on reviewing the various qualitative methods already employed. This work has brought together information on current market practice (both in the UK and around the world) and previous research into one place - please see the reference materials section below.

Stage 2 - Development of a reserve uncertainty framework

Stage 2 commenced in 2016 and used the Stage 1 research to propose ideas for how the measurement of reserve uncertainty could be moved forward in the UK.  As a result, the MUQ working party has proposed a framework for assessing uncertainty beyond statistical techniques. 

The purpose of this framework is to provide actuaries with a best practice approach for thinking about aspects of uncertainty that are not covered by quantitative factors such as percentiles.  This will enable actuaries to take a wider view of uncertainty and identify qualitative issues that may be missed in a purely quantitative approach.  It has been developed with a focus on reserving uncertainty, but the principles could be applied to many other areas of actuarial work.  

Feedback from members of the profession is encouraged to help develop the framework further.  Please send feedback to professional.communities@actuaries.org.uk

For further information, including additional reading, resources on individual framework elements and ideas on how to deal with specific elements of uncertainty, please the ‘Reference Materials’ section below.

Chair Keith Brown
Membership 17
Established 2014

Reference Materials:

Contents

  1. Experience from other countries
    1. Australia
    2. Ireland
  2. Additional resources for framework elements
    1. Internal/Process – Data
    2. Internal/Process – Control Risk
    3. Internal/Process - Communication
    4. Human – Expert Opinion
    5. Statistical – Model risk
  3. Additional useful resources
    1. Beyond ‘Bootstrap’ measures of uncertainty
    2. Previous GIROC papers

1. Experience from other countries

1.1 Australia

1.2 Ireland

2. Additional resources for framework elements

2.1 Internal/Process – Data

  • Data uncertainty matrix - The Forest of Brocéliande has a Knowledge Quality Assessment module, which provides an uncertainty matrix.  This can serve as a high-level qualitative register for data uncertainties in a model and was used to inform the MUQ framework.
  • IAN on data for "CP73" – guidance from the Society of Actuaries in Ireland on questions a Signing Actuary could ask to help form a view on whether data used for providing a Statement of Actuarial Opinion is sufficiently accurate, complete and appropriate.

2.2 Internal/Process – Control Risk

  • S&P GI ERM Rating Criteria – pages 22-25 cover risk controls assessment from a general insurance perspective, where the extent (or level of detail) that this is in place may cause additional (or lower) degree of uncertainty on the reserves.

2.3 Internal/Process - Communication

Language used in communicating uncertainties:

  • The Intergovernmental Panel on Climate Change has various types of reports on climate change demonstrating good use of language: IPCC_summary-for-policymakers

2.4 Human – Expert Opinion

  • Expert judgement elicitation
    • Dr Joseph Lo, Dr Ed Tredger and Bernadette Hlavka discuss the tricks and possible pitfalls when conducting a successful expert judgment elicitation meeting, Article from The Actuary, 2013
  • Uncertain factors surrounding expert judgements:  Expert Judgement WP, 2015
    • Expert judgement process has long been in use in actuarial work, but it has lacked transparency. This paper aims to provide a practical framework regarding expert judgement processes, and how those processes may be validated.

2.5 Statistical – Model risk

  • ‘Ersatz model tests’ – Presented at the 2016 reserving seminar, it looks at ways of testing stochastic models, with an aim to developing deeper understanding of when and why different models are more or less appropriate.

Effectiveness of methods working party

3. Additional useful resources

3.1 Beyond 'Bootstrap' measure of uncertainty

3.2

More information on the work of GIROC.

Related documents

Contact Details

If you want more information about this research working party please contact the Communities Team.

professional.communities@actuaries.org.uk

Filter or search events

Start date
E.g., 23/07/2019
End date
E.g., 23/07/2019

Events calendar

  • Implications of 2019 IFRS 17 Exposure Draft

    Staple Inn Hall, High Holborn, London, WC1V 7QJ
    24 July 2019

    Fully booked.

    The International Accounting Standards Board (IASB) recently published an Exposure Draft (ED) of limited changes to its insurance contracts standard IFRS 17, effective date 2022.

  • Insurance Investment Roundtable with the IFoA & PRA - 25 July 2019

    EY Offices 1 More London Place London, SE1 2AF
    25 July 2019

    Fully booked.

    The IFoA hosts regular roundtable meetings with the PRA on best practice in insurance investment and the application of the Prudent Person Principle, which governs insurance investment under Solvency II.

  • SIAS Event: Climate Zero to Climate Hero

    Staple Inn Hall, High Holborn, London, WC1V 7QJ
    3 September 2019

    Spaces available

    An introductory session to help you get ahead with climate change.

    • Science, terminology and initiatives: handy facts to keep in your back pocket 
    • Getting your point across: how to influence people and avoid common traps and pitfalls
    • Taking action: what are actuaries expected to do...and what are we actually doing?
  • KSS event – The Regulatory Perspective

    Deloitte Saltire Court 20 Castle Terrace Edinburgh EH1 2EG
    5 September 2019

    Spaces available

    This KSS talk, presented by the FCA Head of Department in Scotland, will focus on the following 3 main areas:

    • FCA business plan priorities
    • The future of regulation
    • FCA Engagement in Scotland
  • Sessional Research Event - Risk Margin Working Party

    Staple Inn Hall, High Holborn London, WC1V 7QJ
    9 September 2019

    Spaces available

    For life insurers in the UK, the risk margin is one of the most controversial aspects of the Solvency II regime. Following its implementation, the risk margin came under considerable criticism for being too large and too sensitive to interest rate movements. These criticisms are particularly valid for annuity business – such business is of great significance to the national system for retirement provision. This criticism has led to political interest, and the risk margin was a major element of the Treasury Committee inquiry into Solvency II.

  • GIRO Conference 2019

    EICC, The Exchange, 150 Morrison St, Edinburgh EH3 8EE
    24-26 September 2019
    Spaces available

    GIRO is attended annually by over 800 delegates and speakers who are keen to discuss key topics such as Pricing, Reserving, Modelling and the future of the insurance industry. GIRO 2018 was a huge success and we have opened bookings early for what we hope will be another brilliant conference at the EICC in Edinburgh this year. 

     

  • The Future of the Actuarial Profession

    Staple Inn Hall, High Holborn London WC1V 7QJ
    3 October 2019

    Fully booked.

     

    Three actuaries – and CEOs – discuss their views on how the business world is changing and what that might mean for actuaries in the future.

  • Spaces available

    Have you ever thought about working in wider fields? Would you like to play a role in the fight against climate change to make the planet better? 

    It can be difficult to do this - but seeing an example you can follow can make it more realistic. In this ‘green’ case study a template is outlined to show how actuaries can apply their skills more broadly - and in doing so, to make a difference.

  • Sessional Meeting - Autonomous Vehicles and impacts on the wider insurance industry

    Staple Inn, High Holborn, London WC1V 7QJ         
    28 October 2019

    Spaces available

    The Institute and Faculty of Actuaries is running a sessional meeting on autonomous vehicles on 28th October.  The session will showcase the work of the IFoA “Autonomous Vehicles” working party alongside a number of expert external presenters. 

  • Life Conference 2019

    The Convention Centre Dublin, Spencer Dock, North Wall Quay, Dublin 1
    20-22 November 2019
    Spaces available

    The Life Conference is the premier event for professionals interested in life insurance.  Offering a wide range of workshops and plenary sessions it’s the perfect opportunity to discover what’s hot and current in life insurance ensuring you get up to date on the latest thinking and innovation whilst meeting and exchanging ideas with a broad range of professionals.

  • Autumn Lecture 2019, London - Rt Hon Nicky Morgan MP

    Lincoln's Inn The Treasury Office, London WC2A 3TL
    2 December 2019

    Fully booked.

    The IFoA is pleased to announce that this year’s Autumn Lecture will feature the Rt Hon Nicky Morgan MP as its guest speaker.  Nicky has previously served as Financial Secretary to the Treasury and Minister for Women. She now chairs the Treasury Select Committee whose remit is to examine the expenditure, administration and policy of HM Treasury, along with all of its agencies and associated bodies.

  • Autumn Lecture 2019: Live Streaming

    Webinar 
    2 December 2019

    Spaces available

    Watch the live stream of this year's Autumn Lecture with guest speaker Rt Hon Nicky Morgan MP.