You are here

Measuring Uncertainty Qualitatively (MUQ)

The Measuring Uncertainty Qualitatively (MUQ) Working Party is developing reserve uncertainty thinking beyond percentiles and bootstrap style techniques

The 2014 GIROC survey (GIROC UK Reserving Survey 2014) highlighted the wide differences in approaches to measuring and communicating uncertainty in reserves that are currently employed in the UK and identified that this was an area the profession would benefit from focusing on. 

The MUQ working party was set up in the wake of this finding and has undertaken work in two stages.

Outputs:

Stage 1 - Bringing together work that has been done before

Stage 1 was carried out in 2015 and focused on reviewing the various qualitative methods already employed. This work has brought together information on current market practice (both in the UK and around the world) and previous research into one place - please see the reference materials section below.

Stage 2 - Development of a reserve uncertainty framework

Stage 2 commenced in 2016 and used the Stage 1 research to propose ideas for how the measurement of reserve uncertainty could be moved forward in the UK.  As a result, the MUQ working party has proposed a framework for assessing uncertainty beyond statistical techniques. 

The purpose of this framework is to provide actuaries with a best practice approach for thinking about aspects of uncertainty that are not covered by quantitative factors such as percentiles.  This will enable actuaries to take a wider view of uncertainty and identify qualitative issues that may be missed in a purely quantitative approach.  It has been developed with a focus on reserving uncertainty, but the principles could be applied to many other areas of actuarial work.  

Feedback from members of the profession is encouraged to help develop the framework further.  Please send feedback to professional.communities@actuaries.org.uk

For further information, including additional reading, resources on individual framework elements and ideas on how to deal with specific elements of uncertainty, please the ‘Reference Materials’ section below.

Chair Keith Brown
Membership 17
Established 2014

Reference Materials:

Contents

  1. Experience from other countries
    1. Australia
    2. Ireland
  2. Additional resources for framework elements
    1. Internal/Process – Data
    2. Internal/Process – Control Risk
    3. Internal/Process - Communication
    4. Human – Expert Opinion
    5. Statistical – Model risk
  3. Additional useful resources
    1. Beyond ‘Bootstrap’ measures of uncertainty
    2. Previous GIROC papers

1. Experience from other countries

1.1 Australia

1.2 Ireland

2. Additional resources for framework elements

2.1 Internal/Process – Data

  • Data uncertainty matrix - The Forest of Brocéliande has a Knowledge Quality Assessment module, which provides an uncertainty matrix.  This can serve as a high-level qualitative register for data uncertainties in a model and was used to inform the MUQ framework.
  • IAN on data for "CP73" – guidance from the Society of Actuaries in Ireland on questions a Signing Actuary could ask to help form a view on whether data used for providing a Statement of Actuarial Opinion is sufficiently accurate, complete and appropriate.

2.2 Internal/Process – Control Risk

  • S&P GI ERM Rating Criteria – pages 22-25 cover risk controls assessment from a general insurance perspective, where the extent (or level of detail) that this is in place may cause additional (or lower) degree of uncertainty on the reserves.

2.3 Internal/Process - Communication

Language used in communicating uncertainties:

  • The Intergovernmental Panel on Climate Change has various types of reports on climate change demonstrating good use of language: IPCC_summary-for-policymakers

2.4 Human – Expert Opinion

  • Expert judgement elicitation
    • Dr Joseph Lo, Dr Ed Tredger and Bernadette Hlavka discuss the tricks and possible pitfalls when conducting a successful expert judgment elicitation meeting, Article from The Actuary, 2013
  • Uncertain factors surrounding expert judgements:  Expert Judgement WP, 2015
    • Expert judgement process has long been in use in actuarial work, but it has lacked transparency. This paper aims to provide a practical framework regarding expert judgement processes, and how those processes may be validated.

2.5 Statistical – Model risk

  • ‘Ersatz model tests’ – Presented at the 2016 reserving seminar, it looks at ways of testing stochastic models, with an aim to developing deeper understanding of when and why different models are more or less appropriate.

Effectiveness of methods working party

3. Additional useful resources

3.1 Beyond 'Bootstrap' measure of uncertainty

3.2

More information on the work of GIROC.

Related documents

Contact Details

If you want more information about this research working party please contact the Communities Team.

professional.communities@actuaries.org.uk

Filter or search events

Start date
E.g., 23/06/2019
End date
E.g., 23/06/2019

Events calendar

  • SIAS Event: Navigating Organisational Politics Positively

    Staple Inn Hall, High Holborn, London, WC1V 7QJ
    3 June 2019

    Spaces available

    The term 'office politics' usually has a lot of negative connotations and indeed an inability to be able to navigate an organisation's formal processes and interact effectively with others at work can have far reaching adverse consequences.

  • Spaces available

    Public scrutiny of what investment funds deliver for consumers continues to be high profile, with the FCA’s Asset Management Market Study requiring fund managers to make (and publish) an annual assessment of value for authorised funds from the end of 2019.

  • Reimagining ageing

    Staple Inn Hall, High Holborn London WC1V 7Q
    14 June 2019

    Spaces available

    Reimagining ageing, hosted by the Institute and Faculty of Actuaries, in partnership with the ILC

  • Spaces available

    Increasing global concern over the impact of climate change has recently led to public scrutiny over the adequacy of existing risk management practices by insurance firms and pension schemes in dealing with these challenges, that potentially impact both individual actuaries and the IFOA generally.

     

  • Pensions Conference 2019

    Bristol Marriott Hotel City Centre, 2 Lower Castle Street, Old Market, Bristol, BS1 3AD
    18-19 June 2019
    Spaces available

    Covering current topics and industry trends, the conference also includes a pre-conference evening dinner (18 June) giving you the opportunity to develop your network. 

  • KSS event – FinTech and The Actuarial Profession

    EY, Atria One, 144 Morrison Street, Edinburgh
    19 June 2019

    Spaces available

    This KSS talk from FinTech Scotland's CEO will explore the mission to create an integrated Fintech ecosystem through provision of funding, support, infrastructure and talent that recognises and responds to the needs of all stakeholders - and the overarching aim for Scotland to be one of the top 5 Fintech global leaders by 2020.

    To book your place, please email Barry_Shannon@standardlife.com 

  • Current Issues in General Insurance (CIGI) 2019

    Inmarsat, 99 City Road, London, EC1Y 1BJ
    19 June 2019

    Spaces available

    CIGI is a well-established one-day seminar designed to increase awareness and encourage discussion on a variety of topical issues across the general insurance industry. 

    There will be an excellent and diverse line-up of speakers to provide a variety of perspectives and challenge covering technical and professional areas. 

  • Cass Event – New Thinking about Deferred Annuities

    Cass Business School, Executive Education Facilities 200 Aldersgate St, London EC1A 4HD
    21 June 2019

    Spaces available

    Our motivation for discussing this important subject comes from some exciting recent research which has analysed the impact of behavioural factors on the decision to purchase an annuity. This work has shown that behavioural factors can explain the well-known low demand for immediate annuities but this research also identifies an important opportunity in relation to deferred annuities (DA). The research suggests that these factors lead to positive incentives to purchase a DA and that, for longer deferred periods, a DA could be an attractive product for both consumers and insurers.

  • IFoA/SAS Joint Professional Skills Training – Singapore

    Room 903, NTUC Centre, Level 9, One Marina Boulevard, Singapore 018989
    25 June 2019

    Spaces available

    The Institute and Faculty of Actuaries (IFoA) and Singapore Actuarial Society (SAS) are organising a joint Professional Skills Training (PST) in Singapore. This session is suitable for actuaries working in any area (i.e. it is not specifically aimed at Life, GI or any other technical discipline) and is interactive, so you should come along prepared to take part in the discussions.

  • AGM and Presidential Address 2019 + Volunteer and Member Drinks Reception

    The Hub  Castlehill Edinburgh EH1 2NE
    26 June 2019

    Spaces available

    Notice is hereby given that the ANNUAL GENERAL MEETING of the INSTITUTE AND FACULTY OF ACTUARIES will be held at The Hub, Edinburgh on Wednesday 26 June 2019 at 16.30 (Preceded by tea from 16.00) and followed by a PRESIDENTIAL ADDRESS given by John Taylor.

  • IFAM event - Actuarial Teachers’ & Researchers’ Conference 2019

    Institute for Financial and Actuarial Mathematics Department of Mathematical  Sciences The University of Liverpool Mathematical Sciences Building Peach Street Liverpool, L69 7ZL
    27 June 2019 - 29 June 2019

    Spaces available

    The Institute for Financial and Actuarial Mathematics (IFAM) at the University of Liverpool is pleased to host the 2019 Actuarial Teachers’ and Researchers’ Conference from 27-28 June 2019. This annual two-day event has been running annually now for many years, each time hosted by a different university, and provides all those interested in actuarial research and education a great opportunity to share their ideas and catch up on the latest developments.

  • IFoA/ASM Joint Professional Skills Training – Kuala Lumpur

    Menara AIA, Auditorium, 99 Jalan Ampang, 50450, Kuala Lumpur
    28 June 2019

    Spaces available

    The Institute and Faculty of Actuaries (IFoA) and Actuarial Society of Malaysia (ASM) are organising a joint Professional Skills Training (PST) in Kuala Lumpur. This session is suitable for actuaries working in any area (i.e. it is not specifically aimed at Life, GI or any other technical discipline) and is interactive, so you should come along prepared to take part in the discussions.

  • SIAS: The Impact of Air Pollution on Health and Life Expectancy

    Staple Inn Hall, High Holborn, London, WC1V 7QJ
    2 July 2019

    Spaces available

    Air pollution has gained increasing attention lately. Nicola Oliver, head of longevity and mortality research for Medical Intelligence, will discuss not only the impacts of air pollution on health and life expectancy but also how as an industry we should be addressing it.

  • GIRO Conference 2019

    EICC, The Exchange, 150 Morrison St, Edinburgh EH3 8EE
    24-26 September 2019
    Spaces available

    GIRO is attended annually by over 800 delegates and speakers who are keen to discuss key topics such as Pricing, Reserving, Modelling and the future of the insurance industry. GIRO 2018 was a huge success and we have opened bookings early for what we hope will be another brilliant conference at the EICC in Edinburgh this year.