Uncertain Judgements: Eliciting Experts' Probabilities / Edition 1

Hardcover (Print)
Used and New from Other Sellers
Used and New from Other Sellers
from $54.41
Usually ships in 1-2 business days
(Save 35%)
Other sellers (Hardcover)
  • All (14) from $54.41   
  • New (8) from $62.98   
  • Used (6) from $54.41   


Elicitation is the process of extracting expert knowledge about some unknown quantity or quantities, and formulating that information as a probability distribution. Elicitation is important in situations, such as modelling the safety of nuclear installations or assessing the risk of terrorist attacks, where expert knowledge is essentially the only source of good information. It also plays a major role in other contexts by augmenting scarce observational data, through the use of Bayesian statistical methods. However, elicitation is not a simple task, and practitioners need to be aware of a wide range of research findings in order to elicit expert judgements accurately and reliably. Uncertain Judgements introduces the area, before guiding the reader through the study of appropriate elicitation methods, illustrated by a variety of multi-disciplinary examples.

This is achieved by:

  • Presenting a methodological framework for the elicitation of expert knowledge incorporating findings from both statistical and psychological research.
  • Detailing techniques for the elicitation of a wide range of standard distributions, appropriate to the most common types of quantities.
  • Providing a comprehensive review of the available literature and pointing to the best practice methods and future research needs.
  • Using examples from many disciplines, including statistics, psychology, engineering and health sciences.
  • Including an extensive glossary of statistical and psychological terms.

An ideal source and guide for statisticians and psychologists with interests in expert judgement or practical applications of Bayesian analysis, Uncertain Judgements will also benefit decision-makers, risk analysts, engineers and researchers in the medical and social sciences.

Read More Show Less

Editorial Reviews

From the Publisher
“This book, written by a group of expert statisticians and psychologists, provides an introduction to the subject and a detailed overview of the existing literature. The book guides the reader through the design of an elicitation method and details examples from a cross section of literature in the statistics, psychology, engineering and health sciences disciplines.”  (Zentralblatt Math, 1 August 2013)

"This is an interesting, well-written book that will be valuable to any decision maker who much rely on expert judgments, any statistician who uses Bayesian statistics, and any researcher who wishes to understand the field of elicitation." (Journal of the American Statistical Association, March 2009)

"This book provides an excellent introduction and working reference to the subject of its title and should be an invaluable aid to producers and consumers of expert opinion." (Biometrics, September 2008)

"I recommend 'Uncertain Judgements' as an excellent source for a wide variety of research." (Psychometrika, March 2008)

“…will be of interest to those who are concerned with or interested primarily in the practicalities of modeling expert judgement and opinion.” (International Journal of Marketing, January 2007)

Read More Show Less

Product Details

  • ISBN-13: 9780470029992
  • Publisher: Wiley
  • Publication date: 9/14/2006
  • Series: Statistics in Practice Series, #35
  • Edition number: 1
  • Pages: 338
  • Sales rank: 1,405,732
  • Product dimensions: 6.28 (w) x 9.17 (h) x 0.96 (d)

Meet the Author

Professor Anthony O’Hagan is the Director of The Centre for Bayesian Statistics in Health Economics at the University of Sheffield. The Centre is a collaboration between the Department of Probability and Statistics and the School of Health and Related Research (ScHARR). The Department of Probability and Statistics is internationally respected for its research in Bayesian statistics, while ScHARR is one of the leading UK centres for economic evaluation.

Prof O’Hagan is an internationally leading expert in Bayesian Statistics.


Professor Paul Gathwaite – Open University, Prof of Statistics, Maths and Computing

Dr Jeremy Oakley – Sheffield University

Professor John Brazier – Director of Health Economics Group, University of Sheffield

Dr Tim Rakow – University of Essex, Psychology Department

Dr Alireza Daneshkhah – University of Sheffield, Medical Statistics Department

Dr Jim Chilcott - School of Health Research, University of Sheffield, Department of OR

Read More Show Less

Table of Contents


1. Fundamentals of Probability and Judgement.

1.1 Introduction.

1.2 Probability and elicitation.

1.3 Uncertainty and the interpretation of probability.

1.4 Elicitation and the psychology of judgement.

1.5 What use are such judgements?

1.6 Conclusions.

2. The Elicitation Context.

2.1 How and who?

2.2 What is an expert?

2.3 The elicitation process.

2.4 Conventions in Chapters 3 to 9. 

2.5 Conclusions.

3. The Psychology of Judgement Under Uncertainty.

3.1 Introduction.

3.2 Understanding the task and the expert.

3.3 Understanding research on human judgement.

3.4 The heuristic and biases research programme. 3.4.6 The affect heuristic.

3.5 Experts and expertise.

3.6 Three meta theories of judgement.

3.7 Conclusions.

4. The Elicitation of Probabilities.

4.1 Introduction.

4.2 The Calibration of Subjective Probabilities.

4.3 The calibration in subjective probabilities: theories and explanations.

4.4 Representations and methods.

4.5 Debiasing.

4.6 Conclusions.

5. Eliciting Distributions - General.

5.1 From probabilities to distributions.

5.2 Eliciting univariate distributions.

5.3 Eliciting multivariate distributions.

5.4 Uncertainty and imprecision.

5.5 Conclusions.

6. Eliciting and Fitting a Parametric Distribution.

6.1 Introduction.

6.2 Outline of this chapter.

6.3 Eliciting opinion about a proportion.

6.4 Eliciting opinion about a general scalar quantity.

6.5 Eliciting opinion about a set of proportions.

6.6 Eliciting opinion about the parameters of a multivariate normal distribution.

6.7 Eliciting opinion about the parameters of a linear regression model.

6.8 Eliciting opinion about the parameters of a generalized linear model.

6.9 Elicitation methods for other problems.

6.10 Deficiencies in existing research.

6.11 Conclusions.

7. Eliciting Distributions - Uncertainty and Imprecision.

7.1 Introduction.

7.2 Imprecise probabilities.

7.3 Incomplete information.

7.4 Summary.

7.5 Conclusions.

8. Evaluating Elicitation.

8.1 Introduction.

8.2 Scoring rules.

8.3 Coherence, feedback and overfitting.

8.4 Conclusions.

9. Multiple Experts.

9.1 Introduction.

9.2 Mathematical aggregation.

9.3 Behavioural aggregation.

9.4 Discussion.

9.5 Elicitation practice.

9.6 Research questions.

10. Published Examples of the Formal Elicitation of Expert Opinion.

10.1 Some applications.

10.2 An example of an elicitation interview - eliciting engine sales.

10.3 Medicine.

10.4 The nuclear industry.

10.5 Veterinary science.

10.6 Agriculture.

10.7 Meteorology.

10.8 Business studies, economics and finance.

10.9 Other professions.

10.10 Other examples of the elicitation of subjective probabilities.

11. Guidance on Best Practice.

12. Areas for Research.



Author Index.


Read More Show Less

Customer Reviews

Be the first to write a review
( 0 )
Rating Distribution

5 Star


4 Star


3 Star


2 Star


1 Star


Your Rating:

Your Name: Create a Pen Name or

Barnes & Noble.com Review Rules

Our reader reviews allow you to share your comments on titles you liked, or didn't, with others. By submitting an online review, you are representing to Barnes & Noble.com that all information contained in your review is original and accurate in all respects, and that the submission of such content by you and the posting of such content by Barnes & Noble.com does not and will not violate the rights of any third party. Please follow the rules below to help ensure that your review can be posted.

Reviews by Our Customers Under the Age of 13

We highly value and respect everyone's opinion concerning the titles we offer. However, we cannot allow persons under the age of 13 to have accounts at BN.com or to post customer reviews. Please see our Terms of Use for more details.

What to exclude from your review:

Please do not write about reviews, commentary, or information posted on the product page. If you see any errors in the information on the product page, please send us an email.

Reviews should not contain any of the following:

  • - HTML tags, profanity, obscenities, vulgarities, or comments that defame anyone
  • - Time-sensitive information such as tour dates, signings, lectures, etc.
  • - Single-word reviews. Other people will read your review to discover why you liked or didn't like the title. Be descriptive.
  • - Comments focusing on the author or that may ruin the ending for others
  • - Phone numbers, addresses, URLs
  • - Pricing and availability information or alternative ordering information
  • - Advertisements or commercial solicitation


  • - By submitting a review, you grant to Barnes & Noble.com and its sublicensees the royalty-free, perpetual, irrevocable right and license to use the review in accordance with the Barnes & Noble.com Terms of Use.
  • - Barnes & Noble.com reserves the right not to post any review -- particularly those that do not follow the terms and conditions of these Rules. Barnes & Noble.com also reserves the right to remove any review at any time without notice.
  • - See Terms of Use for other conditions and disclaimers.
Search for Products You'd Like to Recommend

Recommend other products that relate to your review. Just search for them below and share!

Create a Pen Name

Your Pen Name is your unique identity on BN.com. It will appear on the reviews you write and other website activities. Your Pen Name cannot be edited, changed or deleted once submitted.

Your Pen Name can be any combination of alphanumeric characters (plus - and _), and must be at least two characters long.

Continue Anonymously

    If you find inappropriate content, please report it to Barnes & Noble
    Why is this product inappropriate?
    Comments (optional)