|
Difficulties
|
Suggestions |
|
Probabilistic thinking
|
Good facilitator; education
|
|
Calibration
Interpretation
|
Question design
Explicit questions so answers are free from interpretive uncertainty
|
|
Qualitative dimension: not easily translated into numbers
|
Verbal assessments; decomposition into indicators; retain subjective
verbal statements
|
|
Identification of experts
|
Still an ongoing task; expect over time there will be more experts
|
|
Unbiased assessment
|
Use debiasers, e.g. non-judgmental methods, responses from objective
assessors and other stakeholders
|
|
Low response rate
|
The right incentives
|
|
Willingness to respond
|
Credibility of the facilitator; buy-in; managerial mandates
|