Expert review (method)

[1] The experts document their assessment and typically report the results in open-ended comments.

[3] They can also conduct a systematic review using a coding tool such as the Questionnaire Appraisal System that is supported by an item taxonomy of the cognitive demands of a question and a detailed set of potential problem codes document the features that may lead to response error.

[4][5] When applied to translated surveys, the expert panel also includes translators and they usually produce individual reports and then convene a resolution meeting that generates an improved version of the survey translation.

[6] Compared to empirical pretesting methods, an expert review is more time-efficient and less costly to complete.

[7] An expert review can also be combined with other methods to enable multimode pretesting.