TY - JOUR
T1 - False precision: The ring of truth
AU - Roberts, William L.
N1 - Generated from Scopus record by KAUST IRTS on 2023-09-20
PY - 2017/4/1
Y1 - 2017/4/1
N2 - Articles on best practices in research usually focus on collecting and analysing data. However, an important ethical and practical issue is often ignored: False precision. Researchers, reviewers, and editors often ignore the precision of instruments and the concept of significant digits, familiar from introductory courses in many sciences. The result is that findings are presented so that they appear to be more precise or accurate than they actually are. Imprecision is also ignored (and precision implied) when results are presented without margins of error (confidence intervals). Other practices also increase or mask imprecision. It is not widely appreciated that imprecision is inflated when scale scores are calculated by summing items, a common practice for clinical instruments. The use of global scores can mask the complex, multidimensional nature of constructs such as stress, resilience, and depression. Although these practices are not intended to mislead or deceive, that is their effect when presented to policymakers, clients- A nd ourselves. Improvements are obvious: Reported results should reflect the precision of measurements; margins of error should be reported; scale scores should be calculated by averaging, not summing, items; and unidimensional scales should be used in research articles instead of global scores.
AB - Articles on best practices in research usually focus on collecting and analysing data. However, an important ethical and practical issue is often ignored: False precision. Researchers, reviewers, and editors often ignore the precision of instruments and the concept of significant digits, familiar from introductory courses in many sciences. The result is that findings are presented so that they appear to be more precise or accurate than they actually are. Imprecision is also ignored (and precision implied) when results are presented without margins of error (confidence intervals). Other practices also increase or mask imprecision. It is not widely appreciated that imprecision is inflated when scale scores are calculated by summing items, a common practice for clinical instruments. The use of global scores can mask the complex, multidimensional nature of constructs such as stress, resilience, and depression. Although these practices are not intended to mislead or deceive, that is their effect when presented to policymakers, clients- A nd ourselves. Improvements are obvious: Reported results should reflect the precision of measurements; margins of error should be reported; scale scores should be calculated by averaging, not summing, items; and unidimensional scales should be used in research articles instead of global scores.
UR - http://doi.apa.org/getdoi.cfm?doi=10.1037/cbs0000070
UR - http://www.scopus.com/inward/record.url?scp=85018903553&partnerID=8YFLogxK
U2 - 10.1037/cbs0000070
DO - 10.1037/cbs0000070
M3 - Article
SN - 0008-400X
VL - 49
SP - 97
EP - 99
JO - Canadian Journal of Behavioural Science
JF - Canadian Journal of Behavioural Science
IS - 2
ER -