Korneev A.A., Rasskazova E.I., Krichevets A.N., Koyfman A.Ya. Criticism of Null Hypothesis Significance Testing: Limitations and Possible Ways Out. Part I

Full text in Russian: Корнеев А.А., Рассказова Е.И., Кричевец А.Н., Койфман А.Я. Критика методологии проверки нулевой гипотезы: ограничения и возможные пути выхода. Часть I
Lomonosov Moscow State University, Moscow, Russia

About authors
Suggested citation


The most common mistakes in using of Null-hypothesis significance testing (NHST) as a mean of data analysis in psychology are disclosed in the article. Several levels of criticism of NHST in recent publications are described: the level of presuppositions and main procedures of the approach; the level of social implication and after-effect; the level of psychological interpretation of statistical results. The main alternative proposals are analyzed. The preliminary conclusion is that not procedures of single study evaluation have to be changed but new structure of evaluation and comparison different researches results must be developed in the society.

Keywords: null hypothesis significance testing, statistical inference, p-value, meta-analysis

 

References

Alekseev A.A. In: A.N. Alekhin (Ed.), Metodologicheskie problemy meditsinskoi psikhologii: materialy seminara kafedry klinicheskoi psikhologii Rossiiskogo gosudarstvennogo pedagogicheskogo universiteta im. A.I.Gertsena. Part II. St. Petersburg: Znanie, 2012. pp. 69–88. (in Russian)

Artemeva E.Yu., Martynov E.M. Veroyatnostnye metody v psikhologii. Moscow: Mosk. gos. universitet, 1975. (in Russian)

Borenstein M., Hedges L.V., Higgins J.P.T., Rothstein H.R. Introduction to Meta-Analysis. Chichester, UK: John Wiley and Sons, 2009.

Carver R. The case against statistical significance testing. Harvard Educational Review, 1978, 48(3), 378–399.

Cohen J. The earth is round (p < .05): Rejoinder. American Psychologist, 1994, 50(12), 997–1003.

Eidswick J. A Bayesian Alternative to Null Hypothesis Significance Testing. Shinken Research Bulletin, 2012, 16(1), 2–15.

Fisher R.A. Statisticheskie metody dlya issledovatelei. Moscow: Gosstatizdat, 1958. (in Russian)

Fraley R.C., Marks M.J. The null hypothesis significance testing debate and its implications for personality research. In: Handbook of research methods in personality psychology. New York, NY: Guilford, 2007. pp. 149–169.

Gigerenzer G. Mindless statistics. The Journal of Socio-Economics, 2004, 33(5), 587–606.

Gliner J.A., Leech N.L., Morgan G.A. Problems with null hypothesis significance testing (NHST): what do the textbooks say? The Journal of Experimental Education, 2002, 71(1), 83–92.

Hoekstra R., Finch S., Kiers H.A., Johnson A. Probability as certainty: Dichotomous thinking and the misuse of p-values. Psychonomic Bulletin and Review, 2006, 13(6), 1033–1037.

Kelley K., Preacher K.J. On effect size. Psychological Methods, 2012, 17(2), 137–152.

Korneev A.A., Krichevets A.N. Psikhologicheskii Zhurnal, 2011, 32(1), 97–110. (in Russian)

Krichevets A.N., Korneev A.A., Rasskazova E.I. Matematicheskaya statistika dlya psikhologov. Moscow: Akademiya, 2012. (in Russian)

Krichevets A.N., Shvarts A.Yu., Chumachenko D.V. Psikhologiya. Zhurnal Vysshei Shkoly Ekonomiki, 2014, 11(3), 55–78. (in Russian)

Little T.D. Longitudinal structural equation modeling. New York, NY: Guilford Press, 2013.

Masicampo E.J., Lalande D.R. A peculiar prevalence of p values just below .05.  The Quarterly Journal of Experimental Psychology, 2012, 65(11), 2271–2279.

Nuzzo R. Statistical errors. Nature, 2014, 506(13), 150–152.

Purssell E., While A. P = nothing, or why we should not teach healthcare students about statistics. Nurse Education Today, 2011, 31(8), 837–840.

Robinson D.H., Wainer H. On the past and future of null hypothesis significance testing. Research Report, 2001, No. 2, 1–20.

Schneider J.W. Null hypothesis significance tests. A mix-up of two different theories: the basis for widespread confusion and numerous misinterpretations. Scientometrics, 2015, 102(1), 411–432.

Sivukha S.V. In: M.M. Gorbunov (Ed.), Aktual'nye problemy gumanitarnykh i sotsial'no-ekonomicheskikh nauk: Sbornik materialov Vos'moi mezhdunarodnoi zaochnoi nauchno-prakticheskoi konferentsii. Moscow: Pero, 2014. Ch. 1, pp. 123–25. (in Russian)

Sivukha S.V., Kozyak A.A. Psikhologiya. Zhurnal Vysshei Shkoly Ekonomiki, 2009, 6(4), 66–86. (in Russian)

Sotos A.E.C., Vanhoof S., van den Noortgate W., Onghena P. Students’ misconceptions of statistical inference: A review of the empirical evidence from research on statistics education. Educational Research Review, 2007, 2(2), 98–113.

Trafimow D., Marks M. Editorial. Basic and Applied Social Psychology, 2015, 37(1), 1–2.

Wilkinson L. Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 1999, 54(8), 594–604.

Received 12 August 2015. Date of publication: 28 February 2016.

About authors

Korneev Aleksei A. Ph.D., Senior Research Associate, Laboratory of Neuropsychology, Faculty of Psychology, Lomonosov Moscow State University, ul. Mokhovaya, 11–9, 125009 Moscow, Russia; Senior Research Associate, Laboratory of Neurophysiology of Cognitive Processes, Institute of Developmental Physiology, Russian Academy of Education, ul. Pogodinskaya, 8–2, 119121 Moscow, Russia.
E-mail: Этот адрес электронной почты защищен от спам-ботов. У вас должен быть включен JavaScript для просмотра.

Rasskazova Elena I. Ph.D., Associate Professor, Faculty of Psychology, Lomonosov Moscow State University, ul. Mokhovaya, 11–9, 125009 Moscow, Russia; Senior Research Associate, Mental Health Research Center, Russian Academy of Medical Sciences, Kashirskoe shosse, 34, 115522 Moscow, Russia.
E-mail: Этот адрес электронной почты защищен от спам-ботов. У вас должен быть включен JavaScript для просмотра.

Krichevets Anatoly N. Ph.D., Professor, Department of Methodology of Psychology, Faculty of Psychology, Lomonosov Moscow State University, ul. Mokhovaya, 11–9, 125009 Moscow, Russia.
E-mail: Этот адрес электронной почты защищен от спам-ботов. У вас должен быть включен JavaScript для просмотра.

Koyfman Aleksandra Ya. Psychologist, Department of Educational Psychology, Faculty of Psychology, Lomonosov Moscow State University, ul. Mokhovaya, 11–9, 125009 Moscow, Russia.
E-mail: Этот адрес электронной почты защищен от спам-ботов. У вас должен быть включен JavaScript для просмотра.

Suggested citation

Korneev A.A., Rasskazova E.I., Krichevets A.N., Koyfman A.Ya. Criticism of Null Hypothesis Significance Testing: Limitations and Possible Ways Out. Part I. Psikhologicheskie Issledovaniya, 2016, Vol. 9, No. 45, p. 1. http://psystudy.ru (in Russian, abstr. in English).

Permanent URL: http://psystudy.ru/index.php/eng/2016v9n45e/1243-korneev45e.html

Back to top >>