Number of Response Options, Reliability, Validity, and Potential Bias in the Use of the Likert Scale Education and Social Science Research: A Literature Review

Kusmaryono I., Wijayanti D., Maharani H.R.

Abstract

This study reviews 60 papers using a Likert scale and published between 2012 – 2021. Screening for literature review uses the PRISMA method. The data analysis technique was carried out through data extraction, then synthesized in a structured manner using the narrative method. To achieve credible research results at the stage of the data collection and data analysis process, a group discussion forum (FGD) was conducted. The findings show that only 10% of studies use a measurement scale with an even answer choice category (4, 6, 8, or 10 choices). In general, (90%) of research uses a measurement instrument that involves a Likert scale with odd response choices (5, 7, 9, or 11) and the most popular researchers use a Likert scale with a total response of 5 points. The use of a rating scale with an odd number of responses of more than five points (especially on a seven-point scale) is the most effective in terms of reliability and validity coefficients, but if the researcher wants to direct respondents to one side, then a scale with an even number of responses (six points) is possible. more suitable. The presence of response bias and central tendency bias can affect the validity and reliability of the use of the Likert scale instrument.

Journal
International Journal of Educational Methodology
Page Range
625-637
Publication date
2022
Total citations
Reliability and validity of a chinese version of the stem attitude scale for primary and secondary school students

Lao J., Shen Y., Xu Q., Zhang Y.

An application of item response theory to psychological test development

Hambleton R.K., Hutz C.S., Yoo H., Zanon C.

Biased Average Position Estimates in Line and Bar Graphs: Underestimation, Overestimation, and Perceptual Pull

Ceja C.R., Franconeri S., Ludwig C.J.H., Xiong C.

Reporting and interpreting scores derived from Likert-type scales

Warmbrod J. R.

Mathematical disposition of students’, teachers, and parents in distance learning: A survey

Kusmaryono I., Ulia N., Kusmaryono I., Ulia N., Kusmaryono I., Ulia N.

General mixture item response models with different item response structures: Exposition with an application to Likert scales

Bolsinova M., Jeon M., Tijmstra J.

Data analysis using item response theory methodology: An introduction to selected programs and applications

Favia A., Thorpe G. L.

Methods for the thematic synthesis of qualitative research in systematic reviews

Harden A., Thomas J.

What is the best response scale for survey and questionnaire design: Review of different lengths of rating scale / attitude scale / Likert scale

Taherdoost H.

Validity and reliability of the research instrument: How to test the validation of a questionnaire/survey in a research

Taherdoost H.

An EEG-based analysis of the effects of different music genres on driving stress

Tang B., Luo B., Li Y., Zhu M., Li Y., Yue Q.

Frontiers in Human Neuroscience

Exploring AI to Automate EFL Corrective Written Feedback in the First Language

Hirschel R., Horai K.

Technology in Language Teaching and Learning

Cognitive Load in English as a Foreign Language Speaking Competency of Vocational High School Students

Candiasa I.M., Susilawati A., Oya A., Putra H.S., Arimbawa G.P.A., Dewi P.W.R.

International Journal of Language Education

Perceived association of mood and symptom severity in adults with mitochondrial diseases

Rosales X.Q., Hirano M., Trumpff C., Picard M., Junker A., Cross M., Englestad K., Kelly C.

Mitochondrion

Translation, cultural adaptation, and validation of the Concussion Recognition Tool 6 (CRT6™), Sport Concussion Assessment Tool 6 (SCAT6®) and Sport Concussion Office Assessment Tool 6 (SCOAT6™): the Italian process

Bressan S., Re V., Baioccato V., Bazo M., Ermolao A., Leo I., Patricios J.S., Echemendia R.J., Simonelli A., Davis G.A.

Italian Journal of Pediatrics

Access to Document