Number of Response Options, Reliability, Validity, and Potential Bias in the Use of the Likert Scale Education and Social Science Research: A Literature Review
Kusmaryono I., Wijayanti D., Maharani H.R.
Abstract
This study reviews 60 papers using a Likert scale and published between 2012 – 2021. Screening for literature review uses the PRISMA method. The data analysis technique was carried out through data extraction, then synthesized in a structured manner using the narrative method. To achieve credible research results at the stage of the data collection and data analysis process, a group discussion forum (FGD) was conducted. The findings show that only 10% of studies use a measurement scale with an even answer choice category (4, 6, 8, or 10 choices). In general, (90%) of research uses a measurement instrument that involves a Likert scale with odd response choices (5, 7, 9, or 11) and the most popular researchers use a Likert scale with a total response of 5 points. The use of a rating scale with an odd number of responses of more than five points (especially on a seven-point scale) is the most effective in terms of reliability and validity coefficients, but if the researcher wants to direct respondents to one side, then a scale with an even number of responses (six points) is possible. more suitable. The presence of response bias and central tendency bias can affect the validity and reliability of the use of the Likert scale instrument.
Reliability and validity of a chinese version of the stem attitude scale for primary and secondary school students
Lao J., Shen Y., Xu Q., Zhang Y.
An application of item response theory to psychological test development
Hambleton R.K., Hutz C.S., Yoo H., Zanon C.
Biased Average Position Estimates in Line and Bar Graphs: Underestimation, Overestimation, and Perceptual Pull
Ceja C.R., Franconeri S., Ludwig C.J.H., Xiong C.
Reporting and interpreting scores derived from Likert-type scales
Warmbrod J. R.
Mathematical disposition of students’, teachers, and parents in distance learning: A survey
Kusmaryono I., Ulia N., Kusmaryono I., Ulia N., Kusmaryono I., Ulia N.
General mixture item response models with different item response structures: Exposition with an application to Likert scales
Bolsinova M., Jeon M., Tijmstra J.
Data analysis using item response theory methodology: An introduction to selected programs and applications
Favia A., Thorpe G. L.
Methods for the thematic synthesis of qualitative research in systematic reviews
Harden A., Thomas J.
What is the best response scale for survey and questionnaire design: Review of different lengths of rating scale / attitude scale / Likert scale
Taherdoost H.
Validity and reliability of the research instrument: How to test the validation of a questionnaire/survey in a research
Taherdoost H.
Curiel I.T., Gill N.W., Navarro R.A.
Permanente Journal
Tang B., Luo B., Li Y., Zhu M., Li Y., Yue Q.
Frontiers in Human Neuroscience
Muljono P., Saleh A., Suparman, Priatna W.B.
Open Agriculture
Hirschel R., Horai K.
Technology in Language Teaching and Learning
Nugroho S.E., Mustari M., Hartono, Sugianto
Journal of Educators Online
Thinley P., Phuntsho J., Steinmetz-Weiss C.
Cities
Candiasa I.M., Susilawati A., Oya A., Putra H.S., Arimbawa G.P.A., Dewi P.W.R.
International Journal of Language Education
Rosales X.Q., Hirano M., Trumpff C., Picard M., Junker A., Cross M., Englestad K., Kelly C.
Mitochondrion
Bressan S., Re V., Baioccato V., Bazo M., Ermolao A., Leo I., Patricios J.S., Echemendia R.J., Simonelli A., Davis G.A.
Italian Journal of Pediatrics
Yazid M., Fauziyah, Agustriani F., Iskandar I.
Singapore Journal of Tropical Geography