Online targeting behavior of peer-assessors under identity-revealed, nicknamed, and concealed modes

Fu-Yun Yu, Shannon Sung

Research output: Contribution to journalArticle

Abstract

This study examined whether different identity revelation conditions result in different online targeting behavior among peer-assessors through a pretest and posttest quasi-experimental research design. Students from six fifth-grade classes (N = 196) participated in online learning tasks where they generated and selected peer-generated questions to review and assess in their respective identity revelation modes-real-name, nickname, and anonymity. Several findings were obtained. First, there was a high redundancy rate for both high- and low-targeted assessees under the pre-treatment (control) and treatment conditions for all three identity revelation modes. Second, the non-significant results of the chi-square tests indicated that the identity revelation modes and assessee redundancy were neither considerably related for the high- nor low-targeted assessees groups. Third, the results from the ANCOVA on the number of peer-feedback messages each student received showed no significant differences among the three identity revelation treatments. Fourth, the Wilcoxon tests confirmed that there were no significant differences in the assessee rankings in terms of the number of times their generated questions were assessed between the pre-treatment and treatment conditions for all different identity revelation modes. Finally, the results from participants' responses to the checkbox question revealed almost the same ranking pattern regarding factors dominating their targeting behavior (with the question-author ranked last among all factors), despite the various different identity revelation modes. In sum, identity revelation modes were not found to affect peer-assessors' targeting behavior in an online peer-assessment activity.

Original languageEnglish
Pages (from-to)15-27
Number of pages13
JournalEducational Technology and Society
Volume22
Issue number1
Publication statusPublished - 2019 Jan 1

Fingerprint

Redundancy
Students
Feedback
redundancy
ranking
anonymity
research planning
student
learning
Group

All Science Journal Classification (ASJC) codes

  • Education
  • Sociology and Political Science
  • Engineering(all)

Cite this

@article{e36088a1ce1e493f88fec0bc26d77574,
title = "Online targeting behavior of peer-assessors under identity-revealed, nicknamed, and concealed modes",
abstract = "This study examined whether different identity revelation conditions result in different online targeting behavior among peer-assessors through a pretest and posttest quasi-experimental research design. Students from six fifth-grade classes (N = 196) participated in online learning tasks where they generated and selected peer-generated questions to review and assess in their respective identity revelation modes-real-name, nickname, and anonymity. Several findings were obtained. First, there was a high redundancy rate for both high- and low-targeted assessees under the pre-treatment (control) and treatment conditions for all three identity revelation modes. Second, the non-significant results of the chi-square tests indicated that the identity revelation modes and assessee redundancy were neither considerably related for the high- nor low-targeted assessees groups. Third, the results from the ANCOVA on the number of peer-feedback messages each student received showed no significant differences among the three identity revelation treatments. Fourth, the Wilcoxon tests confirmed that there were no significant differences in the assessee rankings in terms of the number of times their generated questions were assessed between the pre-treatment and treatment conditions for all different identity revelation modes. Finally, the results from participants' responses to the checkbox question revealed almost the same ranking pattern regarding factors dominating their targeting behavior (with the question-author ranked last among all factors), despite the various different identity revelation modes. In sum, identity revelation modes were not found to affect peer-assessors' targeting behavior in an online peer-assessment activity.",
author = "Fu-Yun Yu and Shannon Sung",
year = "2019",
month = "1",
day = "1",
language = "English",
volume = "22",
pages = "15--27",
journal = "Educational Technology and Society",
issn = "1176-3647",
publisher = "IEEE Computer Society",
number = "1",

}

Online targeting behavior of peer-assessors under identity-revealed, nicknamed, and concealed modes. / Yu, Fu-Yun; Sung, Shannon.

In: Educational Technology and Society, Vol. 22, No. 1, 01.01.2019, p. 15-27.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Online targeting behavior of peer-assessors under identity-revealed, nicknamed, and concealed modes

AU - Yu, Fu-Yun

AU - Sung, Shannon

PY - 2019/1/1

Y1 - 2019/1/1

N2 - This study examined whether different identity revelation conditions result in different online targeting behavior among peer-assessors through a pretest and posttest quasi-experimental research design. Students from six fifth-grade classes (N = 196) participated in online learning tasks where they generated and selected peer-generated questions to review and assess in their respective identity revelation modes-real-name, nickname, and anonymity. Several findings were obtained. First, there was a high redundancy rate for both high- and low-targeted assessees under the pre-treatment (control) and treatment conditions for all three identity revelation modes. Second, the non-significant results of the chi-square tests indicated that the identity revelation modes and assessee redundancy were neither considerably related for the high- nor low-targeted assessees groups. Third, the results from the ANCOVA on the number of peer-feedback messages each student received showed no significant differences among the three identity revelation treatments. Fourth, the Wilcoxon tests confirmed that there were no significant differences in the assessee rankings in terms of the number of times their generated questions were assessed between the pre-treatment and treatment conditions for all different identity revelation modes. Finally, the results from participants' responses to the checkbox question revealed almost the same ranking pattern regarding factors dominating their targeting behavior (with the question-author ranked last among all factors), despite the various different identity revelation modes. In sum, identity revelation modes were not found to affect peer-assessors' targeting behavior in an online peer-assessment activity.

AB - This study examined whether different identity revelation conditions result in different online targeting behavior among peer-assessors through a pretest and posttest quasi-experimental research design. Students from six fifth-grade classes (N = 196) participated in online learning tasks where they generated and selected peer-generated questions to review and assess in their respective identity revelation modes-real-name, nickname, and anonymity. Several findings were obtained. First, there was a high redundancy rate for both high- and low-targeted assessees under the pre-treatment (control) and treatment conditions for all three identity revelation modes. Second, the non-significant results of the chi-square tests indicated that the identity revelation modes and assessee redundancy were neither considerably related for the high- nor low-targeted assessees groups. Third, the results from the ANCOVA on the number of peer-feedback messages each student received showed no significant differences among the three identity revelation treatments. Fourth, the Wilcoxon tests confirmed that there were no significant differences in the assessee rankings in terms of the number of times their generated questions were assessed between the pre-treatment and treatment conditions for all different identity revelation modes. Finally, the results from participants' responses to the checkbox question revealed almost the same ranking pattern regarding factors dominating their targeting behavior (with the question-author ranked last among all factors), despite the various different identity revelation modes. In sum, identity revelation modes were not found to affect peer-assessors' targeting behavior in an online peer-assessment activity.

UR - http://www.scopus.com/inward/record.url?scp=85063792900&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85063792900&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:85063792900

VL - 22

SP - 15

EP - 27

JO - Educational Technology and Society

JF - Educational Technology and Society

SN - 1176-3647

IS - 1

ER -