TY - GEN
T1 - Crowdsourcing college examinations using technology to improve assessment and higher learning by students
AU - Olson, Timothy
PY - 2014/1/1
Y1 - 2014/1/1
N2 - A highly ranked Management Information Systems Department at a leading american university has implemented crowdsourcing, where students generate the questions in an introductory course. This paper describes the process and results after two semesters and participation of approximately 1000 students. The course blends students attending scheduled classroom lectures and significant use of an open source Learning Management Systems, (LMS). The LMS, accessible through the university's website, contains all course material including readings, team exercises, videos, related websites, grades and online exams. At the beginning of the semester, students are assigned to a team of five. The total number of teams in all sections per semester is approximately eighty. Each team is responsible for preparing four questions, generating a collective pool of over 300 questions for the exam across multiple course sections. After editing and removal of duplicate questions by teaching assistants a study guide of all the questions without the answers is provided to the students in advance through LMS. An on-going issue in higher education is academic dishonesty. Crowdsourcing properly used in conjunction with an online LMS can significantly reduce the risk of students cheating on exams by increasing the complexity of sharing answers in the test setting among students. Students and teams benefit from performing higher on learning activities by engaging more thoroughly with the subject matter when comprising complex questions. Using the philosophy "to learn a subject is to teach it", or in this case, by writing exam questions more actively engaging in personal learning whilst dictating what fellow students learn. Teams are not given credit for questions that are too simplistic, where explicit guidelines and prompts of how to write good multiple choice questions are provided. Students are given access to all the exam questions, but not the answers, so they have a comprehensive study guide before the exam. The course uses technology to improve the quality of education. Crowdsourcing is a compelling tool used in education to increase student collaboration and higher learning. Students see the input side of preparing examinations and the output in two different forms: a study guide and individually LMS generated exam. Academic dishonesty is significantly minimized by the use of the LMS's student logs, documenting: date, time, content, duration, facilities and monitoring student IP addresses location.
AB - A highly ranked Management Information Systems Department at a leading american university has implemented crowdsourcing, where students generate the questions in an introductory course. This paper describes the process and results after two semesters and participation of approximately 1000 students. The course blends students attending scheduled classroom lectures and significant use of an open source Learning Management Systems, (LMS). The LMS, accessible through the university's website, contains all course material including readings, team exercises, videos, related websites, grades and online exams. At the beginning of the semester, students are assigned to a team of five. The total number of teams in all sections per semester is approximately eighty. Each team is responsible for preparing four questions, generating a collective pool of over 300 questions for the exam across multiple course sections. After editing and removal of duplicate questions by teaching assistants a study guide of all the questions without the answers is provided to the students in advance through LMS. An on-going issue in higher education is academic dishonesty. Crowdsourcing properly used in conjunction with an online LMS can significantly reduce the risk of students cheating on exams by increasing the complexity of sharing answers in the test setting among students. Students and teams benefit from performing higher on learning activities by engaging more thoroughly with the subject matter when comprising complex questions. Using the philosophy "to learn a subject is to teach it", or in this case, by writing exam questions more actively engaging in personal learning whilst dictating what fellow students learn. Teams are not given credit for questions that are too simplistic, where explicit guidelines and prompts of how to write good multiple choice questions are provided. Students are given access to all the exam questions, but not the answers, so they have a comprehensive study guide before the exam. The course uses technology to improve the quality of education. Crowdsourcing is a compelling tool used in education to increase student collaboration and higher learning. Students see the input side of preparing examinations and the output in two different forms: a study guide and individually LMS generated exam. Academic dishonesty is significantly minimized by the use of the LMS's student logs, documenting: date, time, content, duration, facilities and monitoring student IP addresses location.
KW - Academic dishonesty
KW - Blended courses
KW - Crowdsourcing
KW - Digital classroom
KW - Higher learning
KW - Learning management system
KW - Test banks
UR - http://www.scopus.com/inward/record.url?scp=84910032566&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84910032566&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:84910032566
T3 - Proceedings of the International Conference on e-Learning, ICEL
SP - 123
EP - 130
BT - Proceedings of the International Conference on e-Learning, ICEL
A2 - Yanez, Teresita Arenas
A2 - Griffiths, Paul
A2 - Rodriguez, Oscar Saavedra
PB - Academic Conferences Limited
T2 - 9th International Conference on e-Learning, ICEL 2014
Y2 - 26 June 2014 through 27 June 2014
ER -