MHCI PSLC Data Shop Project

LearnLab Surveys

As part of our requirements solicitation process, we interviewed and distributed a LearnLab Survey to each of the course leaders and tutor developers. The purpose of these surveys is to understand how researchers in each of the various LearnLab courses understand various knowledge units that we have identified. For more details you can access the full survey (.pdf) here

.

Tutor Element ANDES WhyAtlas French (dev.) Chemistry Geometry ESL

Subgoal Entries Expectations / Responses Only included in complex activities, not named Parts, steps Step RE - None/AE - Question

Problem Problem Task Activities (problems or tasks are also okay) Activity, set of exercises, problem Problem Reading Event (RE)/Assessment Event(AE)

Knowledge Component Principles Principles Skills, Categories of Learning concepts, skills Learning Outcomes, Gains RE - Vocabular (Words), Grammar (Rules)

Right Answers Right Answers Correct Features / Right Answers Right Answers Correct Answer Correct Answers/Steps Correct

Wrong Answers Recognized Errors Recognized Errors Predicted Error Errors Errors Incorrect

Unanticipated Errors Unrecognized Errors Unrecognized Errors Unpredicted Error Errors Errors None

Error / Wrong Answer Feedback Red Incorrect Answer State Feedback Feedback after submission Error Feedback Messages None

Hint Next Step Help (NSH) / What's Wrong Help (WWH) N/A Hint or Help Hints (currently problem specific, such as restating the goal, not step specific) Hint or Help RE - Hint

Error Clusters Error Classes Misconceptions "We haven't thought that far... " but could be based on meaning, form, orthography "Working towards that"... will be context dependent Error Categories None

Etc Inter-Help Questions Latency data to indicate level of student engagement in the exercise Identifying typical strategies used by students to solve the problem Knowledge Module - takes students history of correct/incorrect and determines whether they should know a word.

Tutor Element	ANDES	WhyAtlas	French (dev.)	Chemistry	Geometry	ESL
Subgoal	Entries	Expectations / Responses	Only included in complex activities, not named	Parts, steps	Step	RE - None/AE - Question
Problem	Problem	Task	Activities (problems or tasks are also okay)	Activity, set of exercises, problem	Problem	Reading Event (RE)/Assessment Event(AE)
Knowledge Component	Principles	Principles	Skills, Categories of Learning	concepts, skills	Learning Outcomes, Gains	RE - Vocabular (Words), Grammar (Rules)
Right Answers	Right Answers	Correct Features / Right Answers	Right Answers	Correct Answer	Correct Answers/Steps	Correct
Wrong Answers	Recognized Errors	Recognized Errors	Predicted Error	Errors	Errors	Incorrect
Unanticipated Errors	Unrecognized Errors	Unrecognized Errors	Unpredicted Error	Errors	Errors	None
Error / Wrong Answer Feedback	Red	Incorrect Answer State	Feedback	Feedback after submission	Error Feedback Messages	None
Hint	Next Step Help (NSH) / What's Wrong Help (WWH)	N/A	Hint or Help	Hints (currently problem specific, such as restating the goal, not step specific)	Hint or Help	RE - Hint
Error Clusters	Error Classes	Misconceptions	"We haven't thought that far... " but could be based on meaning, form, orthography	"Working towards that"... will be context dependent	Error Categories	None
Etc	Inter-Help Questions		Latency data to indicate level of student engagement in the exercise	Identifying typical strategies used by students to solve the problem		Knowledge Module - takes students history of correct/incorrect and determines whether they should know a word.