CHI2015: Learning in the Real World Tops Learning From a Tablet
News
You see it in headlines with more and more frequency: "Local School Provides Tablets for All Students." But though screen technologies are ubiquitous and certainly appealing for children, it's worth asking whether kids still need real-world experimentation with physical objects to enhance their learning. A group of HCII researchers recently demonstrated that the answer to that question is a resounding yes.
HCII Ph.D. student Nesra Yannier, working with HCII faculty Ken Koedinger and Scott Hudson, designed an experiment that investigated whether 92 children ages 6–8 learned more from a mixed-reality (combining physical and virtual worlds) or screen-only educational game, and the effect that adding a physical component (like shaking the screen) had on the students' enjoyment of the activity. Their findings, "Learning From Mixed-Reality Games: Is Shaking a Tablet as Effective as Physical Observation?" were presented at the recent Association for Computing Machinery’s (ACM) Conference on Human Factors in Computing Systems (CHI2015) and received an Honorable Mention award.
In the experiment, students played one of four versions of "EarthShake," a learning game that uses a friendly gorilla and towers made from blocks to teach students scientific thinking and basic physics principles like stability and balance. The original mixed-reality version of the game includes an earthquake table, the towers, and a projected video game synchronized with the real world via a Kinect depth camera sensing and a specialized algorithm. At the beginning of the game, the gorilla asks the students which of two towers on the earthquake table in front of them will fall first, and the students use a mouse to select the tower on the projected interface. After collaboratively discussing why they think the tower will fall, the students use a mouse to press the shake button on the projected screen, and an experimenter activates the earthquake table with a switch. Once the tower falls down, the game recognizes the results in the real world and gives interactive feedback accordingly. If the students chose the correct tower, the gorilla congratulates them and asks them why they think it fell. If they're wrong, the gorilla nicely tells them so. Both groups then select the reason why they thought it fell from a list of possible explanations.
The experimenters developed three variations on the original game to explore how physical interaction affects learning, how enjoyment affects learning and if enjoying the exercise leads to enhanced learning. In the first modification, students played the mixed-reality game but could control the earthquake table themselves with a physical switch — with no experimenter intervention. In the second modification, students played a screen-only version of the game on a laptop, but answered questions and pressed the shake button with a mouse. In the final variation, students played the screen-only version on a tablet, and could shake the tablet at earthquake time. Testing was done both before and after the game to measure learning.
In the final analysis, Yannier and her colleagues found that the mixed-reality game improved learning by almost five times more than the screen-only alternatives, both in the mouse-controlled and physically controlled conditions. Not only that, but students enjoyed the game more in the mixed-reality conditions. They also determined that simple physical controls like shaking the tablet or pushing the earthquake button did little to improve either learning or enjoyment of the game.
"Mixed-reality games that support physical observation in the real world have a great potential to enhance learning and enjoyment for young children," the researchers concluded. They aim to extend their mixed-reality game to different content areas to create a new educational system that bridges the advantages of physical and virtual worlds to improve children’s science learning, understanding and enjoyment in a collaborative way.
Read the paper here, and watch a video of the research in action here. Don't miss the media coverage for their research on sites like Education Week, Education News, Silicon Angle, the KINECT for Windows blog, The Journal and Vision UX.