CMU logo
Expand Menu
Close Menu

Faculty Projects

  • Scenario of a user working with the RealityReplay system with side by side views of the environment with and without RealityReplay

    RealityReplay

    Humans easily miss events in their surroundings due to limited short-term memory and field of view. This happens, for example, while watching an instructo...

  • Data Navigator provides visualization toolkits with rich, accessible navigation structures, robust input handling, and flexible, semantic rendering.

    Data Navigator

    Data Navigator is a JavaScript library that allows for navigation of data structures. Data Navigator makes png, svg, canvas, and even webgl graphics acces...

  • screenshot of the Android Network Traces website with a table of tracing info about Meta apps

    Android Network Traces

    Smartphone apps collect and send a great deal of data about us to third-party websites, but what are they collecting and where are they sending it?...

  • A before and after that shows a data visualization's screen reader semantics have been improved.

    Chartability

    Chartability is a set of heuristics (testable questions) for ensuring that data visualizations, systems, and interfaces are accessible. Chartability is or...

  • A grid of six images showing different VR environments (street, museum, supermarket) and different types of navigation instructions (arrows on ground, avatar, call outs).

    User Preference for Navigation Instructions in Mixed Reality

    Current solutions for providing navigation instructions to users who are walking are mostly limited to 2D maps on smartphones and voice-based instructions...

  • close up of the ReCompFig kinematic display

    ReCompFig

    From creating input devices to rendering tangible information, the field of HCI is interested in using kinematic mechanisms to create human-computer inter...

  • UML-style workflow diagram of system. A Mixed Reality layout is generated by users, and an automatic system the adapts its positioning.

    SemanticAdapt

    We present an optimization-based approach that automatically adapts Mixed Reality (MR) interfaces to different physical environments. Current MR layouts, ...

  • screenshot of the choose sound categories, checkbox lists of different sound options

    Polyphonic

    The Polyphonic project explores collecting real-world data by piggybacking on game streaming communities such as Twitch, which capture over a trillion min...

  • HCII logo, grey watermark

    Games and Climate

    How can games help address the challenge of climate change? Through research and design, we are exploring ways that games can motivate collective action, ...

  • splash screen for Bloomwood Stories: Block Party

    Bloomwood Stories

    Bloomwood Stories: Block Party is a visual novel that aims to increase players' health self-efficacy and connect them to health resources at their local l...

  • Social Cybersecurity

    Our research into the human factors of cybersecurity focuses on people as social actors whose security behaviors are influenced by their relationships, co...

  • sensing relationships icon: a continuous loop between a person and their friends with a mobile phone in the middle

    Understanding Mental Health with Mobile Sensing

    Understanding how our family and friends affect our mental health People are social beings in nature and our friends and family play a crucial part in ou...

  • scatterplot graph of the landscape of HCI literature using machine learning

    Increasing Design Innovation

    Design innovation often follows technical advances. For example, when Philips invented the cassette recorder in 1962, designers innovated this technology ...

  • closeup of IoT coffee table

    IoT Coffee Table

    Communicates what the environment is sensing Today people increasingly find themselves in spaces that invisibly sense them. The increasing use of cameras...

  • 2 side by side photos of an HCII PostDoc and PhD student with the SpokeSense prototype at the NWBA basketball tournament

    SpokeSense

    A Wearable Fitness Tracker for Wheelchair Athletes Information provided by traditional fitness trackers is not always relevant to athletes of all abiliti...

  • this flat, white 3D printed item self-folded into the shape of a rose when exposed to heat

    Thermorph: Flat, 3D Printed Materials that Self-Fold When Heated

    Researchers at Carnegie Mellon University have used an inexpensive 3-D printer to produce flat plastic items that, when heated, fold themselves into prede...

  • smartwatch on right wrist projecting the interface onto the wearer's forearm

    LumiWatch

    While smartwatches are convenient, there is a limit to their functionality due to their small interfaces. Enter LumiWatch. ...

  • a person touches a wall in 2 places which is recognized by the wall's sensors and displayed on a nearby laptop screen

    Wall++

    Researchers at Carnegie Mellon University's Human-Computer Interaction Institute and Disney Research found that they could make walls "smart" at relativel...

  • teacher's view of 3 wide rows students and desks from the front of the classroom with the Class In Sight technology overlay

    ClassInSight

    While much of education research is focused on student performance, this research turns the focus to the development of the teacher....

  • Demonstration of VizLens app

    VizLens

    VizLens: A Robust and Interactive Screen Reader for Interfaces in the Real World The world is full of physical interfaces that are inaccessible to blind ...