
Skeema
Skeema is a new way to manage your tabs that helps to declutter your browser and your mind. ...

Studying and designing for human-AI collaborative work in real-world contexts
Across a range of real-world contexts, we are studying how AI is currently being designed and used to augment or transform worker practices. Moving beyond...
Ken Holstein, Anna Kawakami, Frederic Gmeiner, Luke Guerdan, Haiyi Zhu, Nikolas Martelaro, Steven Wu
Applied Machine Learning, Artificial Intelligence (AI), Computational Creativity, Design Research, Fairness, Accountability, Transparency, and Ethics (FATE), Future of Work, Human-Centered AI, Learning Sciences and Technologies, Societal Problems

Empowering and Enhancing Workers Through Building A Community-Centered Gig Economy
The gig economy is characterized by short-term contract work performed by independent workers who are paid in return for the "gigs" they perform. Example ...
Haiyi Zhu

Advancing Fairness in AI with Human-Algorithm Collaborations
Artificial intelligence (AI) systems are increasingly used to assist humans in making high-stakes decisions, such as online information curation, resume s...
Artificial Intelligence (AI), Fairness, Accountability, Transparency, and Ethics (FATE), Human-Centered AI, Societal Problems

Incorporating and Balancing Stakeholder Values in Algorithm Design
This project will create a general method for value-sensitive algorithm design and develop tools and techniques to help incorporate the tacit values of st...
Haiyi Zhu
Artificial Intelligence (AI), Fairness, Accountability, Transparency, and Ethics (FATE), Human-Centered AI, Social Computing

User Preference for Navigation Instructions in Mixed Reality
Current solutions for providing navigation instructions to users who are walking are mostly limited to 2D maps on smartphones and voice-based instructions...
David Lindlbauer

Towards Understanding Diminished Reality
Diminished reality (DR) refers to the concept of removing content from a user's visual environment. While its implementation is becoming feasible, it is s...
David Lindlbauer

SemanticAdapt
We present an optimization-based approach that automatically adapts Mixed Reality (MR) interfaces to different physical environments. Current MR layouts, ...
David Lindlbauer

ReCompFig
From creating input devices to rendering tangible information, the field of HCI is interested in using kinematic mechanisms to create human-computer inter...
Computational Fabrication, Computational Creativity, Tools, Virtual Reality (VR), Wearables

Polyphonic
The Polyphonic project explores collecting real-world data by piggybacking on game streaming communities such as Twitch, which capture over a trillion min...

Games and Climate
How can games help address the challenge of climate change? Through research and design, we are exploring ways that games can motivate collective action, ...

Bloomwood Stories
Bloomwood Stories: Block Party is a visual novel that aims to increase players' health self-efficacy and connect them to health resources at their local l...

Understanding Mental Health with Mobile Sensing
Understanding how our family and friends affect our mental health People are social beings in nature and our friends and family play a crucial part in ou...

Increasing Design Innovation
Design innovation often follows technical advances. For example, when Philips invented the cassette recorder in 1962, designers innovated this technology ...
Design Research

IoT Coffee Table
Communicates what the environment is sensing Today people increasingly find themselves in spaces that invisibly sense them. The increasing use of cameras...
John Zimmerman
Design Research

SpokeSense
A Wearable Fitness Tracker for Wheelchair Athletes Information provided by traditional fitness trackers is not always relevant to athletes of all abiliti...
Accessibility

VizLens
VizLens: A Robust and Interactive Screen Reader for Interfaces in the Real World The world is full of physical interfaces that are inaccessible to blind ...
Jeffrey Bigham

Thermorph: Flat, 3D Printed Materials that Self-Fold When Heated
Researchers at Carnegie Mellon University have used an inexpensive 3-D printer to produce flat plastic items that, when heated, fold themselves into prede...
Lining Yao

LumiWatch
While smartwatches are convenient, there is a limit to their functionality due to their small interfaces. Enter LumiWatch. ...
Tools

Wall++
Researchers at Carnegie Mellon University's Human-Computer Interaction Institute and Disney Research found that they could make walls "smart" at relativel...
Scott Hudson,

ClassInSight
While much of education research is focused on student performance, this research turns the focus to the development of the teacher....

The Knowledge Accelerator
Researchers from the Human-Computer Interaction Institute are working on a system they call Knowledge Accelerator. A system that uses a machine-learning p...
Crowdsourcing

Modeling and Understanding Human Routine Behavior
Everyone has some kind of routine. Whether it's how you get ready each morning or how you drive your car, routines are behavior blueprints that help us pu...
Digital Footprints
Personal information management and privacy is a major and increasing challenge. New internet architectures will make people and their interactions more t...
Social Computing
Audio Emotion Recognition
We have built an emotion recognition system based on prosodic features (i.e. intensity, pitch, formant frequencies of sounds) combined with short-term per...
Daniel Siewiorek
Virtual Rehabilitation Assistants (VRAs)
VRAs are applications of wearable devices which track patient home exercises in order to quantify exercise metrics regarding compliance, performance, and ...
Daniel Siewiorek
Virtual Coach for Stroke Rehabilitation Therapy
This Virtual Coach evaluates and offers corrections and feedback for rehabilitation of stroke survivors. The Virtual Coach is composed of a tablet for cli...
Daniel Siewiorek
Seating Coach
The goal of Seating Coach (SC) is to facilitate power wheelchair users to utilize auxiliary seating functions for health management while preventing poten...
Daniel Siewiorek
Health Kiosk
Our contention is that multi-user health kiosks, designed with input from older adults and situated in convenient community locations, offer a way to bols...
Daniel Siewiorek
Connection Machines
Our Connection Machines project investigates nonverbal and verbal behaviors of two partners in a conversation setting in the context of rapport. We have c...
Justine Cassell,