CMU logo
Search
Expand Menu
Close Menu

Faculty Projects

  • illustration of the proof-of-concept editing interface with map-inspired elements, like district, path and landmark
    Project

    VideoMap

    Video editing is a creative and complex endeavor and we believe that there is potential for reimagining a new video editing interface to bette...

  • 3 pane illustration
    Project

    Auptimize

    Spatial audio in Extended Reality (XR) provides users with better awareness of where virtual elements are placed, and efficiently guides them ...

  • side by side images of a person holding gauze on their forehead and an interface with both question answering and proactive interventions
    Project

    PrISM: Procedural Interaction from Sensing Module

    There are numerous complex tasks in everyday life, from cooking to medical self-care, that involve a series of atomic steps. Properly executin...

  • close up of scene reconstruction, data annotation and data summary elements
    Project

    MineXR

    Extended Reality (XR) interfaces offer engaging user experiences, but the...

  • VR scene with some brightly colored underwater plants, text in the center reads "Echo of the Abyss"
    Project

    Echo of the Abyss

    Echo of the Abyss is a Virtual Reality (VR) experience that uses animal guides and immersive environments to cultivate a sense of kinship towa...

  • screenshot of the Jigsaw prototyping system
    Project

    Jigsaw: Supporting Designers to Prototype Multimodal Applications by Assembling AI Foundation Models

    Recent advancements in AI foundation models have made it possible for them to be utilized off-the-shelf for creative tasks, including ideating...

  • Wikibench illustration of a bench made up of the 8 puzzle pieces from the wiki logo
    Project

    Wikibench

    AI tools are increasingly deployed in community contexts. However, datasets used to evaluate AI are typically created by developers and annota...

  • hcii logo watermark
    Project

    What Makes Digital Support Effective?

    Online mental health support communities have grown in recent years for providing accessible mental and emotional health support through volun...

  • hcii-logo-watermark
    Project

    Shaping Online Dialogue

    Community rules play a key part in enabling or constraining the behaviors of members in online communities. However, little is unknown regardi...

  • Soundify assists users in matching sound effects (in bold) and ambients (in italics) to video, and helps dynamically adjust panning and volume by localizing "sound emitters".
    Project

    Soundify

    In the art of video editing, sound is really half the story. Through formative interviews with professional editors (N=10), we found that the ...

  • a full image of a parrot above 8 small squares, each containing a small portion of image. Text reads "Select 4 of the most representative visualizations of the parrot for hints"
    Project

    Eye into AI

    Recent developments in explainable AI (XAI) aim to improve the transparency of black-box models. How...

  • We built a visualization dashboard called Rx RiskMap that communicates and explains the results of a model to predict overdose risk across the state of Pennsylvania. The data shown is outdated and depicted for demonstration purposes only.
    Project

    Predicting and Visualizing Overdose Risk for Public Health

    Overdose due to opioid misuse and abuse is currently a critical public health issue in the United States and worldwide. Machine learning (ML) ...

  • Scenario of a user working with the RealityReplay system with side by side views of the environment with and without RealityReplay
    Project

    RealityReplay

    Humans easily miss events in their surroundings due to limited short-term memory and field of view. This happens, for example, while watching ...

  • Data Navigator provides visualization toolkits with rich, accessible navigation structures, robust input handling, and flexible, semantic rendering.
    Project

    Data Navigator

    Data Navigator is a JavaScript library that allows for navigation of data structures. Data Navigator makes png, svg, canvas, and even webgl gr...

  • screenshot of the Android Network Traces website with a table of tracing info about Meta apps
    Project

    Android Network Traces

    Smartphone apps collect and send a great deal of data about us to third-party websites, but what are they collecting and where are they sendin...

  • matching for peer support - an illustration of 7 different silhouette images with dashed lines to visualize potential interconnectedness
    Project

    Matching for Peer Support

    Online mental health communities (OMHCs) have emerged in recent years as an effective and accessible way to obtain peer support, filling cruci...

  • A before and after that shows a data visualization's screen reader semantics have been improved.
    Project

    Chartability

    Chartability is a set of heuristics (testable questions) for ensuring that data visualizations, systems, and interfaces are accessible. Charta...

  • A grid of six images showing different VR environments (street, museum, supermarket) and different types of navigation instructions (arrows on ground, avatar, call outs).
    Project

    User Preference for Navigation Instructions in Mixed Reality

    Current solutions for providing navigation instructions to users who are walking are mostly limited to 2D maps on smartphones and voice-based ...

  • close up of the ReCompFig kinematic display
    Project

    ReCompFig

    From creating input devices to rendering tangible information, the field of HCI is interested in using kinematic mechanisms to create human-co...

  • UML-style workflow diagram of system. A Mixed Reality layout is generated by users, and an automatic system the adapts its positioning.
    Project

    SemanticAdapt

    We present an optimization-based approach that automatically adapts Mixed Reality (MR) interfaces to different physical environments. Current ...