A team at Apple analyzed nearly 78,000 screenshots from more than 4,000 apps to improve the screen reader function on its mobile devices. The result was Screen Recognition, a tool that uses machine learning and computer vision to automatically detect and provide content readable by VoiceOver for apps that would otherwise not be accessible.
Researchers Will Develop Prototype Smartphone Interface for Accessible Self-Driving Cars
A team led by the Human-Computer Interaction Institute is one of 10 semifinalists in the U.S. Department of Transportation's Inclusive Design Challenge, which seeks to make self-driving vehicles more accessible to people with disabilities.
Anhong Guo, who recently completed his Ph.D. in the Human-Computer Interaction Institute (HCII) and next month will join the University of Michigan faculty, was named to the 2021 Forbes "30 Under 30" in science for his work on combining human and artificial intelligence to make visual information more accessible.
People with visual impairments use social media like everyone else, often with the help of screen reader software. But that technology falls short when it encounters memes, which don't include alternate text, or alt text, to describe what's depicted in the image.
Amelia Li is threading wires into bits of hardware scattered on a table. As she alternates between red, yellow, blue and green, the master's student of entertainment technology at Carnegie Mellon University keeps the fixated attention of a seamstress. The experimental contraption will go into the wheelchair of Jennifer Phillips who sits next to her.
The Undergraduate Research Symposium, or the "Meeting of the Minds," (MoM) is a university-wide celebration of undergraduate research. More than 700 Carnegie Mellon University students, including several from the Human-Computer Interaction Institute, presented their research on Wednesday, May 8, in the Cohon University Center.
Conducting research is a valuable experience for CMU undergraduates and advisors alike.
Jason Wu, first year human-computer interaction Ph.D. student, received a 2019 Graduate Research Fellowship from the National Science Foundation.
Four faculty members from the Human-Computer Interaction Institute have received 2018 Google Faculty Research Awards.
Google seeks to identify and strengthen long-term collaborative relationships with world-class computer science faculty researchers in areas of mutual interest. The goal of these collaborations is to impact how future generations use technology.
Stockgrok is a web-based tool that provides auditory counterparts to visual cues in charts that are used to assess financial securities. The team worked with Bloomberg, LP to help make financial visualizations more accessible to people with visual impairments. This inclusive solution was designed to empower people with visual impairments to assess financial trends and make buy or sell judgments non-visually.
Over the last two years, Bloomberg’s UX team has partnered with Carnegie Mellon University Master of Human-Computer Interaction program and visually impaired users to prototype next generation accessibility tools.
