In a groundbreaking study, a team of researchers from Cornell Tech is revolutionizing the way technology supports individuals with speech disabilities. The focus is not only on functional speech but also on incorporating real-time humor into conversations for users of augmentative and alternative communication (AAC) technology.
The research delves into how artificial intelligence interfaces can assist AAC users in delivering witty remarks during conversations, a challenging task due to the slow pace of traditional AAC systems. Lead author Tobias Weinberg, a Ph.D. student at Cornell Tech who relies on AAC technology himself, emphasizes the importance of humor in social interactions and the difficulty of timing jokes when communication is impaired.
The study, titled “Why So Serious? Exploring Timely Humorous Comments in AAC Through AI-Powered Interfaces,” was recognized with awards at the Association for Computing Machinery’s Conference on Human Factors in Computing Systems (CHI ’25). Collaborating with researchers from Cornell Tech and the Cornell Ann S. Bowers College of Computing and Information Science, as well as assistant professor Stephanie Valencia from the University of Maryland, the project aimed to develop AI-powered tools that enable AAC users to express humor effectively.
The research introduced participants with speech disabilities to four AI-assisted interfaces: “Full-auto,” “Keywords,” “Context Bubble Selection,” and “Wizard.” Each interface offered a different balance of speed and control, allowing users to generate or fine-tune jokes to match their personal style. The study revealed that participants initially preferred more agency in crafting jokes but ultimately favored time-efficient interfaces after using the tools.
Weinberg highlights the importance of humor in communication, stating that even if a joke is not entirely original, it still serves its purpose of eliciting laughter. However, the study also identified challenges, such as scrolling difficulties for users relying on eye-gaze or joystick input and the lack of emotional nuance in text-to-speech voices.
The project advisor, Thijs Roumen, emphasized the trade-off between agency and timing in AI-based interfaces and the importance of empowering individuals with disabilities to express themselves fully. The study calls for further research to enhance expressivity in AAC communication and enable individuals with speech impairments to engage in conversations and thrive in society.
Overall, the research sheds light on the need for innovative solutions to improve AAC devices and underscores the significance of fostering self-expression, humor, and emotional connections for individuals with disabilities. By exploring the intersection of technology and communication, the study paves the way for future advancements in accessibility research.
For more information, the paper titled “Why So Serious? Exploring Timely Humorous Comments in AAC Through AI-Powered Interfaces” can be accessed in the Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems.
