Cornell Tech Student Transforms Assistive Communication

At 15, when a neurological condition took Tobias Weinberg’s ability to speak, aspects of his personality became more difficult to express.

Typing to communicate, he struggled to keep up in conversations, especially to make the jokes or sarcastic comments that had been his norm. And his first text-to-voice device was monotone, with Mexican or Spanish accents but not his native Argentinian.

“The monotone voices, the timing of interjections and conveying my personality through this new way of communication was definitely frustrating,” wrote Weinberg, now a doctoral student and Siegel PiTech Fellow at Cornell Tech. As part of the Matter of Tech Lab, he is exploring how artificial intelligence (AI) can enhance the technologies that he and more than two million Americans with speech disabilities use to communicate.

Through a standing partnership between Cornell Tech and YAI—a nonprofit that supports more than 20,000 people with intellectual and developmental disabilities in New York, New Jersey and California—Weinberg spent a year working with a group of Augmentative and Alternative Communication (AAC) users who live in group homes in Tarrytown, New York to better understand needs and behaviors and to improve prototypes.

Before pursuing his doctorate at Cornell Tech, Weinberg earned his bachelor’s degree in mechanical engineering at the Technion — Israel Institute of Technology, where he first developed his passion for using technology to improve lives.