Computer learning system detects emotions in text messages

June 29, 2015
Kevin Hattori

Despite the use of smiley faces and exclamation points, it is all too easy to misinterpret sarcasm, humor, irony or determination in a text or email message. That may all change thanks to the efforts of Eden Saig, a computer science student at the Technion-Israel Institute of Technology, who developed a computerized learning system that can detect emotional sentiments expressed in a text message or email based on recognizing repeated word patterns.

SmartphoneSM1His student project, entitled “Sentiment Classification of Texts in Social Networks,” won the annual Amdocs Best Project Contest, sponsored by Amdocs, a provider of software and services to more than 250 communications, media and entertainment service providers in more than 80 countries. Saig developed the system at the Technion’s Learning and Reasoning Laboratory, after taking a course in artificial intelligence supervised by Professor Shaul Markovich, of the Faculty of Computer Science.

According to Saig, voice tone and inflections play an important role in conveying one’s meaning in verbally communicated message. In text and email messages, those nuances are lost and writers who want to signify sarcasm, sympathy or doubt have taken to using images, or “emoticons,” such as the smiley face, to compensate.

“These icons are superficial cues at best,” said Saig. “They could never express the subtle or complex feelings that exist in real life verbal communication.”

Recently, pages intended to be humorous on social networks such as Facebook and Twitter were titled “superior and condescending people,” or “ordinary and sensible people.” Such pages are very popular in Israel, said Saig, and users are invited to submit suggestions for phrases that can be labeled as ‘stereotypical sayings,’ for that particular page. Tens of thousands of friends and followers joined these groups.

By observing posts to these groups, Saig was able to identify existing patterns, The method he developed enables the system to detect future patterns on any social network, he added.

Since the content in these sections was colloquial, everyday language, Saig realized that, “the content could provide a good database for collecting homogeneous data that could, in turn, help ‘teach’ a computerized learning system to recognize patronizing sounding semantics or slang words and phrases in text.”

The project applied ‘Machine-Learning’ algorithms to the content on these pages and used the results to automatically identify stereotypical behaviors found every day in social network communication.

The quantification was carried out by examining 5,000 posts on social media pages and, through statistical analysis, gearing a learning system to recognize content structure that could be identified as condescending or slang. The system was constructed to identify key words and grammatical habits that were characteristic of sentence structure implied by the content’s sentiments. The repeated patterns were learned automatically through a text analysis system designed specifically for analyzing popular social networking groups. Saig found that the greatest accuracy could be obtained when the system combined keyword searches with grammatical structural analysis. He also found that accuracy improved when the number of “Likes” a message received was taken into account.

“Now, the system can recognize patterns that are either condescending or caring sentiments and can even send a text message to the user if the system thinks the post may be arrogant,” explained Saig.

The method he developed has many potential pragmatic applications beyond clarifying emotions or feelings in interpersonal communication on social media.

When applied to other networking pages it may help detect content that suggests suicidal ideations, for example, or ‘calls’ for help, or expressions of admiration or pleasure.”

“I hope that ultimately I can develop a mechanism that would demonstrate to the writer how his or her words could be interpreted by readers, thereby helping people to better express themselves and avoid being misunderstood,” he concluded.

The Technion-Israel Institute of Technology is a major source of the innovation and brainpower that drives the Israeli economy, and a key to Israel’s renown as the world’s “Start-Up Nation.” Its three Nobel Prize winners exemplify academic excellence. Technion people, ideas and inventions make immeasurable contributions to the world including life-saving medicine, sustainable energy, computer science, water conservation and nanotechnology. The Joan and Irwin Jacobs Technion-Cornell Institute is a vital component of Cornell Tech, and a model for graduate applied science education that is expected to transform New York City’s economy.

American Technion Society (ATS) donors provide critical support for the Technion—more than $2 billion since its inception in 1940. Based in New York City, the ATS and its network of supporters across the U.S. provide funds for scholarships, fellowships, faculty recruitment and chairs, research, buildings, laboratories, classrooms and dormitories, and more.