A graduate of Information Technology from the University of Derby in the United Kingdom, Omotayo Omoyemi, has developed an artificial intelligence tool to assist persons with speech impairment.
The AI tool translates Makaton signs into written English. Makaton is a communication system that combines signs, symbols, and speech, widely used by people with conditions such as autism, cerebral palsy, and stroke-related speech impairments.
A statement by the developer says the tool was designed to break communication barriers and empower Makaton users in classrooms, hospitals, and everyday life.
“Imagine needing to communicate a basic request but being trapped because those around you don’t understand your signs.
“This tool dismantles that barrier, giving users autonomy in education, healthcare, and social interactions,” Omoyemi said.
Unlike existing symbol-based apps that require manual input or rely on pre-selected vocabulary, Omoyemi’s system uses advanced computer vision to analyse live video streams.
It captures gestures, facial expressions, and signing nuances, converting them into text instantly. The tool is equipped with core vocabulary like “help”, “hungry”, and “thank you” and offers customisable features to reflect cultural and religious communication styles.
Omoyemi noted that the innovation incorporates safeguarding alerts to detect signs of distress, such as repeated gestures indicating discomfort, and includes sensory-friendly interfaces to support neurodiverse users.
“It is also built for classroom use, with the ability to sync with educational platforms to enhance learning outcomes for students with communication challenges.
“By prioritising universal design principles, this tool redefines what inclusive technology can achieve.
“This groundbreaking research exemplifies the power of technology to drive social change. By merging IT expertise with a commitment to accessibility, the tool not only advances Makaton’s translation but also sets a precedent for future assistive innovations.
“As development progresses toward prototyping, this tool promises to unlock new possibilities for millions worldwide,” he added.
Omoyemi said the tool was informed by extensive consultations with educators, caregivers, and Makaton users and features context-aware error correction and adaptive vocabulary modules to ensure inclusivity across diverse communities.
For a better society
Follow us across our platforms:
Instagram – https://www.instagram.com/championnewsonline/
Facebook – https://web.facebook.com/championnewsonline
LinkedIn – https://www.linkedin.com/company/champion-newspapers-limited/
https://x.com/championnewsng/
You can also like and comment on our YouTube videos.
https://youtu.be/QIBfD1tT80w?si=R4Qf3so2LxYu3GC2
