The Scott-Morgan Foundation and Lenovo have launched a new technology suite combining predictive AI, hyper-realistic avatars, personalized voices and eye tracking.
SEATTLE, Washington, October 15, 2024 – Today, at Lenovo Tech World ’24the global technology leader Lenovo and the Scott Morgan Foundation (SMF), an innovative and pioneering assistive technology nonprofit, revealed an AI-powered solution for people with amyotrophic lateral sclerosis (ALS) and other severe disabilities. Scalable new technology reveals new possibilities for applying generative AI to accessibility challenges and advances a shared vision for service delivery. Smarter AI for everyone.
The integrated solution combines a circular keyboard interface designed by SMF and built by Lenovo, Lenovo’s predictive AI, custom AI voice replicas from ElevenLabshyper realistic avatars of DIDand eye tracking technology IrisBond to provide fast, accurate and personal communication.
The proof of concept, currently in active testing with the SMF community of people with ALS and leading clinicians, builds on years of collaboration between SMF and Lenovo to reinvent and evolve assistive technologies. Focusing on ALS, a neurodegenerative disease that typically leads to full-body paralysis, inspires solutions that benefit countless other illnesses and disabilities.
Lenovo Tech World opened with the story of a father recently diagnosed with ALS using technology to tell stories and sing lullabies to his two young children in his own voice.
“This is about smarter AI for everyone: applying transformative technologies to the most pressing human challenges,” said Linda Yao, vice president of AI Solutions and Services at Lenovo. “With compassionate partners like the Scott-Morgan Foundation and a bold vision to bring AI to everyone, we are using our AI expertise and portfolio to show how bright the future can be.” »
The collaboration was born from SMF’s mission to break down barriers between technologies and democratize life-changing solutions that ensure a universal right to thrive.
“We live in a world where more than half a billion people are silenced, not by choice, but by disability,” said LaVonne Roberts, executive director of SMF. “Imagine a world where even the most severely disabled can fully express themselves, where cutting-edge technology gives voice to the voiceless. We don’t just imagine this world: we build it with Lenovo. With more 500 million people worldwide struggle with muscular or neurological diseasesour work has the potential to impact lives on a large scale.
Live at Lenovo Tech World
Erin Taylor, a disability advocate and botany enthusiast with ALS, used technology to introduce herself and then welcome Lenovo Chairman and CEO Yuanqing Yang to the stage at Tech World.
“I find renewed strength and hope when I see what is possible with technology, especially with the latest advances in AI,” said Erin, who shares her experiences and insights with a company growing. social media audience. “Speaking with my voice as it sounded before diagnosis is of course amazing, but what excites me most is being a part of developing smarter technology for others.”
Erin also helped demonstrate the technology on the show floor and continues to provide key feedback to the development team.
Building on early designs first revealed at CES 2024Lenovo led the development of a fully functional, fully integrated prototype.
“We prioritized human-centered design and leveraged our expertise in innovative user experiences,” said Lenovo UX prototyper Daniel Pollock, who led the development of the interface. “It is an absolute privilege to contribute and collaborate on this project and integrate such powerful AI technology.”
Building an AI innovation consortium
Traditional voice banking is an arduous process, often limited by the vocal deterioration that can appear as an early symptom of ALS. Older models also suffered from a distinct lack of emotional expressiveness, limited to robotic cadences and artificial rhythms, but AI has changed all that. Now, limited audio samples, even low quality, can generate convincing, on-demand AI voice.
“Over the past year, we have been deeply inspired by individuals who have reclaimed their voices despite all challenges, and we are grateful for the chance to play a small part in this process,” said Mati Staniszewski, CEO of ElevenLabs. “Now with the incredible support from the Scott-Morgan Foundationwe’re taking these efforts to the next level. We are proud to help break down communication barriers and empower people.
This personalized voice feeds directly into D-ID’s avatar technology. Again, scalability and simplicity are a priority with assistive technologies, and D-ID is capable of generating realistic avatars from still photos or very limited videos.
“This powerful technology is so often used for commercial or entertainment purposes – which of course we love to see and support – but it is in promoting social good that we see it being life-changing. D-ID has a long track record of using its technology to help worthy causes such as combatting domestic violence, sex trafficking awareness, and numerous education and advocacy efforts,” said Gil Perry, co-founder and CEO of D-ID. “Working with this collaboration fits perfectly with our strategy of using AI to make the world a better, more connected place. »
The complete solution currently runs on Lenovo’s ThinkPad x12 detachable PC, which offers an ideal combination of power and portability. The removable form factor allows the device to easily mount on a variety of surfaces, from kitchen tables to wheelchairs, and integrate with IrisBond’s eye tracking hardware and software. Here, IrisBond used its Hiru camera, which works across multiple platforms and in different conditions to accurately track eye movements. Lenovo is also developing more personalized AI models to facilitate communication.
“We have been working with SMF for several years to help disrupt the assistive technology landscape and give people greater freedom of action and independence,” said Eduardo Jauregui Torrecilla, CEO of IrisBond. “We have a history of supporting and practical development for people with ALS, cerebral palsy and countless diseases in which the eye is our best communication tool – and AI is transforming what is possible in extraordinary ways .
The Scott-Morgan Foundation will work directly with clinicians, technologists and people with ALS to further refine and test the technology.
This solution was one of the dreams of visionary roboticist Dr. Peter Scott-Morgan, who died in 2022. At the time, creating an avatar or speaking with a banking voice was time-consuming, expensive, resource-intensive, and a lot less expressive. and precise than what is possible with generative AI.
“Technology has advanced significantly over the past two years, thanks to AI,” said Andrew Morgan, CEO of the Scott-Morgan Foundation. “We have always believed that AI is the gateway to a revolution in assistive technologies, but we must raise our voices and advocate for these solutions, to give a voice to those who have them most needed and include them in the process. We are still in uncharted territory and I can’t wait to see what solutions we come up with and democratize next.
