Follow Us

We use cookies to provide you with a better experience. If you continue to use this site, we'll assume you're happy with this. Alternatively, click here to find out how to manage these cookies

hide cookie message

Cambridge researchers develop virtual assistant of the future

Talking head based on the face of actress Zoe Lister can replicate human emotions

Article comments

A virtual “talking head,” which can express a full range of human emotions and could be used as a digital personal assistant, has been developed by researchers at Toshiba’s Cambridge Research Lab and the University of Cambridge’s Department of Engineering.

Known as Zoe, the talking head is based on the face of actress Zoe Lister, who plays Zoe Carpenter in the Channel 4 series Hollyoaks. Zoe can display emotions such as happiness, anger, and fear, and changes its voice to suit the feeling that the user wants it to simulate.

Users can type in a message, specifying the requisite emotion or combination of emotions, and the face will recite the text. According to its designers, Zoe is the most expressive controllable avatar ever created, replicating human emotions with “unprecedented realism”.

To make the system as realistic as possible, the research team collected a dataset of thousands of sentences, which they used to train the speech model. They also tracked Lister’s face while she was speaking using computer vision software.

This was then converted into voice and face-modelling, mathematical algorithms which gave the researchers the voice and image data they needed to recreate expressions on a digital face, directly from the text.

The program used to run Zoe is just tens of megabytes in size, which means that it can be easily incorporated into even the smallest computer devices. This means that the could be used as a personal assistant in smartphones and tablets, or to “face message” friends.

The framework behind Zoe is also a template that, before long, could enable people to upload their own faces and voices, so that in the future users will be able to customise and personalise their own, emotionally realistic, digital assistants.

“This technology could be the start of a whole new generation of interfaces which make interacting with a computer much more like talking to another human being,” said Professor Roberto Cipolla from the Department of Engineering, University of Cambridge.

“It took us days to create Zoe, because we had to start from scratch and teach the system to understand language and expression. Now that it already understands those things, it shouldn’t be too hard to transfer the same blueprint to a different voice and face.”

The team who created Zoe are currently looking for applications, and are also working with a school for autistic and deaf children, where the technology could be used to help pupils to “read” emotions and lip-read.

Ultimately, the system could have multiple uses – including in gaming, in audio-visual books, as a means of delivering online lectures, and in other user interfaces, according to the researchers.


More from Techworld

More relevant IT news


Send to a friend

Email this article to a friend or colleague:

PLEASE NOTE: Your name is used only to let the recipient know who sent the story, and in case of transmission error. Both your name and the recipient's name and address will not be used for any other purpose.

Techworld White Papers

Choose – and Choose Wisely – the Right MSP for Your SMB

End users need a technology partner that provides transparency, enables productivity, delivers...

Download Whitepaper

10 Effective Habits of Indispensable IT Departments

It’s no secret that responsibilities are growing while budgets continue to shrink. Download this...

Download Whitepaper

Gartner Magic Quadrant for Enterprise Information Archiving

Enterprise information archiving is contributing to organisational needs for e-discovery and...

Download Whitepaper

Advancing the state of virtualised backups

Dell Software’s vRanger is a veteran of the virtualisation specific backup market. It was the...

Download Whitepaper

Techworld UK - Technology - Business

Innovation, productivity, agility and profit

Watch this on demand webinar which explores IT innovation, managed print services and business agility.

Techworld Mobile Site

Access Techworld's content on the move

Get the latest news, product reviews and downloads on your mobile device with Techworld's mobile site.

Find out more...

From Wow to How : Making mobile and cloud work for you

On demand Biztech Briefing - Learn how to effectively deliver mobile work styles and cloud services together.

Watch now...

Site Map

* *