Star Trek-style communicator hopes to break down cultural barriers -

Star Trek-style communicator hopes to break down cultural barriers

Credit: phys.org

  • About: 6 days ago
  • 3 views
Users will be able to communicate easily with technology that translates any language instantly. Credit: Pixabay/ terimakasih0

In Star Trek, the technology to instantly translate any language was first developed in the late 22nd century, but today researchers are already working on ways to take universal communication even further.

Mobile phone applications make it possible to translate into many different languages, but imagine giving a thumbs-up to someone from the Middle East or West Africa at the end of a chat – in most western cultures it is a sign of pleasure, but to them the signal is an outrageous insult.

"It is often much easier to understand someone if you can see them because what is being said in a conversation extends far beyond the spoken word," said Professor Leo Wanner, a computational linguistics researcher at the Pompeu Fabra University in Barcelona, Spain.

"It is about the tone of the voice, the and the gestures. But there are social idiosyncrasies that vary between cultures."

Prof. Wanner is leading the EU KRISTINA project which aims to interpret language alongside cultural barriers in order to develop a personal translation assistant. They are working on software that can watch, listen and respond to migrants in ways that are socially appropriate to them or translate their needs for locals.

"Helping people overcome barriers when they arrive in an unfamiliar country is not just about translating the language – it is rather about communication that requires social, cultural and background knowledge. This is what our socially intelligent conversation agent is trying to do," said Prof. Wanner.

The agent takes the form of a digital platform that can respond to questions from users in their native language. Prof. Wanner said the goal is to develop a system that runs on devices like tablets and laptops.

The overall aim is to make these interactions as normal and natural as possible so users can ask questions, and chat, as if they were talking to another human being, which, for example, would help migrants integrate better when they arrive in a new country.

"Migrants who arrive in European countries may not be familiar with the health system at all," he said. "Our agent would be able to assess their problem based on their age, location, gender, and other things – so it can tell them in natural language where they need to go."

KRISTINA aims to provide quick translations to make it easier for migrants to integrate. Credit: KRISTINA

A prototype of the system, which can understand English, German, Spanish and Polish, is being evaluated in a healthcare context in Spain and Germany, while Turkish and Arabic will be added later.

In another setting, KRISTINA is being used to help Polish care workers who are looking after elderly patients in Germany.

"The caregivers do not know the (German) language that well or the preferences of the elderly person they are looking after, so the agent can be an intermediary," said Prof. Wanner.

Vulnerable populations

Around 4.1 % of the elderly population in Europe were born outside the EU. Interacting with people from such diverse backgrounds can be difficult and requires a deeper understanding of their background and cultures than most translation software can provide.

KRISTINA's digital assistant aims to further help these people by recording sample conversations and building up a bank of basic knowledge. The system then builds on these conversations using machine learning, a type of automated data analysis, to help it recognise facial expressions, gestures and changes in the tone of voice.

Prof. Wanner said: "If we have an greet the virtual agent in a bit of a depressed voice in the morning, it will recognise that and ask what is wrong.

"It will ask if they slept poorly or look for anything it can do to cheer them up. For example, it might remind them their family are coming to visit later that afternoon."

The idea of communicating with people in ways that are familiar to them is something Professor Mirella Lapata, from the University of Edinburgh, UK, also believes is essential. She has been developing technology that doesn't simply translate information for people – it makes it simpler.

Just think of the often incomprehensible terminology on tax forms and complex phrasing used on other official documents such as customs declarations. Then imagine tackling those in a second language.

Prof. Lapata, who is leading an EU European Research Council project called TransModal, is using machine learning to unravel key information from text, images, video and even computer code so it can be used by anyone.

"What we are proposing is not just something like Google Translate but much more like Google Simplify," she explained. "The idea is you press a button or scan a document with your phone and get a simpler version."

For someone with only a basic understanding of a second language, this could help them access information that has previously been mystifying to them, according to Prof. Lapata.

She said: "If you have an immigrant who comes to the UK, for example, they will struggle to do day-to-day stuff like going to the bank or to the post office because they cannot read the . The idea is to simplify the information they see so they can understand it."

Prof. Lapata hopes the algorithms involved could eventually be used through an application on a mobile phone or a button on a web-browser.

It is still early days, but Prof. Lapata believes the uses could also extend far beyond helping those who struggle with foreign languages.

"People who have poor literacy skills could definitely benefit," she said. "Teachers could also use it to produce materials that are aimed at a range of abilities."

Follow Us on Twitter

Related stories with Star Trek-style communicator hopes to break down cultural barriers

Automated safety systems are preventing car crashes -World News
Automated safety systems are preventing car crashes 6 days ago
Safety systems to prevent cars from drifting into another lane or that warn drivers of vehicles in their blind spots are beginning to live up to their potential to significantly reduce crashes, according to two studies released Wednesday.
Here's how we can stop driverless cars from being hacked -World News
Here's how we can stop driverless cars from being hacked 6 days ago
Once hackers get into your internet-connected car, they could disable the air bags, brakes, door locks and even steal the vehicle. That's the finding of researchers who recently uncovered a flaw in the way the different components of a connected car talk
Industry expected to advance research innovated by Army-led science consortium -World News
Industry expected to advance research innovated by Army-led science consortium 6 days ago
Work to develop small autonomous robots through a 10-year effort led by the U.S. Army Research Laboratory is helping to inform the development of future swarms of heterogeneous Army systems for air and ground - large and small - that work collaboratively.
Samsung okay to test self-driving cars in California -World News
Samsung okay to test self-driving cars in California 6 days ago
Samsung Electronics has joined the self-driving car race in California with a permit from the state to test the technology on the home turf of Tesla, Google, and Apple.
At TEDGlobal: Somali start-ups and a new kind of map -World News
At TEDGlobal: Somali start-ups and a new kind of map 6 days ago
From fostering innovation in one of the world's harshest environments to novel ways to repel mosquitoes and map the world, here are some highlights from the TEDGlobal conference in Arusha, Tanzania.
China fast-food operator pilots face-recognition payments -World News
China fast-food operator pilots face-recognition payments 6 days ago
The operator of KFC in China is rolling out a futuristic system of paying at a fast-food counter via facial recognition, as the country embraces the technology for everything from toilet paper to travel.
Car navigation tech brings new twists and turns to driving -World News
Car navigation tech brings new twists and turns to driving 6 days ago
Digital maps that dodge traffic jams are saving time for millions of motorists, but they're also turning some neighborhood streets into headache-inducing escape routes from congested highways.
House passes bill to speed deployment of self-driving cars -World News
House passes bill to speed deployment of self-driving cars 6 days ago
The House voted Wednesday to speed the introduction of self-driving cars by giving the federal government authority to exempt automakers from safety standards not applicable to the technology, and to permit deployment of up to 100,000 of the vehicles annu
China seeks more competent translators as it exports more books to other countries -World News
China seeks more competent translators as it exports more books to other countries 6 days ago
September 14, 2017 2:02 PMBEIJING (CHINA DAILY/ASIA NEWS NETWORK) - China will export more publications to other countries, both in print and digital formats, to further expand its visibility, officials said. And it could do with more translators.
North Korea threatens to 'sink' Japan, reduce US to 'ashes and darkness' -World News
North Korea threatens to 'sink' Japan, reduce US to 'ashes and darkness' 6 days ago
A North Korean state agency threatened on Thursday to use nuclear weapons to "sink" Japan and reduce the United States to "ashes and darkness" for supporting a U.N. Security Council resolution and sanctions over its latest nuclear test.
More people took up subsidised training courses last year: SkillsFuture Singapore -World News
More people took up subsidised training courses last year: SkillsFuture Singapore 6 days ago
A total of 418,000 people took up 950,000 training course places funded by the Ministry of Education and SkillsFuture Singapore last year, an increase from the 379,000 people who took up 835,000 places in 2015.
Koeman wants strong Everton reaction against Atalanta -World News
Koeman wants strong Everton reaction against Atalanta 6 days ago
Everton must forget their Premier League thrashing by Tottenham Hotspur over the weekend and respond strongly against Italy's Atalanta in the Europa League, manager Ronald Koeman has said.