Neural networks and the future of translation




Greater than 5 minutes, my friend!

A conference with big brands like Apple, Google and Facebook as the main sponsors does not happen that often and certainly not in the translation industry. Nevertheless that is exactly what happened last weekend in Copenhagen, where the 2017 Conference on Empirical Methods on Natural Language Processing was held. You guessed it: participants to this weekend conference with the long and difficult title dived into machine translation. The sponsorship by the big brands clearly shows a huge interest in MT by companies that spend billions of dollars on research that will probably pay off some day. What is all the fuss about?

The facts

Machine translation is a hot potato that has been engaging the moods of translation professionals for many years already. While it often leads to fierce discussions in the industry, not many companies have shown their interest openly. So far, only a few players in the technology market have offered publicly available machine translation services, like Google with Google Translate and Microsoft with Bing Translate. However, the emergence of the cloud, together with powerful computers to compute complex calculations within nano seconds is changing the landscape. After Google and Microsoft other major tech companies are trying to secure a market share as well. This interest can be explained by the forecasts market research companies are projecting: in April this year Global Market Insights, Inc. announced that the machine translation market will hit $1.5 billion by 2024. More recently, in August P&S market research claimed that the market will reach $2,275 million by 2023.
In order to harvest some of the low-hanging fruit, Facebook has been experimenting with machine translation of its content for a couple of years now. Earlier this summer, Amazon announced that it is planning a service to rival Google Translate. Then there is Baidu, the Chinese counterpart of Google, applying machine learning to languages in order to offer machine translation. And finally, Apple is in the race as well to create technologies for machine translation. The company even launched its own blog about machine learning.
While all these companies can have various reasons to bet on deep learning and machine learning, all their steps show is that there is something to win in these fields in terms of money. Deep learning and machine translations can offer cost reductions on translations at a low level. (Microsoft is already offering many knowledge base articles in different languages by human translators, and has many blog posts that are [sometimes poorly] translated by their own machine translation technology as well.) A second benefit is that these companies can offer instant translations of their own content and the content of their clients, thus abandoning the need to hire translators and wait until their content is translated into several more languages. On a higher level, the results of deep learning technologies, however, can be used for other applications as well, some of them probably not even existing at the time this blog post is published.

The emotions

The announcement of Amazon preparing for a battle with Google Translate and the publication of the sponsors for the 2017 EMNLP conference raised some interest from tech watchers and language industry professionals as well. That million dollar companies are diving into a complete new or different field is exciting for some people, while others regard the trend with mixed feelings. Overall, tech lovers seem to love the new path these companies are walking and cannot wait to see the first results, or even a total shake up of the market. Language professionals, however, seem sceptical, and above all, uncertain about what these developments will bring. Both feelings are fed by the cover-up these companies are using to mask their business activities. Amazon did not comment on the news about its plans, while Apple is speaking only in general terms and not explaining its targets clearly.

The developments

It is nevertheless a fact that companies have more technologies at their disposal that can be helpful in using Artificial Intelligence in their business, and machine translation is one of the applications. While in the last years statistical machine translation was the hot potato among translators, now neural machine translation is at the heart of the debate – often leaving the real translation professionals confused about what it all means.
In short, statistical machine translation (SMT) is a paradigm for machine translation that generates its translations on the basis of statistical models. The data behind this model comes from an analysis of bilingual text corpora. So the model analyses the texts, trying to figure out which word means what, and then uses a computational logic to translate new sentences on the basis of the existing corpora.
Neural machine translation (NMT) on the other hand, is a technology that uses a large neural network. It departs from the phrase-based statistical machine translation but uses deep learning. This approach makes use of so-called neural networks, a type of intelligent network with programs and data patterned on the operation of the human brain that learns from and adapts to initial rules. Neural machine translation is therefore more intelligent and adaptive than statistical machine translation while also using less resources than its predecessor. In an interview on eMpTy pages, Systran SEO Jean Senellart explains that NMT also needs less data to learn. Companies can therefore benefit from faster machine translation results for a lower investment. Nevertheless, professionals have mixed feelings about the results of NMT compared to SMT. Language technology provider Tilde published results of a comparative evaluation claiming that ‘NMT systems are up to five times better at handling word ordering and morphology, syntax and agreements (including long distance agreements) than the SMT systems’ and ‘Translations from NMT systems are more fluent and also more precise than SMT translations’. In a presentation at SlideShare (published in July 2016), however, two professionals from the language industry claimed that translators are still more enthusiastic about SMT results.

The future

Whatever the feelings of translators and sceptical professionals, NMT currently seems to hold the winning hand. The promise of technological advancement and the perspectives of more AI and lower costs (except for the investment in NMT) makes companies more prone to bet their wages on NMT than on SMT. If so, many billion-dollar companies investing in NMT and SMT will lose for sure, even if the results are good enough to use. For translators there is not much to fear however. Translators investing in SMT can only afford software like Slate Desktop, which has the added benefit of secure local translation engines. Translators therefore do not risk losing their data in the cloud. Most translators, however, do not invest in MT technologies and only choose to use them when it is safe, probably free, and demanded by the client. They only need to work with the results of the translation engine, no matter the technology that underlies it. From that perspective, it does not matter which road tech companies head down. Translators will ultimately follow that pathway.

Pieter Beens

About Pieter Beens

Freelance translator English-Dutch. Works for high-profile clients worldwide. Professional. Punctual. Passionate.

Leave a Reply

The Open Mic

Where translators share their stories and where clients find professional translators.

Find Translators OR Register as a translator