Machine Translation Quality Estimation (MTQE) is an AI-powered feature that provides segment-level quality estimations for machine translation (MT) suggestions in a similar way to the quality estimations for translation memory (TM) matches and non-translatables (NT).
The instant MT quality scores help guide post-editing and can be used to enhance the default (pre-translation) analysis and to assess MT engine quality.
To learn more about the benefits of MTQE, see our blog article.
The following scoring categories are now supported:
- 100% -Excellent MT match, probably no post-editing required
- 99% - Near-perfect MT output, possibly minor post-editing required for mostly typographical errors
- 75% - Good MT match, but likely to require some post-editing
- No score - When there is no score, it is very likely that the MT output is of low quality. In general, it is recommended that this output not be post-edited but used for reference only.
The MTQE scores will appear at the segment level together with other translation resources (TM, NT, TB). When hovering over the score, a tooltip with the match origin will appear. This origin will also appear at the bottom of the CAT panel in the metadata section.
You can enable MTQE for an MT engine in just a few simple steps:
Step 1: Click the Setup wheel in the top right corner. Scroll down to Integrations and click on Machine Translation Engines.
Step 2: Select the applicable MT engine and click the Edit button (alternatively, you can also create a new MT engine by clicking on Create and selecting the engine you want). You can use MTQE with any of the MT engines supported by Memsource.
Step 3: Select the MT Quality Estimation checkbox and click Save.
Step 4: Once you've successfully set up the MT engine, you will see a checkmark appear under Quality Estimation in the MT settings page.
With the MTQE correctly enabled for any of your MT engines, it will be automatically available in projects with this MT engine selected.
Please note that MTQE is not supported in all language combinations. To see the list of currently available language pairs, please refer to the dedicated page on MTQE Support Languages.
With the MTQE feature enabled, you can run a Default Analysis which will include MT scores alongside the TM and NT scores.
To carry out this analysis, you need to select the job, click Analyze, and enable the Include machine translation matches (Beta) option. You can learn more in our Analyses section.
Include MT matches in Default analysis
In addition to the instant, segment-level, quality matches in the Memsource Editor, you can use MTQE via the pre-translation feature. This allows batch pre-translation with a number of options.
To do this, select the job and click Pre-translate. Select Pre-translate where Empty.... In the pre-translation settings, there is now the option to confirm 100% machine translation matches right away (as shown below). To learn more, please refer to our Pre-translate section.
To use MTQE, you will need to purchase characters (a form of credit) via Memsource. If you use the Manage Machine Translation via Memsource feature, you will be able to use the characters you purchase for machine translation or for MTQE.
For each segment estimated by MTQE (whether via Analysis, through the CAT panel in the Memsource Editor, or during pre-translation), the appropriate number of characters will be deducted from the remaining characters available for your selected MT engine.
MTQE can be used with all MT engines supported by Memsource. However, if you wish to use it with multiple MT engines, you will need to purchase characters for each of the engine types. For example, the 2 million characters available for Microsoft Translator can only be used for the Microsoft Translator MT engine. To use MTQE with Google Translate, you would need to purchase characters for Google Translate separately.
To buy more characters, click on the Settings wheel in the top right corner, and scroll down to Integrations. Click on Machine Translation Engines. Next to the appropriate TM engine, select Buy Characters. Once you do this, the Buy More Characters page will appear with a list of 3 different bundles that are available:
- 2 million characters - $40 (€34)
- 5 million characters - $100 (€85)
- 10 million characters - $200 (€170)
Select a bundle and then follow the instructions on the payment pages. Once you have bought the characters, you will see the that they have been added to the Remaining characters column.
Machine Translation Settings page
Once you've purchased your additional characters, an invoice will be automatically generated. A link to the invoice will be available in the green banner that appears when the payment has been successful. It can also be viewed by going to Setup and clicking on Details in the Subscription section.
Note: There is no time limit when it comes to using up these characters. Once they are purchased they will remain in your account.