New, interesting research of Google Research and MIT on more effective human evaluation for machine translation, cites our work.

Google Research in cooperation with MIT Media Lab published new research “Toward More Effective Human Evaluation for Machine Translation” (

The authors investigate a simple way to reduce cost by reducing the number of text segments that must be annotated in order to accurately predict a score for a complete test set.

Thank you, interesting work, and it was also nice to see that the research cites (among others) our earlier work on “Measuring uncertainty in translation quality evaluation” (