Lluis Marquezekin UPCn lan egiten duen Daniele Pighin ikerlaria astebeteko bisitan dugu Donostian. Mintegi bat antolatu dugu bere ikerketa-lanaren berri jasotzeko.
Gaia: Automatic Projection of Semantic Structures: an Application to Pairwise Translation Ranking (Rol semantikoen erabilera itzulpenen kalitatea neurtzerakoan.)
Tokia: 3.2 gelan (batzar-gela ohia)
Hizlaria: Daniele Pighin
Eguna: Maiatzaren 31
Ordua: 11:30
Izenburua / Title
Automatic Projection of Semantic Structures: an Application to Pairwise Translation Ranking
(Rol semantikoen erabilera itzulpenen kalitatea neurtzerakoan.)
Laburpena /Abstract
The ability to automatically assess the quality of translation hypotheses is a key requirement towards the development of accurate and dependable translation models. While it is largely agreed that proper transfer of predicate-argument structures from source to target is a very strong indicator of translation quality, especially in relation to adequacy, the incorporation of this kind of information in the Statistical Machine Translation (SMT) evaluation pipeline is still limited to few and isolated cases.
We present a model for the inclusion of semantic role annotations in the framework of confidence estimation for machine translation. The model has several interesting properties:
- it only requires a linguistic processor on the (generally well-formed) source side of the translation;
- it does not directly rely on properties of the translation model (hence, it can be applied beyond phrase-based systems);
- it is inherently extendable to cope with different kinds of sequential annotations, e.g., POS tags.
These features make it potentially appealing for system ranking, translation re-ranking and user feedback evaluation. Preliminary experiments in pairwise hypothesis ranking on five confidence estimation benchmarks show that the model has the potential to capture salient aspects of translation quality.
