TC-Star Evaluation Information (WP4)

EN-ES Results	Human EN-ES Results	ES-EN Results	ZH-EN Results	Go back to SLT page

 

Human SLT Results for the English to Spanish direction

(in red the best primary system for each metric)

FTE Task

SYSTEM - Scoring	Adequacy 5: better 1 : bad	Fluency 5: better 1 : bad
DFKI-PRIMARY-system1	3.53	3.31
IBM_PRIMARY_system1	3.60	3.50
IRST-PRIMARY	3.67	3.46
ROVER	3.72	3.46
RWTH_PRIMARY_1	3.74	3.58
UED-PRIMARY	3.79	3.63
UKA-PRIMARY_1	3.49	3.17
UPC-PRIMARY-1	3.68	3.48
UW-PRIMARY-system1	3.62	3.40
SYSTRAN*	2.93	2.46
Human Reference	4.44	4.56

*translation with a commercial cd

SYSTEM - Ranking	Adequacy	Fluency
DFKI-PRIMARY-system1	9	9
IBM_PRIMARY_system1	8	4
IRST-PRIMARY	6	6
ROVER	4	6
RWTH_PRIMARY_1	3	3
UED-PRIMARY	2	2
UKA-PRIMARY_1	10	10
UPC-PRIMARY-1	5	5
UW-PRIMARY-system1	7	8
SYSTRAN*	11	11
Human Reference	1	1

*translation with a commercial cd

VERBATIM Task

SYSTEM - Scoring	Adequacy 5: better 1 : bad	Fluency 5: better 1 : bad
IBM_PRIMARY_system1	3.51	3.35
IRST-PRIMARY *	3.54	3.35
ROVER	3.55	3.32
RWTH-PRIMARY_1	3.55	3.38
UKA-PRIMARY_1	3.36	3.07
UPC-PRIMARY	3.54	3.39
UW-PRIMARY-system1	3.43	3.14
SYSTRAN**	2.77	2.34
Human Reference	4.31	4.31

*submitted the 2006/03/29
**translation with a commercial cd

SYSTEM - Ranking	Adequacy	Fluency
IBM_PRIMARY_system1	6	4
IRST-PRIMARY *	4	4
ROVER	2	6
RWTH-PRIMARY_1	2	3
UKA-PRIMARY_1	8	8
UPC-PRIMARY	5	2
UW-PRIMARY-system1	7	7
SYSTRAN**	9	9
Human Reference	1	1

*submitted the 2006/03/29
**translation with a commercial cd

ASR Task

SYSTEM - Scoring	Adequacy 5: better 1 : bad	Fluency 5: better 1 : bad
IBM_PRIMARY_1	3.05	3.04
IRST-PRIMARY*	3.09	2.99
RWTH-PRIMARY_1	3.13	3.06
UKA-PRIMARY_1	2.97	2.84
UPC-PRIMARY	3.09	3.04
SYSTRAN**	2.33	2.09

*submitted the 2006/03/29
**translation with a commercial cd

SYSTEM - Ranking	Adequacy	Fluency
IBM_PRIMARY_1	4	2
IRST-PRIMARY*	2	4
RWTH-PRIMARY_1	1	1
UKA-PRIMARY_1	5	5
UPC-PRIMARY	2	2
SYSTRAN**	6	6

*submitted the 2006/03/29
**translation with a commercial cd

Back to Top