New Productivity Assessment (PA) job

The project manager must fill out the Productivity Assessment job type form.

New PA job form fields

FIELD NAME	DESCRIPTION
Name	A unique and meaningful name for internal tracking.	Required
Min. evaluators	A job must have a minimum of one evaluator. More evaluators can be added later in the project, if necessary.	Required
End Date	Deadline for the evaluators. The end date can be modified later on.	Required
Randomize MT	When this box is ticked, the segments are shown to the evaluators out of order to avoid any bias in the evaluation.	Optional
Description	This optional field allows the project manager to add some additional meta data about the project.	Optional

PA input data format

The input data format requirements for Productivity Assessment jobs are as follows:

PA job input data

File format	CSV
Separator	Semicolon (;)
Number of MTPE segments	200
Number of HT segments	30
Number of control segments	5
Column 1: Source	The source text
Column 2: MT1	The MT output or human translation (in case of control segment)
Column 3: MT1_model_name	Name of the MT model, ‘HT’ (human translation) or ‘control’ (control segment)
Column 4: metadata	Internal metadata for tracking and data analysis
Column 5: Additional_information	Internal metadata for tracking and data analysis
Optional Column(at any position): Original_Id	Internal metadata for tracking Original data Id. Maximal length 64 characters
Optional Column(at any position): Domain	Internal metadata for tracking domain category. Maximal length 64 characters

Due to the nature of productivity assessments, they require a very specific data set. This includes MT segments, Human Translated (HT) segments and Control segments. The evaluator will be asked to post-edit the MT segments and translate the HT segments from scratch. The data has to reflect these activities; therefore the segment types must be populated in a single data set as follows:

MT segments

{{Source}};{{MT1}};{{MT1_model_name}};{{metadata}};{{Additional_information}}

HT segments

{{Source}};;HT;{{metadata}};{{Additional_information}}

Control segments

{{Source}};{{Human_translation}};control;{{metadata}};{{Additional_information}}