New Quality Assessment (QA) job

The project manager must fill out the Quality Assessment job type form.

New QA job form fields

FIELD NAME	DESCRIPTION
Name	A unique and meaningful name for internal tracking.	Required
Min. evaluators	A job must have a minimum of one evaluator. More evaluators can be added later in the project, if necessary.	Required
End Date	Deadline for the evaluators. The end date can be modified later on.	Required
Scoring System	The Scoring System dropdown will only show scoring systems that are compatible with the selected job type. The scoring system can be changed until one or more evaluators has accepted the job. See more information about HEVAL Input File Naming Convention	Required
Hide Source Panel	For QA job types only when this box is ticked, the source is hidden to allow the evaluator to focus on the MT output only. The source is then shown to the evaluator, allowing them to adjust their evaluation, if needed.	Optional
Randomize MT	When this box is ticked, the segments are shown to the evaluators out of order to avoid any bias in the evaluation.	Optional
Description	This optional field allows the project manager to add some additional meta data about the project.	Optional

QA input data format

The input data format requirements for Quality Assessment jobs are as follows:

QA job input data

File format	CSV
Separator	Semicolon (;)
Minimum number of segments	2
Maximum number of segments	150
Column 1: Source	The source text
Column 2: MT1	The MT output
Column 3: MT1_model_name	Name of the MT model
Column 4: metadata	Internal metadata for tracking and data analysis
Column 5: Additional_information	Internal metadata for tracking and data analysis
Optional Column(at any position): Original_Id	Internal metadata for tracking Original data Id. Maximal length 64 characters
Optional Column(at any position): Domain	Internal metadata for tracking domain category. Maximal length 64 characters