GitXplorerGitXplorer
a

ml-behavioral-testing-for-mt

public
6 stars
1 forks
0 issues

Commits

List of commits on branch main.
Unverified
e6a9ff514e961e7d29a19cf8bfec78d742d4515e

Update citation

mmsperber committed a year ago
Unverified
41abae54042444d7ce5ca0c39dbfc6c10f21cfc6

initial commit

mmsperber committed a year ago

README

The README file for this repository.

Data for Behavioral Testing in Machine Translation

This data set accompanies the research paper, Automating Behavioral Testing in Machine Translation.

It includes the following:

  • data/prompts_src_gen contains the prompts that were used to generate the English source sentences for behavioral testing, as described in the paper.
  • data/filtered_src_gen contains the generated source sentences after the filter steps outlined in the paper.
  • data/prompts_candidates contains the prompts that were used to generate the target-language-specific candidate sets.
  • data/candidate_sets contains the generated candidate sets (unfiltered).

Citation

If you use this dataset, please cite our paper as follows:

Javier Ferrando, Matthias Sperber, Hendra Setiawan, Dominic Telaar, Saša Hasan (2023). Automating Behavioral Testing in Machine Translation. Conference on Machine Translation (WMT).