The AdversarialQA Round 1 data is the first round of the Dynabench QA task. Dynabench is a research platform for dynamic data collection and benchmarking. Please submit your model predictions directly to the live Dynabench leaderboard.
For convenient analysis and evaluation, we provide the test sets with answers removed.
Upload predicted answers as a .json file in the format {"id_1": "answer_1", "id_2": "answer_2", ...} (i.e. standard SQuAD prediction format)
by combining your model predictions for each test set, or predicting directly on the provided D(Combined) test set.