hackathon
It is necessary to create an algorithm that finds the answer to the question in the corresponding text from Wikipedia.
The dataset includes fragments of articles from Wikipedia, questions to them asked by markers, and the correct answers. The correct answer to each question is a segment from the corresponding Wikipedia fragment.
Example:
Fragment:
The Peace of Tilsit is a peace treaty concluded between June 13 and June 25, 1807 in Tilsit between Alexander I and Napoleon after the War of the Fourth Coalition of 1806-1807, in which Russia helped Prussia.
Question:
What was the name of the treaty signed between Russia and France in 1807 after Napoleon's victories in the campaign of 1806-1807?
Answer:
The Peace of Tilsit
Для проверки нужно было предоставить json-файл, в котором указан id вопроса и ответ на него.
The quality of the solution was determined by two metrics:
- percentage of answers that exactly match the answers from the gold standard (EM);
- the already familiar F1 average metric.
You have access to a basic solution from the developers of the problem and a webinar with its analysis.
