Fine-Tuning and Evaluation of Question Generation for Slovak Language

Fine-Tuning and Evaluation of Question Generation for Slovak Language

Automatic generation of questions about the given context is useful for the adaptation of question-answering systems or to support education. We trained and evaluated a model that generates a question in the Slovak language. We have designed an automatic metric where an additional question-answering model is used to evaluate the generated questions. We calculated how many questions have confidence greater than the given threshold. For generating questions, we used contexts from the Slovak question-answering dataset. The fine-tuned Slovak T5 model did generate 38% of the questions that the evaluation model could answer with confidence greater than 50%. We cooperated with partners from Taiwan during these experiments in the frame of a bilateral project and we plan to transfer the knowledge to the Chinese language later.