Training Specialised Chatbots on Ukrainian Scientific Text Corpora Using Transfer Learning

- Liashenko, Roman O. (orcid.org/0009-0000-2614-6997) and Semerikov, Serhiy O. (orcid.org/0000-0003-0789-0272) (2024) Training Specialised Chatbots on Ukrainian Scientific Text Corpora Using Transfer Learning In: 2024 IEEE 19th International Conference on Computer Science and Information Technologies (CSIT), 16-19 October 2024, Lviv, Ukraine.

Text 183.pdf Download (202kB)

Abstract

This paper presents an extensive experimental study on applying transfer learning techniques to fine-tune pre-trained language models for creating chatbots specialised in Ukrainian scientific texts. The study involves curating two diverse text corpora from research publications, selecting appropriate base models, and fine-tuning them on the prepared datasets using the Hugging Face transformers library. The fine-tuned models are tested for generating chatbot responses to domain-specific user queries. Detailed analyses of the datasets, model architectures, fine-tuning process, and evaluation results are provided. The results demonstrate the feasibility and effectiveness of transfer learning for adapting language models to Ukrainian scientific texts and creating chatbots capable of meaningful dialogue in specialised domains. Challenges and future research directions are discussed.

Item Type:	Conference or Workshop Item (Poster)
Additional Information:	https://ieeexplore.ieee.org/document/10982573
Keywords:	chatbots, transfer learning, language models, fine-tuning, Ukrainian language, scientific texts
Subjects:	Science and knowledge. Organization. Computer science. Information. Documentation. Librarianship. Institutions. Publications > 00 Prolegomena. Fundamentals of knowledge and culture. Propaedeutics > 004 Computer science and technology. Computing. Data processing > 004.9 Application-oriented computer-based techniques Science and knowledge. Organization. Computer science. Information. Documentation. Librarianship. Institutions. Publications > 8 Language. Linguistics. Literature > 81 Linguistics and languages
Divisions:	Institute for Digitalisation of Education > Department of Cloud-Oriented Systems and Artificial Intelligence in Education
Depositing User:	Сергій Олексійович Семеріков
Date Deposited:	10 Jul 2026 09:09
Last Modified:	10 Jul 2026 09:09
URI:	https://lib.iitta.gov.ua/id/eprint/749849

Downloads

Actions (login required)

View Item