Flow constructing and optimizing method for composite web service based on Q-learning

- Гришанова, І.Ю. (orcid.org/0000-0003-4999-6294) and Рогушина, Юлія Віталіївна (orcid.org/0000-0001-7958-2557) (2025) Flow constructing and optimizing method for composite web service based on Q-learning Проблеми програмування, 1. pp. 82-93. ISSN 1727-4907

Text 767-1759-1-SM.pdf Download (653kB)

Abstract

We propose a method of automated flow generation for the web services composition according to the de fined target state based on reinforcement machine learning. An agent that uses Q-learning gradually accu mulates knowledge about the environment to updates the evaluations of the usefulness of its actions (these actions correspond to the existing services). The task is divided into two subtasks: - construction of possible flows represented as sequences of services where the results of the previous service execution change the current environment state and enable the exe cution of the next service; - choice of the optimal flow according to the history of interactions and to QoS criteria that is adapted to environment changes. We determine the main components of reinforcement learning and analyze their specifics for service com position task. Additional approaches that allow avoiding looping and the use of unnecessary services are considered. We propose modification of the Q-learning method developed for automatic generation of flows based on input and output data of web services and for selecting the optimal flow based on the analysis of their qualitative characteristics. This modified method uses approach with memory where the agent expands its knowledge about the environment at each step. We consider characteristics of proposed method based on analysis of its software implementation. Possibilities of proposed method are considered on example of generation an optimal study sequences used for individual educational trajectories in accordance with the personal needs of students. Every learning ob ject (information object used for educational needs described by metadata) is considered as a specific ser vice where inputs and outputs are represented by required and result competencies.

Item Type:	Article
Keywords:	web service; composition of services; flow; machine learning.
Subjects:	Science and knowledge. Organization. Computer science. Information. Documentation. Librarianship. Institutions. Publications > 00 Prolegomena. Fundamentals of knowledge and culture. Propaedeutics > 004 Computer science and technology. Computing. Data processing > 004.4 Software Science and knowledge. Organization. Computer science. Information. Documentation. Librarianship. Institutions. Publications > 00 Prolegomena. Fundamentals of knowledge and culture. Propaedeutics > 004 Computer science and technology. Computing. Data processing > 004.9 Application-oriented computer-based techniques Science and knowledge. Organization. Computer science. Information. Documentation. Librarianship. Institutions. Publications > 3 Social Sciences > 37 Education > 37.01/.09 Special auxiliary table for theory, principles, methods and organization of education > 37.09 Organization of instruction
Divisions:	Institute for Digitalisation of Education > Department of Digital Transformation of the NAES of Ukraine
Depositing User:	н.с. Х.В. Середа
Date Deposited:	12 Jan 2026 13:20
Last Modified:	12 Jan 2026 13:22
URI:	https://lib.iitta.gov.ua/id/eprint/748201

Downloads

Actions (login required)

View Item