Verification of final ranking which received because of the expert evaluation


Keywords: expert-analytical activity, expert evaluation, final ranking of objects, verification of expert judgments, modeling of expert activity, coefficient of concordance

Abstract

In the modern dynamic information society, situations that are characterized by complexity, multifactoriality, uncertainty, and non-formalization occur very often. Under such conditions, the adoption of effective management decisions is impossible without interaction with the expert environment. This applies to a wide range of human activities, including economic issues. The article is devoted to one of the key stages of expert evaluation – the analysis of members of expert commissions’ judgments and drawing up final conclusions. The author aims to get closer to solving one of the key problems characteristic to this stage, namely: truth verification problems, reliability confirmation for final conclusions obtained as a result of generalization of expert groups’ work. Most often, the experts are asked to compare certain objects according to certain criteria, to identify the best and the worst among them. It is clear that expert judgments are rarely unanimous. Therefore, it is important to apply scientific approaches to constructing final ranking, that is, the final location of objects in order of increase or decrease of a certain quality or usability. The mathematical modeling of activity of an expert group conducted by the author of the article made it possible to identify cases where, depending on the applied techniques, the final rankings obtained on the basis of the judgments of the same experts may differ (sometimes even substantially). This again emphasizes the need to verify the final rankings. The advantages and disadvantages of applying quantitative and qualitative methods in expert-analytical activity are also considered. The scientific novelty of the conducted research is to improve the methodological approaches that will allow to improve the consistency of expert judgments, and to develop recommendations for the complex application of separate methods for constructing total ranking. The article is intended for scientists and practitioners who are interested in contemporary sociological and management approaches to solving economic problems. Also, the article may be useful for specialists and programmers who work in the field of development of artificial intelligence.

References

Kendel, M. (1975). Rangovyie korrelyatsii. M.: Statistyika (in Russian).

Litvak, B.G. (2004). Ekspertnyie tehnologii v upravlenii. M.: Delo (in Russian).

Mizintseva, M.F., & Sardaryan, A.R. (2019). Otsenka personala: uchebnik i praktikum dlya akade-micheskogo bakalavriata. Moskva: Izdatelstvo Yurayt: https://urait.ru/bcode/432770 (in Russian).

Novosad, V.P. (2009). Otsiniuvannia uzghodzhenosti ekspertnykh vysnovkiv metodamy ranhovoi koreliatsii. Demokratychne vriaduvannia v konteksti hlobalnykh vyklykiv ta kryzovykh sytuatsii: materialy nauk.-prakt. konf. za mizhnar. uchastiu (3 kvit.2009 r., m. Lviv): u 2 ch. za nauk. red. chl.-kor. NAN Ukrainy V.S. Zahorskoho, dots. A.V.Lipentseva. Lviv: LRIDU NADU, 353–356 (in Ukrainian).

Novosad, V.P. (2019). Perspekty`vy` zastosuvannya texnologij ekspertnogo ocinyuvannya u tury`sty`chnij sferi. Zbirny`k tez naukovo-prakty`chnoyi konferenciyi “Sil`s`ki tery`toriyi Ukrayiny`: stan ta perspekty`vy` rozvy`tku”, 16–17 travnya 2019 r. L`viv: LNUVMB imeni S.Z. Gzhy`cz`kogo, FOP Korpan B.I., 29–30 (in Ukrainian).

Novosad, V.P., Kukhar, R.B., & Yeleiko, O.I. (2012). Optymizatsiinyi metod vyznachennia vahovykh koefitsiientiv bahatokryterialnoho ekspertno-ho otsiniuvannia. Upravlinnia sotsialno-ekonomichnymy protsesa-my zasobamy matematychnoho modeliuvannia ta informatsiinykh tekhnolohii: materialy naukovo-metodychnoho seminaru kafedry matematychnoho modeliuvannia ta informatsiinykh tekhnolohii. Lviv: LRIDU NADU, 69–71 (in Ukrainian).

Novosad, V.P., Seliverstov, R.G., & Arty`m, I.I. (2009). Kil`kisni metody` ekspertnogo ocinyuvannya: nauk.-metod.rozrobka. K.: NADU (in Ukrainian).

Vy`nogradova, O.V., Gusyeva, O.Yu., & Piligry`m, K.I. (2015). Naukovi problemy` doslidzhennya zovnishn`ogo moty`va-cijnogo seredovy`shha tury`sty`chny`x pidpry`yemstv. Mexanizmy` regulyuvannya ekonomiky`, 4, 38–45 (in Ukrainian).

Abstract views: 54
PDF Downloads: 85
Published
2019-11-16
How to Cite
Stepanyuk, O., & Novosad, V. (2019). Verification of final ranking which received because of the expert evaluation. Scientific Messenger of LNU of Veterinary Medicine and Biotechnologies. Series Economical Sciences, 21(93), 96-101. https://doi.org/10.32718/nvlvet-e9319