Comparison of Multi-Criteria Decision Analysis Methods Under Comprehensive Sensitivity Analysis

In many contemporary decision-making environments, practitioners must navigate complex problems characterized by multiple, conflicting criteria. Multi-Criteria Decision Analysis (MCDA) methods have become essential tools for structuring such evaluations, enabling more transparent and data-driven rec...

Full description

Saved in:
Bibliographic Details
Main Authors: Jakub Saabun, Marcin Hernes, Wojciech Salabun
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/11078265/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1839614672465035264
author Jakub Saabun
Marcin Hernes
Wojciech Salabun
author_facet Jakub Saabun
Marcin Hernes
Wojciech Salabun
author_sort Jakub Saabun
collection DOAJ
description In many contemporary decision-making environments, practitioners must navigate complex problems characterized by multiple, conflicting criteria. Multi-Criteria Decision Analysis (MCDA) methods have become essential tools for structuring such evaluations, enabling more transparent and data-driven recommendations. However, their practical usefulness depends on both their theoretical foundations and their ability to perform reliably under uncertain or changing input data. Despite their widespread integration into Decision Support Systems (DSS), there remains a lack of systematic investigation into how robust different MCDA methods are when exposed to variability in the decision data. This study addresses this gap by investigating the stability and sensitivity of four selected used MCDA methods, Root Assessment Method (RAM), Complex Proportional Assessment (COPRAS), Technique for Order Preference by Similarity to an Ideal Solution (TOPSIS), and Measurement of Alternatives and Ranking according to Compromise Solution (MARCOS). These methods were chosen based on their diverse computational assumptions and approaches to preference calculation, providing a representative basis for comparing stability across different methodological principles. The analysis employs the Comprehensive Sensitivity Analysis Method (COMSAM), a systematic framework that introduces simultaneous perturbations into the decision matrix to simulate real-world uncertainty. Through both simulation experiments and a practical facility location problem, the study reveals significant differences in method stability. RAM demonstrated the highest robustness, maintaining consistent preference rankings, while TOPSIS was most sensitive to matrix fluctuations. The findings highlight the critical role of method selection in DSS design, particularly in dynamic environments. The study contributes a structured comparative framework and empirical benchmarks that support the development of reliable MCDA-based decision tools under conditions of uncertainty.
format Article
id doaj-art-127b51b46a2d45808b371d58f23d7d9f
institution Matheson Library
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-127b51b46a2d45808b371d58f23d7d9f2025-07-25T23:01:42ZengIEEEIEEE Access2169-35362025-01-011312812212813810.1109/ACCESS.2025.358816611078265Comparison of Multi-Criteria Decision Analysis Methods Under Comprehensive Sensitivity AnalysisJakub Saabun0https://orcid.org/0000-0002-9324-3241Marcin Hernes1https://orcid.org/0000-0002-3832-8154Wojciech Salabun2https://orcid.org/0000-0001-7076-2519National Institute of Telecommunications, National Research Institute, Warsaw, PolandCenter for Intelligent Management Systems, Wroclaw University of Economics and Business, Wroclaw, PolandNational Institute of Telecommunications, National Research Institute, Warsaw, PolandIn many contemporary decision-making environments, practitioners must navigate complex problems characterized by multiple, conflicting criteria. Multi-Criteria Decision Analysis (MCDA) methods have become essential tools for structuring such evaluations, enabling more transparent and data-driven recommendations. However, their practical usefulness depends on both their theoretical foundations and their ability to perform reliably under uncertain or changing input data. Despite their widespread integration into Decision Support Systems (DSS), there remains a lack of systematic investigation into how robust different MCDA methods are when exposed to variability in the decision data. This study addresses this gap by investigating the stability and sensitivity of four selected used MCDA methods, Root Assessment Method (RAM), Complex Proportional Assessment (COPRAS), Technique for Order Preference by Similarity to an Ideal Solution (TOPSIS), and Measurement of Alternatives and Ranking according to Compromise Solution (MARCOS). These methods were chosen based on their diverse computational assumptions and approaches to preference calculation, providing a representative basis for comparing stability across different methodological principles. The analysis employs the Comprehensive Sensitivity Analysis Method (COMSAM), a systematic framework that introduces simultaneous perturbations into the decision matrix to simulate real-world uncertainty. Through both simulation experiments and a practical facility location problem, the study reveals significant differences in method stability. RAM demonstrated the highest robustness, maintaining consistent preference rankings, while TOPSIS was most sensitive to matrix fluctuations. The findings highlight the critical role of method selection in DSS design, particularly in dynamic environments. The study contributes a structured comparative framework and empirical benchmarks that support the development of reliable MCDA-based decision tools under conditions of uncertainty.https://ieeexplore.ieee.org/document/11078265/Sensitivity analysisdecision-makingresults stabilitymulti-criteria decision analysisCOMSAM
spellingShingle Jakub Saabun
Marcin Hernes
Wojciech Salabun
Comparison of Multi-Criteria Decision Analysis Methods Under Comprehensive Sensitivity Analysis
IEEE Access
Sensitivity analysis
decision-making
results stability
multi-criteria decision analysis
COMSAM
title Comparison of Multi-Criteria Decision Analysis Methods Under Comprehensive Sensitivity Analysis
title_full Comparison of Multi-Criteria Decision Analysis Methods Under Comprehensive Sensitivity Analysis
title_fullStr Comparison of Multi-Criteria Decision Analysis Methods Under Comprehensive Sensitivity Analysis
title_full_unstemmed Comparison of Multi-Criteria Decision Analysis Methods Under Comprehensive Sensitivity Analysis
title_short Comparison of Multi-Criteria Decision Analysis Methods Under Comprehensive Sensitivity Analysis
title_sort comparison of multi criteria decision analysis methods under comprehensive sensitivity analysis
topic Sensitivity analysis
decision-making
results stability
multi-criteria decision analysis
COMSAM
url https://ieeexplore.ieee.org/document/11078265/
work_keys_str_mv AT jakubsaabun comparisonofmulticriteriadecisionanalysismethodsundercomprehensivesensitivityanalysis
AT marcinhernes comparisonofmulticriteriadecisionanalysismethodsundercomprehensivesensitivityanalysis
AT wojciechsalabun comparisonofmulticriteriadecisionanalysismethodsundercomprehensivesensitivityanalysis