Paper Summary
Paperzilla title
R-squared: The King of Regression Metrics?
This study argues that R-squared is a more informative and robust metric for evaluating regression models compared to SMAPE, MAE, MAPE, MSE, and RMSE. Through several synthetic use cases and analysis of two real medical datasets, the authors demonstrate that R-squared provides a more accurate assessment of model performance, particularly when dealing with skewed data or outliers. They propose using R-squared as the standard metric for regression analysis evaluation.
Possible Conflicts of Interest
Davide Chicco is an Academic Editor for PeerJ Computer Science.
Identified Weaknesses
Limited Use Case Selection
The selection of use cases presented is limited, and there could be other scenarios where SMAPE might be more informative than R-squared.
Limited Comparison with Other Metrics
The paper primarily focuses on comparing R-squared and SMAPE, neglecting a thorough comparison with other relevant regression metrics like Huber metric, LogCosh loss, and Quantile.
Lack of Real-World Application
The paper lacks a real-world application or a comprehensive case study that demonstrates the practical implications of using R-squared over SMAPE in regression analysis.
Rating Explanation
The paper presents a well-reasoned argument for the superiority of R-squared over other regression metrics, particularly SMAPE. The use cases and examples effectively illustrate the limitations of SMAPE, especially its insensitivity to the distribution of values. The comparison with other commonly used metrics is detailed and insightful. Despite some limitations in the scope of comparison and the lack of a real-world application, the paper's strong methodological approach and clear presentation justify a rating of 4.
Good to know
This is our free standard analysis. Paperzilla Pro fact-checks every citation, researches author backgrounds and funding sources, and uses advanced AI reasoning for more thorough insights.
File Information
Original Title:
The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE and RMSE in regression analysis evaluation
File Name:
Chicco-2021-PeerJ%20Comput%20Sci-VoR.pdf
Uploaded:
July 14, 2025 at 11:11 AM
© 2025 Paperzilla. All rights reserved.