The Effect of Multivariate Regression Over Multiple Linear Regression Models Using Non-Normal Data
DOI:
https://doi.org/10.65820/ejsr-3vol1-issue1-2025Keywords:
Non – Normal data, Residual, Pillai, Wilks Lambda, Hotelling Lawley TracexAbstract
Purpose:
This study evaluated the performance of multivariate linear regression relative to multiple linear regression when applied to non-normal data, with the objective of identifying the model that offers greater accuracy and reliability under conditions of equal mean vectors and known variance–covariance matrices.
Methodology:
Simulated datasets were generated using R software. Prior to estimation, all relevant assumptions for both multivariate and multiple linear regression were tested. Model evaluation involved examining residual symmetry, assessing the influence of independent variables on dependent variables, and testing overall model significance. Multivariate regression performance was assessed using Pillai’s Trace, Wilks’ Lambda, Hotelling–Lawley Trace, and Roy’s Largest Root, while the multiple linear regression model was evaluated using analysis of variance.
Results:
The findings revealed that the multivariate linear regression model outperformed the multiple linear regression model under non-normal conditions. The multivariate approach demonstrated more stable residual behavior and stronger statistical evidence of relationships among variables, indicating superior model fit and robustness.
Novelty and contribution:
This study provides new empirical evidence on the comparative suitability of regression models under non-normal data conditions, highlighting the superior performance of multivariate linear regression in handling multiple dependent and independent variables simultaneously.
Practical and social implications:
The results offer practical guidance for researchers, data analysts, and policymakers in selecting appropriate analytical techniques for non-normal multivariate datasets. Improved model selection enhances the accuracy of empirical findings and supports more reliable decision-making in education, health, and the social sciences.
References
AbuElgasim, A. (2022). Important Comparison About the Use of Multiple Linear Regression and Logistic Regression with Applications. International Journal of Mathematics and Statistics Studies. https://www.eajournals.org/
Hair, J.F., Babin, B.J., Anderson, R.E., & Black, W.C., (2019). Multivariate Data Analysis (8th ed.). England Pearson Prentice. DOI: 10.4236/jhrss.2019.134027
Johanneses, H., Dang-Phuong-Lan, Nguyen., Jean-Francois, Aujol., Dominique, B., & Abdullatif, S., (2022). American Institute of Mathematical Sciences. PCA Reduced Gaussian Mixture Models with Applications in Superresolution.Volume 16, Issue 2: 341-366 https://doi:10.3934/ipi.2021053
Johnson, R.A., & Wichern, D.W. (2007) Applied Multivariate Statistical Analysis. 6th Edition, Pearson Prentice Hall, Upper Saddle River. DOI: 10.4236/ojs.2015.57069
Minhui, Liu., (2006). Multivariate Nonnormal Regression Models, Information Complexity, and Genetic Algorithms: A Three Way Hybrid for Intelligent Data Mining. Doctoral Dissertations Submited to University of Tennessee – Knoxville.https://trace.tennessee.edu/itk_graddiss/2007
Rencher, A. C., & Christensen, W.F. (2012). Methods of Multivariate Analysis, 3rd Edition, Wiley, Hoboken. https://doi.org/10.1002/9781118391686
Rosa, Oliveira., & Armando Teixeira-Pinto. (2015). Analyzing Multiple Outcomes: Is it Really Worth the use of Multivariate Linear Regression?. J Biom Biostat. An open access journal. http://dx.doi.org/10.4172/2155-6180.1000256
Tabachnick, B.G., & Fidell, L.S. (2019). Using Multivariate Statistics (7th ed.). Pearson. DOI: 10.4236/jfrm.2021.104025
Varsha D., & Dhananjay, R. (2023). Multivariant Analysis of Variance to Discriminate Groups Based on Dependent Variables. Research Square. https://doi.org/10.21203/rs.3.rs-3071840/v1
Yiming, S., Xinyuan W., Chi Zhang., & Mingkai, Z. (2023). Multiple Regression: Methodology and Applications. International Conference on Applied Mathematics, Modeling Simulation and Automatic Control. https://doi.org/10.54097/hset.v49i.8611
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Elicit Journal of Science Research

This work is licensed under a Creative Commons Attribution 4.0 International License.