The Effect of Multivariate Regression Over Multiple Linear Regression Models Using Non-Normal Data

Authors

DOI:

https://doi.org/10.65820/ejsr-3vol1-issue1-2025

Keywords:

Non – Normal data, Residual, Pillai, Wilks Lambda, Hotelling Lawley Tracex

Abstract

Purpose:
This study evaluated the performance of multivariate linear regression relative to multiple linear regression when applied to non-normal data, with the objective of identifying the model that offers greater accuracy and reliability under conditions of equal mean vectors and known variance–covariance matrices.

Methodology:
Simulated datasets were generated using R software. Prior to estimation, all relevant assumptions for both multivariate and multiple linear regression were tested. Model evaluation involved examining residual symmetry, assessing the influence of independent variables on dependent variables, and testing overall model significance. Multivariate regression performance was assessed using Pillai’s Trace, Wilks’ Lambda, Hotelling–Lawley Trace, and Roy’s Largest Root, while the multiple linear regression model was evaluated using analysis of variance.

Results:
The findings revealed that the multivariate linear regression model outperformed the multiple linear regression model under non-normal conditions. The multivariate approach demonstrated more stable residual behavior and stronger statistical evidence of relationships among variables, indicating superior model fit and robustness.

Novelty and contribution:
This study provides new empirical evidence on the comparative suitability of regression models under non-normal data conditions, highlighting the superior performance of multivariate linear regression in handling multiple dependent and independent variables simultaneously.

Practical and social implications:
The results offer practical guidance for researchers, data analysts, and policymakers in selecting appropriate analytical techniques for non-normal multivariate datasets. Improved model selection enhances the accuracy of empirical findings and supports more reliable decision-making in education, health, and the social sciences.

Author Biographies

  • MUSA Yunus Olatunji, Kwara State Polytechnic Ilorin Kwara State

    Department of Statistics

  • Kabiru Babatude Ishola , Nigerian Army University BIU

    Department of Computer Science 

  • Akeem Kunle SANDA, University of Ilorin, Ilorin, Nigeria

    Department of Statistics 

  • Adam Oluwakayode ABUBAKAR , University of Ilorin, Ilorin, Nigeria

    Department of Statistics 

References

AbuElgasim, A. (2022). Important Comparison About the Use of Multiple Linear Regression and Logistic Regression with Applications. International Journal of Mathematics and Statistics Studies. https://www.eajournals.org/

Hair, J.F., Babin, B.J., Anderson, R.E., & Black, W.C., (2019). Multivariate Data Analysis (8th ed.). England Pearson Prentice. DOI: 10.4236/jhrss.2019.134027

Johanneses, H., Dang-Phuong-Lan, Nguyen., Jean-Francois, Aujol., Dominique, B., & Abdullatif, S., (2022). American Institute of Mathematical Sciences. PCA Reduced Gaussian Mixture Models with Applications in Superresolution.Volume 16, Issue 2: 341-366 https://doi:10.3934/ipi.2021053

Johnson, R.A., & Wichern, D.W. (2007) Applied Multivariate Statistical Analysis. 6th Edition, Pearson Prentice Hall, Upper Saddle River. DOI: 10.4236/ojs.2015.57069

Minhui, Liu., (2006). Multivariate Nonnormal Regression Models, Information Complexity, and Genetic Algorithms: A Three Way Hybrid for Intelligent Data Mining. Doctoral Dissertations Submited to University of Tennessee – Knoxville.https://trace.tennessee.edu/itk_graddiss/2007

Rencher, A. C., & Christensen, W.F. (2012). Methods of Multivariate Analysis, 3rd Edition, Wiley, Hoboken. https://doi.org/10.1002/9781118391686

Rosa, Oliveira., & Armando Teixeira-Pinto. (2015). Analyzing Multiple Outcomes: Is it Really Worth the use of Multivariate Linear Regression?. J Biom Biostat. An open access journal. http://dx.doi.org/10.4172/2155-6180.1000256

Tabachnick, B.G., & Fidell, L.S. (2019). Using Multivariate Statistics (7th ed.). Pearson. DOI: 10.4236/jfrm.2021.104025

Varsha D., & Dhananjay, R. (2023). Multivariant Analysis of Variance to Discriminate Groups Based on Dependent Variables. Research Square. https://doi.org/10.21203/rs.3.rs-3071840/v1

Yiming, S., Xinyuan W., Chi Zhang., & Mingkai, Z. (2023). Multiple Regression: Methodology and Applications. International Conference on Applied Mathematics, Modeling Simulation and Automatic Control. https://doi.org/10.54097/hset.v49i.8611

Downloads

Published

2025-12-30

How to Cite

Olomoda, I. K., Olatunji, M. Y., Ishola , K. B., SANDA, . A. K., & ABUBAKAR , A. O. (2025). The Effect of Multivariate Regression Over Multiple Linear Regression Models Using Non-Normal Data. Elicit Journal of Science Research , 1(1), 28-39. https://doi.org/10.65820/ejsr-3vol1-issue1-2025