© Stefano Bonnini, Michela Borghesi. Article available under the CC BY-SA 4.0 licence
ARTICLE
ABSTRACT
This paper presents a distribution-free test, based on the permutation approach, on treatment effects with a multivariate categorical response variable. The motivating example is a typical case-control biomedical study, performed to investigate the effect of the treatment called “assisted motor activity” (AMA) on the health of comorbid patients affected by “low back pain” (LBP), “hypertension” and “diabetes”. Specifically, the goal was to test whether the AMA determines an improvement in the functionality and the perceived health status of patients. Two independent samples (treated and control group) were compared according to 13 different binary or ordinal outcomes. The null hypothesis of the test consists in the equality in the distribution of the multivariate responses of the two groups, whereas under the alternative hypothesis, the health status of the treated patients is better. The approach proposed in this work is based on the Combined Permutation Test (CPT) method, which is suitable for analyzing multivariate categorical data in the presence of confounding factors. A stratification of the groups and intra-stratum permutation univariate two-sample tests are conducted to avoid the potential confounding effects. P-values from the partial tests are combined using the CPT approach to create a suitable test statistic for the overall problem.
KEYWORDS
nonparametric statistics, permutation test, multivariate statistics, categorical data
REFERENCES
Alibrandi, A.; Giacalone, M.; Zirilli, A., (2022). Psychological stress in nurses assisting Amyotrophic Lateral Sclerosis patients: A statistical analysis based on Non- Parametric Combination test. Mediterr. J. Clin. Psychol., 10.
Agresti, A., (1999). Modelling ordered categorical data: recent advances and future challenges. Statistics in medicine, 18(17-18), pp. 2191–2207.
Agresti, A., Klingenberg, G. B., (2005). Multivariate tests comparing binomial probabilities, with application to safety studies for drugs. J. R. Stat. Soc., Ser. C 4, pp. 691–706
Arboretti Giancristofaro, R., and Bonnini, S., (2009). Some new results on univariate and multivariate permutation tests for ordinal categorical variables under restricted alternatives. Statistical Methods and Applications, 18, pp. 221–236.
Bonnini, S., Borghesi, M., (2022). Relationship between Mental Health and Socio- Economic, Demographic and Environmental Factors in the COVID-19 Lockdown Period—A Multivariate Regression Analysis. Mathematics, 10, pp. 3237.
Bonnini, S., Borghesi, M., and Giacalone, M., (2023). Advances on multisample permutation tests for “V-shaped” and “U-shaped” alternatives with application to Circular Economy. Ann. Oper. Res., 342, pp. 1655–1670.
Bonnini, S., Borghesi, M., and Giacalone, M., (2024a). Simultaneous marginal homogeneity versus directional alternatives for multivariate binary data with application to circular economy assessments. Appl. Stoch. Models Bus. Ind., 40, pp. 389–407.
Bonnini, S., Borghesi, M., and Giacalone, M., (2024b). Semi-parametric approach for modeling overdispersed count data with application to industry 4.0. Socio-Econ. Plan. Sci., 95, p. 101976.
Bonnini, S., Corain, L., Marozzi, M., and Salmaso, L., (2014). Nonparametric Hypothesis Testing. Rank and Permutation Methods with Applications in R. Wiley, Chichester.
Bonnini, S., Assegie, G. M., and Trzcinska, K., (2024). Review about the Permutation Approach in Hypothesis Testing. Mathematics, 12, pp. 2617–1.
Brunner, E., Munzel, U., (2000). The nonparametric Behrens–Fisher problem: asymptotic theory and small-sample approximation. Biom. J., 42, pp. 17–25
Cohen, A., Kemperman, J. H. B., Madigan, D., and Sakrowitz, H. B., (2000). Effective directed tests for models with ordered categorical data. Aust. N. Z. J. Stat., 45, pp. 285–300
Ferreira, M. L., Ferreira, P. H., Latimer, J., Herbert, R. D., Hodges, P. W., Jennings, M. D., ... and Refshauge, K. M., (2007). Comparison of general exercise, motor control exercise and spinal manipulative therapy for chronic low back pain: a randomized trial. Pain, 131(1-2), pp. 31–37.
Gordon, R., Bloxham, S., (2016, April). A systematic review of the effects of exercise and physical activity on non-specific chronic low back pain. In Healthcare (Vol. 4, No. 2, p. 22). MDPI.
Han, K. E., Catalano, P. J., Senchaudhuri, P., and Metha, C., (2004). Exact analysis of dose-response for multiple correlated binary outcomes. Biometrics, 60, pp. 216–224
Hirotsu, C., (1986). Cumulative chi-squared statistic as a tool for testing goodness-offit. Biometrika, 73, pp. 165–173
Loughin, T. M., (2004). A systematic comparison of methods for combining p-values from independent tests. Comput. Stat. Data Anal., 47, pp. 467–485
Loughin, T. M., Scherer, P. N., (1998). Testing for association in contingency tables with multiple column responses. Biometrics, 54, pp. 630–637
Lumely, T., (1996). Generalized estimating equations for ordinal data: a note on working correlation structures. Biometrics, 52, pp. 354–361
Macedo, L. G., Latimer, J., Maher, C. G., Hodges, P. W., McAuley, J. H., Nicholas, M. K., ... and Stafford, R., (2012). Effect of motor control exercises versus graded activity in patients with chronic nonspecific low back pain: a randomized controlled trial. Physical therapy, 92(3), pp. 363–377.
Macedo, L. G., Maher, C. G., Hancock, M. J., Kamper, S. J., McAuley, J. H., Stanton, T. R., ... and Hodges, P. W., (2014). Predicting response to motor control exercises and graded activity for patients with low back pain: preplanned secondary analysis of a randomized controlled trial. Physical therapy, 94(11), pp. 1543–1554.
Marcus, R., Eric, P., and Gabriel, K. R., (1976). On closed testing procedures with special reference to ordered analysis of variance. Biometrika, 63(3), pp. 655–660
Nettleton, D., Banerjee, T., (2000). Testing the equality of distributions of random vectors with categorical components. Comput. Stat. Data Anal., 37, pp. 195–208
Pesarin, F., (1994). Goodness-of-fit testing for ordered discrete distributions by resampling techniques. Metron, 52, pp. 57–71.
Pesarin, F., (2001). Multivariate Permutation Tests with Applications in Biostatistics. Wiley: Chichester.
Pesarin, F, Salmaso, L., (2006). Permutation tests for univariate and multivariate ordered categorical data. Austrian Journal of Statistics, 35, pp. 315–324.
Pesarin F., Salmaso L., (2010). Permutation Tests for Complex Data. Theory, Applications, and Software. Wiley, Chichester.
Silvapulle, M. J., Sen, P. K., (2005). Constrained Statistical Inference, Inequality, Order, and Shape Restrictions. Wiley, New York
Simon, N., Tibshirani, R., (2012). A permutation approach to testing interactions in many dimensions. arXiv, arXiv, 1206.6519.
Stute, W., Thies, S., and Zhu, L., (1998). Model checks for regression: An innovation process approach. Ann. Statist., 26, pp. 1916–1934.
Toma, P., Miglietta, P. P., Zurlini, G., Valente, D., and Petrosillo, I., (2017). A nonparametric bootstrap-data envelopment analysis approach for environmental policy planning and management of agricultural efficiency in EU countries. Ecol. Indic., 83, pp. 132–143.
Troendle, J. F., (2002). A likelihood ratio test for the nonparametric Behrens–Fisher problem. Biom. J., 44(7), pp. 813–824
Wang, Y., (1996). A likelihood ratio test against stochastic ordering in several populations. J. Am. Stat. Assoc., 91, pp. 1676–1683