The total method of Chebyshev interpolation in the problem of constructing a linear regression
https://doi.org/10.22405/2226-8383-2022-23-4-52-63
Abstract
A linear problem of regression analysis is considered under the assumption of the presence of noise in the output and input variables. This approximation problem may be interpreted as an improper interpolation problem, for which it is required to correct optimally the positions of the original points in the data space so that they all lie on the same hyperplane. The minimax criterion is used to estimate the measure of correction of the initial data; therefore, the proposed approach can be called the total method of Chebyshev approximation (interpolation). It leads to a nonlinear mathematical programming problem, which is reduced to solving a finite number of linear programming problems. This number depends exponentially on the number of parameters, therefore, some methods are proposed to overcome this problem. The results obtained are illustrated with practical examples based on real data, namely, the birth rate in
the Federal Districts of the Russian Federation is analyzed depending on factors such as urban population, income and investment. Linear regression dependencies for two and three features are constructed. Based on the empirical fact of statistical stability (conservation of signs of the coefficients), the possibility of reducing the enumeration of linear programming problems is demonstrated.
About the Authors
Victor Alexandrovich GorelikRussian Federation
doctor of physical and mathematical sciences, professor
Tatiana Valerianovna Zolotova
Russian Federation
doctor of physical and mathematical sciences, professor
References
1. Eremin, I. I. 2002, Theory of linear optimization. Inverse and ill-posed problems series, VSP,
2. Utrecht, Boston, Koln, Tokyo.
3. Gorelik, V. A. 2001, “Matrix correction of a linear programming problem with inconsistent
4. constraints“, Computational mathematics and mathematical physics, vol. 11, no. 41, pp. 1615-
5.
6. Gorelik, V. A., Erohin, V. I. 2004, Optimal matrix correction of inconsistent systems of linear
7. algebraic equations by minimal Euclidean norm, CC RAS, Moscow.
8. Gorelik, V. A., Erokhin, V. I., Pechenkin, R. V. 2006, Numerical methods for correcting improper
9. linear programming problems and structural systems of equations, CC RAS, Moscow.
10. Gorelik, V. A., Trembacheva, O. S. 2016, “Solution of the Linear Regression Problem Using
11. Matrix Correction Methods in the 𝑙1 Metric“, Computational Mathematics and Mathematical
12. Physics, vol. 56, no. 2, pp. 200-205.
13. Back A. 2007, “The matrix-restricted total least squares problem“, Signal Process, vol. 87, no.
14. , pp. 2303-2312.
15. Hnˇetynkov´a I., Pleˇsinger M., Sima D. M., Starakoˇs Z., Van Huffel S. 2011, “The total least
16. squares problem in 𝐴𝑋 ≈ 𝐵: A new classification with the relationship to the classical works“,
17. SIAM Journal on Matrix Analysis and Applications, vol. 32, issue 3, pp. 748-770.
18. Hnˇetynkov´a I., Pleˇsinger M., ˇZ´akov´a J. 2019. “On TLS formulation and core reduction for data
19. fitting with generalized models“, Linear Algebra and Its Applications, vol. 577, pp. 1-20.
20. Hnˇetynkov´a I., Pleˇsinger M., ˇZ´akov´a J. 2019. “Solvability classes for core problems in matrix
21. total least squares minimization“, Applications of Mathematics, vol. 64, issue 2, pp. 103-128.
22. Markovsky I., Van Huffel S. 2007 “Overview of total least-squares methods“, Signal Processing,
23. vol. 87, issue 10, pp. 2283-2302.
24. Meng L., Zheng B.,Wei Y. 2020. “Condition numbers of the multidimensional total least squares
25. problems having more than one solution“, Numerical Algorithms, vol. 84, issue 3, pp. 887-908.
26. Shklyar S. 2018. “Consistency of the total least squares estimator in the linear errors-in-variables
27. regression“, Modern Stochastics: Theory and Applications, vol. 5, issue 3, pp. 247-295.
28. Shiryaev A. N. 2016, Fundamentals of stochastic financial mathematics, vol. 1, Facts, Models,
29. MTSNMO, Moscow.
30. Gorelik V. A., Zolotova T. V. 2020, “Method of parametric correction in data transformation
31. and approximation problems“, Lecture Notes in Computer Science, vol. 12422, pp.122-133.
32. Regions of Russia. Socio-economic indicators 2019, https://rosstat.gov.ru (accessed 30 October
33. .
Review
For citations:
Gorelik V.A., Zolotova T.V. The total method of Chebyshev interpolation in the problem of constructing a linear regression. Chebyshevskii Sbornik. 2022;23(4):52-63. (In Russ.) https://doi.org/10.22405/2226-8383-2022-23-4-52-63