[1]郑 列,张 彦. 改进的偏最小二乘回归模型及应用[J].湖北工业大学学报,2021,(1):114-120.
 ZHENG Lie,ZHANG Yan. Nonlinear Partial Least Squares Regression Model Based on Stacking Integration and its Application[J].,2021,(1):114-120.
点击复制

 改进的偏最小二乘回归模型及应用()
分享到:

《湖北工业大学学报》[ISSN:1003-4684/CN:42-1752/Z]

卷:
期数:
2021年第1期
页码:
114-120
栏目:
湖北工业大学学报
出版日期:
2021-02-18

文章信息/Info

Title:
 Nonlinear Partial Least Squares Regression Model Based on Stacking Integration and its Application
文章编号:
1003-4684(2021)01-0114-06
作者:
 郑 列 张 彦
 湖北工业大学理学院, 湖北 武汉 430068
Author(s):
 ZHENG Lie ZHANG Yan
 School of Science, Hubei Univ. of Tech., Wuhan 430068, China
关键词:
 高维数据 非线性拟合 stacking集成 stacking-plsr模型
Keywords:
 high dimensional data nonlinear fitting stacking integration stacking-plsr model
分类号:
O212.4
文献标志码:
A
摘要:
 对样本量小于特征数量的高维数据进行拟合时,偏最小二乘回归模型(PLS)因自身优点对线性关系的拟合效果较好。为解决PLS模型对非线性关系拟合效果较差并控制模型计算量两方面问题,提出基于stacking集成非线性偏最小二乘模型(stacking-plsr)。从模型鲁棒性、敏感性和拟合精度三个方面对stacking-plsr模型进行实证检验。结果表明,stacking-plsr模型的拟合效果对训练集样本数量和超参数degree的取值并不敏感,在测试集上预测值的MSE和ARE两项指标相较于传统PLS模型分别降低68.26%和34.44%。
Abstract:
 When fitting the high-dimensional data whose sample size is less than the number of features, the partial least squares regression model (PLS) has better fitting effect on the linear relationship due to its own advantages. In order to solve the two problems of PLS model’s poor fitting effect on the nonlinear relationship and control the calculation amount of the model, a nonlinear partial least squares model based on the stacking (stacking-plsr) is proposed. The stacking-plsr model is empirically tested from three aspects of model robustness, sensitivity and fitting accuracy. The results show that the fitting effect of the stacking-plsr model is not sensitive to the number of training samples and the value of the super parameter degree. The MSE and ARE of the prediction results of the test set are 68.26% and 34.44% lower than those of the PLS model respectively.

参考文献/References:

[1] 王国权. 面向高维不平衡数据的特征选择算法研究[D].哈尔滨:哈尔滨工业大学,2017.
[2] 陆军. 几类高维模型的特征筛选和纠偏相合统计推断方法[D].济南:山东大学,2018.
[3] 李郅琴,杜建强,聂斌,熊旺平,黄灿奕,李欢.特征选择方法综述[J]. 计算机工程与应用,2019,55(24):10-19.
[4] Li K C. Sliced inverse regression for dimension reduction[J]. Journal of the American Statistical Association,1991,(86):316-327.
[5] Wold S, Albano C, Dunn W J , et al. Modelling data tables by principal components and PLS: Class patterns and quantitative predictive relations[J]. Analusis, 1984, 12(10):477-485.
[6] 范光达. 基于集成学习的SLT-PLS回归算法研究[D].哈尔滨:东北大学,2013.
[7] 郭建校. 改进的高维非线性PLS回归方法及应用研究[D].天津:天津大学,2010.
[8] Qin S J, McAvoy T J. Nonlinear PLS modeling using neural networks[J]. Computers & Chemical Engineering, 1992, 16(4):379-391.
[9] Wilson D J H, Irwin G W, Lightbody G. Nonlinear PLS modeling using radial basis function[C]// American Control Conference, 1997. Proceedings of the 1997. IEEE, 1997.
[10] Li C, Ye H, Wang G, et al. A Recursive Nonlinear PLS Algorithm for Adaptive Nonlinear Process Modeling[J]. chemical engineering & technology, 2005, 28(2):141-152.
[11] Akyol K. Stacking ensemble based deep neural networks modeling for effective epileptic seizure detection[J]. Expert Systems With Applications,2019,148:113239.
[12] 谢合亮,胡迪.多因子量化模型在投资组合中的应用——基于LASSO与Elastic Net的比较研究[J].统计与信息论坛,2017,32(10):36-42.

相似文献/References:

[1]熊韧,曹海印,王焱清,等.非牛顿润滑静压轴承的节流器流量方程修正[J].湖北工业大学学报,2019,34(5):6.
 XIONG Ren,CAO Haiyin,WANG Yanqing,et al.Modified restrictor flow equations of hydrostatic bearings ubricated by non-Newtonian fluids[J].,2019,34(1):6.
[2]王照远,曹 民,王 毅,等. 场景与数据双驱动的隧道图像拼接方法[J].湖北工业大学学报,2020,(4):11.
 WANG Zhaoyuan,CAO Min,WANG Yi,et al. Tunnel Image Stitching Method based on Scene and Data[J].,2020,(1):11.
[3]潘 健,梁佳成,陈凤娇,等. 单电流闭环多重PR控制的LCL型逆变器[J].湖北工业大学学报,2020,(4):16.
 PAN Jian,LIANG Jiacheng,CHEN Fengjiao,et al. Design of LCL Grid Connected Inverter based on Single Closed Loop Control and Multiple PR Controllers[J].,2020,(1):16.
[4]王晓光,赵 萌,文益雪,等. 定子闭口槽结构对永磁电机齿槽转矩影响分析[J].湖北工业大学学报,2020,(4):25.
 WANG Xiaoguang,ZHAO Meng,WEN Yixue,et al. Study on Cogging Torque and Vibration Noise of Permanent Magnet Motor with Segmental Stator and Closed-Slot[J].,2020,(1):25.
[5]宇 卫,凃玲英,陈 健. 风电场集中接入对集电线电流保护的影响[J].湖北工业大学学报,2020,(4):29.
 YU Wei,TU Lingying,CHEN Jian. Effect of the Collective Line Current Protection when Wind Farms are Centralized Accessed to the Power System[J].,2020,(1):29.
[6]廖政斌,王泽飞,祝 珊. 二惯量系统谐振在线抑制及相位补偿[J].湖北工业大学学报,2020,(4):34.
 LIAO Zhengbin,WANG Zefei,ZHU Shan. Online Resonance Suppression and Phase Compensation for Double Inertia System[J].,2020,(1):34.
[7]王 欣,游 颖,姜天翔,等. 面向3D打印过程的产品工艺设计和优化[J].湖北工业大学学报,2020,(4):39.
 WANG Xin,YOU Ying,JIANG Tianxiang,et al. Product Process Design and Optimization for 3D Printing Processes[J].,2020,(1):39.
[8]冉晶晶,文 红,罗雅梅,等. 全自动样品前处理平台及其控制系统[J].湖北工业大学学报,2020,(4):43.
 RAN Jingjing,WEN Hong,LUO Yamei,et al. Research on Automatic Sample Preprocessing Platform and its Control System[J].,2020,(1):43.
[9]杨 磊,马志艳,石 敏,等. 基于模糊PID的小型冷库过热度控制方法[J].湖北工业大学学报,2020,(4):43.
 YANG Lei,MA Zhiyan,SHI Min,et al. Research on Superheat Control Method of Small Cold Storage based on Fuzzy PID[J].,2020,(1):43.
[10]黄 晶,周细枝,周业望. 动态注塑成型模具的设计与实验研究[J].湖北工业大学学报,2020,(4):52.
 HUANG Jing,ZHOU Xizhi,ZHOU Yewang. Design and Experimental Study of Dynamic Injection Molding[J].,2020,(1):52.

备注/Memo

备注/Memo:
[收稿日期] 2020-07-02
[基金项目] 教育部人文社会科学研究规划基金项目(17YJA790098)
[第一作者] 郑 列(1963-), 男, 湖北英山人,湖北工业大学教授,研究方向为应用数学,计算机应用技术
[通信作者] 张 彦(1996-), 男, 湖北枣阳人,湖北工业大学硕士研究生,研究方向为数据挖掘
更新日期/Last Update: 2021-02-19