A Multi-model Approach for Soft Sensor Development Based on Feature Extraction Using Weighted Kernel Fisher Criterion

doi:10.1016/S1004-9541(14)60007-0

Chinese Journal of Chemical Engineering ›› 2014, Vol. 22 ›› Issue (2): 146-152.DOI: 10.1016/S1004-9541(14)60007-0

• 过程系统工程与过程安全 • 上一篇下一篇

A Multi-model Approach for Soft Sensor Development Based on Feature Extraction Using Weighted Kernel Fisher Criterion

吕业, 杨慧中

Key Laboratory of Advanced Process Control for Light Industry of Jiangnan University, Wuxi 214122, China

收稿日期:2012-08-10 修回日期:2012-10-06 出版日期:2014-02-05 发布日期:2014-01-28
通讯作者: YANG Huizhong
基金资助:
Supported by the National Natural Science Foundation of China (61273070) and the Foundation of Priority Academic Program Development of Jiangsu Higher Education Institutions.

A Multi-model Approach for Soft Sensor Development Based on Feature Extraction Using Weighted Kernel Fisher Criterion

LÜ Ye, YANG Huizhong

Key Laboratory of Advanced Process Control for Light Industry of Jiangnan University, Wuxi 214122, China

Received:2012-08-10 Revised:2012-10-06 Online:2014-02-05 Published:2014-01-28
Contact: YANG Huizhong
Supported by:
Supported by the National Natural Science Foundation of China (61273070) and the Foundation of Priority Academic Program Development of Jiangsu Higher Education Institutions.

摘要/Abstract

摘要： Multi-model approach can significantly improve the prediction performance of soft sensors in the process with multiple operational conditions. However, traditional clustering algorithms may result in overlapping phenomenon in subclasses, so that edge classes and outliers cannot be effectively dealt with and the modeling result is not satisfactory. In order to solve these problems, a new feature extraction method based on weighted kernel Fisher criterion is presented to improve the clustering accuracy, in which feature mapping is adopted to bring the edge classes and outliers closer to other normal subclasses. Furthermore, the classified data are used to develop a multiple model based on support vector machine. The proposed method is applied to a bisphenol A production process for prediction of the quality index. The simulation results demonstrate its ability in improving the data classification and the prediction performance of the soft sensor.

关键词: feature extraction, weighted kernel Fisher criterion, classification, soft sensor

Abstract: Multi-model approach can significantly improve the prediction performance of soft sensors in the process with multiple operational conditions. However, traditional clustering algorithms may result in overlapping phenomenon in subclasses, so that edge classes and outliers cannot be effectively dealt with and the modeling result is not satisfactory. In order to solve these problems, a new feature extraction method based on weighted kernel Fisher criterion is presented to improve the clustering accuracy, in which feature mapping is adopted to bring the edge classes and outliers closer to other normal subclasses. Furthermore, the classified data are used to develop a multiple model based on support vector machine. The proposed method is applied to a bisphenol A production process for prediction of the quality index. The simulation results demonstrate its ability in improving the data classification and the prediction performance of the soft sensor.

Key words: feature extraction, weighted kernel Fisher criterion, classification, soft sensor

吕业, 杨慧中. A Multi-model Approach for Soft Sensor Development Based on Feature Extraction Using Weighted Kernel Fisher Criterion[J]. Chinese Journal of Chemical Engineering, 2014, 22(2): 146-152.

LÜ Ye, YANG Huizhong. A Multi-model Approach for Soft Sensor Development Based on Feature Extraction Using Weighted Kernel Fisher Criterion[J]. Chin.J.Chem.Eng., 2014, 22(2): 146-152.

参考文献

1 Li, X.L., Su, H.Y., Chu, J., "Multiple models soft-sensing technique based on online clustering arithmetic", Journal of Chemical Industry and Engineering, 58 (11), 2835-2839 (2007). (in Chinese)

2 Liu, L.L., Zhou, L.F., Xie, S.G., "A novel supervised multi-model modeling method based on k-means clustering", In: Control and De-cision Conference (CCDC), Shenyang, 684-689 (2010). (in Chinese)

3 Li, N., Li, S.Y., Xi, Y.G., "Multi-model modeling method based on satisfactory clustering", Control Theory & Applications, 20 (5), 783-788 (2003). (in Chinese)

4 Li, W.B., Sun, L., Zhang, D.K., "Text classification based on labeled—LDA model", Chinese Journal of Computer, 31 (4), 621-626 (2008). (in Chinese)

5 Yang, Q., Ding, X., "Discrminant local feature analysis with applica tions to face recognition", Journal of Tsinghua University (Science and Technology), 44 (4), 530-533 (2004). (in Chinese)

6 Huerta, E.B., Duval, B., Hao, J., "A hybrid LDA and genetic algo-rithm for gene selection and classification of microarray data", Neu-rocomputing, 73 (13-15), 2375-2383 (2010).

7 Sabatier, R., Reynès, C., "Extensions of simple component analysis and simple linear discriminant analysis", Computational Statistics and Data Analysis, 52 (10), 4779-4789 (2008).

8 Mohammadi, M., Raahemi, B., Akbari, A., Nassersharif, B., Moeinzadeh, H., "Improving linear discriminant analysis with artificial immune system-based evolutionary algorithms", Information Sciences, 189, 219-232 (2012).

9 Chen, C.K., Yang, J.Y., Yang, J., "Fusion of PCA and KFDA for face recognition", Control and Decision, 19 (10), 1147-1154 (2004). (in Chinese)

10 Sun, D.R., Wu, L.N., "Face recognition based on nonlinear feature extraction and SVM", Journal of Electronics & Information Tech-nology, 26 (2), 308-312 (2004). (in Chinese)

11 Li, Y., Jiao, L.C., "Target recognition based on kernel Fisher discriminant", Joural of Xidian University, 30 (4), 179-183 (2003). (in Chinese)

12 Zheng, Y.J., Jian, Y.G., Yang, J.Y., Wu, X.J., "A reformative kernel Fisher discriminant algorithm and its application to face recognition", Neurocomputing, 69 (13-15), 1806-1810 (2006).

13 Sun, J.C., Li, X.H., Yang, Y., "Scaling the kernel function based on the separating boundary in input space: A data-dependent way for improving the performance of kernel methods", Information Sciences, 184 (1), 140-154 (2012).

14 Maldonado, S., Weber, R., Basak, J., "Simultaneous feature selection and classi?cation using kernel-penalized support vector machines", Information Sciences, 181 (2), 115-128 (2011).

15 Wen, Z.M., Cairing, Z., Zhao, L., "Weighted maximum margin dis-criminant analysis with kernels", Neurocomputing, 67, 357-362 (2005).

16 Peng, X.J., "A v-twin support vector machine (v-TSVM) classifier and its geometric algorithms", Information Sciences, 180 (2), 3863-3875 (2010).

17 Amari, S., Wu, S., "Improving support vector machine classifiers by modifying kernel functions", Neural Networks, 12 (6), 783-789 (1999).

18 Kumar, M.A., Khemchandani, R., Gopal, M., Chandra, S., "Know-ledge based least squares twin support vector machines", Information Sciences, 180 (23), 4606-4618 (2010).

19 Wu, Q., "Fault diagnosis model based on Gaussian support vector classifier machine", Expert Systems with Applications, 37 (9), 6251-6256 (2010).

20 He, Q., Wu, C.X., "Separating theorem of samples in Banach space for support vector machine learning", International Journal of Machine Learning and Cybernetics, 184 (1), 49-54 (2011).

21 Loog, M., Duin, R.P.W., Haeb-Umbach, R., "Multiclass linear di-mension reduction by weighted pairwise Fisher criteria", IEEE Transactions on Pattem Analysis And Machine Intelligence, 23 (7), 762-766 (2001).

22 Li, X.H., Li, X., Guo, G.R., "Feature extraction of HRRP based on LDA algorithm", Journal of National University of Defense Tech-nology, 27 (5), 72-77 (2005). (in Chinese)

23 Du, S.Q., "Methods of face recognition based on kernel Fisher dis-criminant", Master Thesis, Shanxi Normal University, China (2007). (in Chinese)

24 Zhang, X., "Research and application of FCM initialization method", Master Thesis, Southwest University, China (2006). (in Chinese)

25 Frank, A., Asuncion, A., "UCI machine learning repository", 2010, http://archive.ics.uci.edu/ml.

[1]	Weipeng Lu, Xuefeng Yan. Balanced multiple weighted linear discriminant analysis and its application to visual process monitoring[J]. 中国化学工程学报, 2021, 36(8): 128-137.
[2]	Qiaoyi Xu, Wenli Du, Jinjin Xu, Jikai Dong. Neural network-based source tracking of chemical leaks with obstacles[J]. 中国化学工程学报, 2021, 33(5): 211-220.
[3]	Kaixun He, Kai Wang, Yayun Yan. Active training sample selection and updating strategy for near-infrared model with an industrial application[J]. 中国化学工程学报, 2019, 27(11): 2749-2758.
[4]	Zhuo He, Zhaohui Tang, Zhihao Yan, Jinping Liu. DTCWT-based zinc fast roughing working condition identification[J]. Chinese Journal of Chemical Engineering, 2018, 26(8): 1721-1726.
[5]	Honggui Han, Shuguang Zhu, Junfei Qiao, Min Guo. Data-driven intelligent monitoring system for key variables in wastewater treatment process[J]. Chinese Journal of Chemical Engineering, 2018, 26(10): 2093-2101.
[6]	Pengfei Cao, Xionglin Luo, Xiaohong Song. Modeling and identification for soft sensor systems based on the separation of multi-dynamic and static characteristics[J]. Chinese Journal of Chemical Engineering, 2018, 26(1): 137-143.
[7]	Pengfei Cao, Xionglin Luo, Xiaohong Song. Feasibility analysis and online adjustment of constraints in model predictive control integrated with soft sensor[J]. , 2017, 25(9): 1230-1237.
[8]	Huan Min, Xionglin Luo. Calibration of soft sensor by using Just-in-time modeling and AdaBoost learning method[J]. , 2016, 24(8): 1038-1046.
[9]	Jian Tang, Tianyou Chai, Zhuo Liu, Wen Yu. Selective ensemble modeling based on nonlinear frequency spectral feature extraction for predicting load parameter in ball mills[J]. Chinese Journal of Chemical Engineering, 2015, 23(12): 2020-2028.
[10]	Wentao Cang, Huizhong Yang. Estimation of catalytic activity using an unscented Kalman filtering in condensation reaction[J]. Chinese Journal of Chemical Engineering, 2015, 23(12): 1965-1969.
[11]	Weiming Shao, Xuemin Tian, PingWang. Supervised local and non-local structure preserving projections with application to just-in-time learning for adaptive soft sensor[J]. Chinese Journal of Chemical Engineering, 2015, 23(12): 1925-1934.
[12]	Yanlin He, Yuan Xu, Zhiqiang Geng, Qunxiong Zhu . Soft sensor of chemical processes with large numbers of input parameters using auto-associative hierarchical neural network[J]. Chinese Journal of Chemical Engineering, 2015, 23(1): 138-145.
[13]	Ouguan Xu, Yongfeng Fu, Hongye Su, Lijuan Li . A Selective Moving Window Partial Least Squares Method and Its Application in Process Modeling[J]. , 2014, 22(7): 799-804.
[14]	曹鹏飞, 罗雄麟. Soft Sensor Model Derived from Wiener Model Structure：Modeling and Identification[J]. Chinese Journal of Chemical Engineering, 2014, 22(5): 538-548.
[15]	许锋, 汪晔晔, 罗雄麟. Soft Sensor for Inputs and Parameters Using Nonlinear Singular State Observer in Chemical Processes[J]. Chinese Journal of Chemical Engineering, 2013, 21(9): 1038-1047.

A Multi-model Approach for Soft Sensor Development Based on Feature Extraction Using Weighted Kernel Fisher Criterion

A Multi-model Approach for Soft Sensor Development Based on Feature Extraction Using Weighted Kernel Fisher Criterion

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价