| Citation: | LIN Y H,LI C B. Multidimensional degradation data generation method based on variational autoencoder[J]. Journal of Beijing University of Aeronautics and Astronautics,2023,49(10):2617-2627 (in Chinese) doi: 10.13700/j.bh.1001-5965.2021.0760 |
The data-driven remaining useful life (RUL) prediction method does not rely on complicated physical models; instead, it can use current monitoring data as well as historical operational data for the equipment, which is very important for developing a reasonable maintenance strategy and lowering the equipment's maintenance costs. However, the data-driven RUL prediction method relies on a large amount of historical data. When the data is insufficient, especially for multidimensional degradation data, the model is difficult to achieve good prediction results. To solve this problem, this paper proposes a multidimensional degradation data generation method.The technique creates a one-stage model using a conditional variational autoencoder as the generation model and a long short-term memory network as the RUL prediction model. The generation model can then be updated using the RUL prediction model, which can then be used to boost the RUL prediction model's performance in the absence of enough degradation data. On a dataset of aero-engine degradation, the approach is validated. The method is validated on an aero-engine degradation dataset. By comparing the performance of the RUL prediction model trained with and without generated data, the effectiveness of the method is demonstrated for RUL prediction with insufficient data.
| [1] |
SHEPPARD J W, KAUFMAN M A, WILMER T J. IEEE standards for prognostics and health management[J]. IEEE Aerospace and Electronic Systems Magazine, 2009, 24(9): 34-41.
|
| [2] |
DING X X, HE Q B. Energy-fluctuated multiscale feature learning with deep ConvNet for intelligent spindle bearing fault diagnosis[J]. IEEE Transactions on Instrumentation and Measurement, 2017, 66(8): 1926-1935. doi: 10.1109/TIM.2017.2674738
|
| [3] |
SUN C, MA M, ZHAO Z B, et al. Deep transfer learning based on sparse autoencoder for remaining useful life prediction of tool in manufacturing[J]. IEEE Transactions on Industrial Informatics, 2019, 15(4): 2416-2425. doi: 10.1109/TII.2018.2881543
|
| [4] |
BROWN E R, MCCOLLOM N N, MOORE E E, et al. Prognostics and health management A data-driven approach to supporting the F-35 lightning II[C]// 2007 IEEE Aerospace Conference. Piscataway: IEEE Press, 2007: 1-12.
|
| [5] |
ZHANG L W, LIN J, LIU B, et al. A review on deep learning applications in prognostics and health management[J]. IEEE Access, 2019, 7: 162415-162438. doi: 10.1109/ACCESS.2019.2950985
|
| [6] |
ZHAO R, YAN R Q, WANG J J, et al. Learning to monitor machine health with convolutional Bi-directional LSTM networks[J]. Sensors, 2017, 17(2): 273. doi: 10.3390/s17020273
|
| [7] |
REN L, ZHAO L, HONG S, et al. Remaining useful life prediction for lithium-ion battery: A deep learning approach[J]. IEEE Access, 2018, 6: 50587-50598. doi: 10.1109/ACCESS.2018.2858856
|
| [8] |
ZHANG Y Z, XIONG R, HE H W, et al. Long short-term memory recurrent neural network for remaining useful life prediction of lithium-ion batteries[J]. IEEE Transactions on Vehicular Technology, 2018, 67(7): 5695-5705. doi: 10.1109/TVT.2018.2805189
|
| [9] |
ZHANG J J, WANG P, YAN R Q, et al. Long short-term memory for machine remaining life prediction[J]. Journal of Manufacturing Systems, 2018, 48: 78-86. doi: 10.1016/j.jmsy.2018.05.011
|
| [10] |
MA J A, SU H A, ZHAO W L, et al. Predicting the remaining useful life of an aircraft engine using a stacked sparse autoencoder with multilayer self-learning[J]. Complexity, 2018, 2018: 1-13.
|
| [11] |
REN L, CHENG X J, WANG X K, et al. Multi-scale dense gate recurrent unit networks for bearing remaining useful life prediction[J]. Future Generation Computer Systems, 2019, 94: 601-609. doi: 10.1016/j.future.2018.12.009
|
| [12] |
AJIBOYE A R, ABDULLAH-ARSHAH R, QIN H, et al. Evaluating the effect of dataset size on predictive model using supervised learning technique[J]. International Journal of Computer Systems & Software Engineering, 2015, 1(1): 75-84.
|
| [13] |
GOODFELLOW I J, POUGET-ABADIE J, MIRZA M, et al. Generative adversarial nets[C]//International Conference on Neural Information Processing Systems. Cambridge: MIT Press, 2014.
|
| [14] |
KINGMA D P, WELLING M. Auto-encoding variational Bayes[EB/OL]. (2022-12-10) [2021-12-16].
|
| [15] |
WANG Z R, WANG J, WANG Y R. An intelligent diagnosis scheme based on generative adversarial learning deep neural networks and its application to planetary gearbox fault pattern recognition[J]. Neurocomputing, 2018, 310: 213-222. doi: 10.1016/j.neucom.2018.05.024
|
| [16] |
WANG Y R, SUN G D, JIN Q. Imbalanced sample fault diagnosis of rotating machinery using conditional variational auto-encoder generative adversarial network[J]. Applied Soft Computing, 2020, 92: 106333. doi: 10.1016/j.asoc.2020.106333
|
| [17] |
BEHERA S, MISRA R. Generative adversarial networks based remaining useful life estimation for IIoT[J]. Computers & Electrical Engineering, 2021, 92: 107195.
|
| [18] |
张晟斐, 李天梅, 胡昌华, 等. 基于深度卷积生成对抗网络的缺失数据生成方法及其在剩余寿命预测中的应用[J]. 航空学报, 2022, 43(8): 225708.
ZHANG S F, LI T M, HU C H, et al. Missing data generation method and its application in remaining useful life prediction based on deep convolutional generative adversarial network[J]. Acta Aeronautica et Astronautica Sinica, 2022, 43(8): 225708(in Chinese).
|
| [19] |
LEE H, HAN S Y, PARK K J. Generative adversarial network-based missing data handling and remaining useful life estimation for smart train control and monitoring systems[J]. Journal of Advanced Transportation, 2020, 2020: 1-15.
|
| [20] |
HUANG Y, TANG Y F, VANZWIETEN J. Prognostics with variational autoencoder by generative adversarial learning[J]. IEEE Transactions on Industrial Electronics, 2022, 69(1): 856-867. doi: 10.1109/TIE.2021.3053882
|
| [21] |
HOCHREITER S, SCHMIDHUBER J. Long short-term memory[J]. Neural Computation, 1997, 9(8): 1735-1780. doi: 10.1162/neco.1997.9.8.1735
|
| [22] |
KINGMA D P, WELLING M. An introduction to variational autoencoders[EB/OL]. (2019-12-11) [2021-12-16].
|
| [23] |
CARL D. Tutorial on variational autoencoders[EB/OL]. (2021-01-03) [2021-12-16].
|
| [24] |
SAXENA A, GOEBEL K, SIMON D, et al. Damage propagation modeling for aircraft engine Run-to-failure simulation[C]// 2008 International Conference on Prognostics and Health Management. Piscataway: IEEE Press, 2008: 1-9.
|
| [25] |
HUANG C G, HUANG H Z, LI Y F. A bidirectional LSTM prognostics method under multiple operational conditions[J]. IEEE Transactions on Industrial Electronics, 2019, 66(11): 8792-8802. doi: 10.1109/TIE.2019.2891463
|
| [26] |
KIM M, LIU K B. A Bayesian deep learning framework for interval estimation of remaining useful life in complex systems by incorporating general degradation characteristics[J]. IISE Transactions, 2021, 53(3): 326-340. doi: 10.1080/24725854.2020.1766729
|
| [27] |
ZHANG J J, WANG P, YAN R Q, et al. Deep learning for improved system remaining life prediction[J]. Procedia CIRP, 2018, 72: 1033-1038. doi: 10.1016/j.procir.2018.03.262
|
| [28] |
ZHENG S, RISTOVSKI K, FARAHAT A, et al. Long short-term memory network for remaining useful life estimation[C]// 2017 IEEE International Conference on Prognostics and Health Management. Piscataway: IEEE Press, 2017: 88-95.
|
| [29] |
WEN L, DONG Y, GAO L A. A new ensemble residual convolutional neural network for remaining useful life estimation[J]. Mathematical Biosciences and Engineering, 2019, 16(2): 862-880. doi: 10.3934/mbe.2019040
|