基于贝叶斯图注意力Transformer的航空发动机剩余使用寿命概率预测

Probabilistic prediction of aero engine remaining useful life based on Bayesian graph attention transformer

  • 摘要: 航空发动机作为飞机的心脏,其健康状态对飞机的安全飞行至关重要. 深度学习强大的数据挖掘能力,为通过海量历史数据预测航空发动机的剩余使用寿命提供了新方法. 然而,传统基于深度学习的方法大都关注于挖掘数据在时间上的关联,而忽略了多个传感器监测数据之间复杂的非欧氏空间关系. 此外,少有研究考虑数据或者预测过程本身具有的不确定性,缺乏对预测结果可靠性的评估. 为解决上述问题,本文提出了一种基于贝叶斯网络和图注意力Transformer的航空发动机剩余使用寿命概率预测方法. 将图注意力机制融入Transformer的时间多头注意力模块,结合图注意力网络在空间特征提取上的优势和Transformer模型在时间特征提取的优势,实现数据特征时空关系的联合提取. 同时,利用改进的贝叶斯网络度量预测不确定性,在得到剩余使用寿命预测点值的同时给出相应的置信区间. 最后,通过在公开航空发动机数据集上的实验,证明了所提模型的有效性和先进性.

     

    Abstract: The aero engine is crucial for the safe flight of aircraft. Predicting its remaining useful life allows for timely maintenance, thereby preventing potential flight accidents. Deep learning’s powerful data mining capabilities provide a novel approach to predicting the remaining useful life of aero engines using vast amounts of historical data. However, traditional deep learning methods often only analyze temporal data correlations, overlooking the complex non-Euclidian spatial relationship between multiple sensor data. In addition, they seldom address the uncertainties in data or the prediction process, which impacts the reliability of their results. To solve these problems, we propose a probabilistic prediction method for aero engines that leverages Bayesian networks and the graph attention transformer. First, sensor data undergo preprocessing using a convolutional denoising autoencoder. Then, to extract the complex non-Euclidian spatial relationships between sensors, we construct a graph convolution network. In this network, sensor signal features serve as node characteristics, and the relationships between sensors are measured by cosine similarity. An attention mechanism assigns different weights to sensor nodes to improve the expressive ability of the graph convolution network. In this paper, the multi-head attention is integrated into the graph convolution network. Following the integration, node characteristics are aggregated with the assigned weights in the proposed graph attention network. Furthermore, to achieve joint extraction of the spatiotemporal relationships of sensor data, the graph attention mechanism is integrated into the transformer’s temporal-multi-attention module. This integration combines the spatial feature extraction strengths of the graph attention transformer with the temporal feature extraction abilities of the transformer model. The extracted spatiotemporal joint features are often utilized to predict the remaining useful life of the aero engine. At the same time, a Bayesian network quantifies the prediction uncertainty of the model using Gaussian mixture distribution and variational inference. Optimal approximate distribution parameters are obtained by minimizing the Kullback–Leibler divergence between the real posterior and approximate distributions. Consequently, the loss function of the proposed model network consists of two parts: minimum mean square error, which reflects the distance between the predicted remaining useful life and the actual remaining useful life, and distribution approximation error measured by Kullback–Leibler divergence. Unlike traditional point value predictions, our probabilistic prediction method yields not only an estimated remaining useful life but also a corresponding confidence interval, which provides a more reliable foundation for subsequent maintenance and decision-making. In addition, we validated the proposed method using an aero engine experimental dataset, comparing its performance against other methods through both comparative and ablation experiments. The results demonstrate the effectiveness of the proposed method and its superiority over existing methods.

     

/

返回文章
返回