Improved Remaining Useful Life Prediction Models For Condition-based Maintenance Planners: A Data-Driven Approach Using Transformer-Based Architectures
| dc.contributor.author | Ogunfowora, Oluwaseyi | |
| dc.contributor.supervisor | Najjaran, Homayoun | |
| dc.date.accessioned | 2023-08-30T17:43:52Z | |
| dc.date.copyright | 2023 | en_US |
| dc.date.issued | 2023-06-19 | |
| dc.degree.department | Department of Mechanical Engineering | en_US |
| dc.degree.level | Master of Applied Science M.A.Sc. | en_US |
| dc.description.abstract | Systems and machines undergo various failure modes that result in their health degradation, so maintenance actions are required to restore them back to a state where they can perform their expected functions. Machine health degradation is inevitable, and so is the maintenance cost associated with it. However, with proper maintenance plans, maintenance costs can be reduced, machine life can be extended, and ultimately we can ensure workplace safety. The field of prognostics is vital to systems health management and proper maintenance planning. A reliable estimation of the remaining useful life (RUL) of machines holds the potential for substantial cost savings. Data-driven methods for predictive maintenance have been recognized as one of the most promising maintenance strategies because of their high efficiency and low cost compared to other strategies. This work uses a sequential approach through experimentation to investigate the two main machine-learning-based methods for remaining useful life prediction, the similarity-based and direct-approximation methods. Drawing insights from existing works in the literature, the two stages of development of a similarity-based model (SBM) were optimized resulting in the development of improved similarity-based models using supervised and unsupervised machine learning methods for the health index construction. Ultimately, this work proposes a novel remaining useful life estimation model that leverages the concept of Large Language Models (LLMs) for more efficient time series data representation learning and prediction applied to the remaining useful life prediction use case. The experimental results indicate that the proposed Encoder-Transformer architecture outperforms the existing state-of-the-art models. Other highlights of this work include the bottom-up experimental approach taken to select the best methods and make improvements. The benefits of this approach can be seen from the improved remaining useful life prediction models developed in this work compared to their other counterparts in the literature and the insights this work provides. In this work, ten separate machine-learning models were developed, trained, and tuned for experimentation purposes. To summarize, three improved RUL prediction models: an Encoder-Transformer direct-approximation-based model, an Improved Unsupervised Learning-based Similarity-based model with Principal Component Analysis (PCA), and a Transformer-Assisted Similarity-based models were developed in this work. These models rank first, second, and fourth best amongst the twelve state-of-the-art models they were compared in the literature. | en_US |
| dc.description.scholarlevel | Graduate | en_US |
| dc.identifier.bibliographicCitation | Ogunfowora O, Najjaran H. A Transformer-based Framework For Multi-variate Time Series: A Remaining Useful Life Prediction Use Case. arXiv preprint arXiv:2308.09884. 2023 Aug 19. | en_US |
| dc.identifier.uri | http://hdl.handle.net/1828/15312 | |
| dc.language | English | eng |
| dc.language.iso | en | en_US |
| dc.rights | Available to the World Wide Web | en_US |
| dc.subject | Remaining useful life prediction | en_US |
| dc.subject | NASA Turbofan Engine Degradation Simulation datasets | en_US |
| dc.subject | Commercial Modular Aero-Propulsion System Simulation (C-MAPSS) | en_US |
| dc.subject | Transformer Architecture | en_US |
| dc.subject | Time series data prediction | en_US |
| dc.subject | Prognostics and Health Management | en_US |
| dc.subject | Similarity-based models | en_US |
| dc.title | Improved Remaining Useful Life Prediction Models For Condition-based Maintenance Planners: A Data-Driven Approach Using Transformer-Based Architectures | en_US |
| dc.type | Thesis | en_US |