岩土力学 ›› 2022, Vol. 43 ›› Issue (S2): 477-486.doi: 10.16285/j.rsm.2021.2091

• 岩土工程研究 • 上一篇    下一篇

基于多头自注意力机制的LSTM-MH-SA滑坡 位移预测模型研究

张振坤1,张冬梅1,李江2,吴益平3   

  1. 1. 中国地质大学 计算机学院,湖北 武汉 430074;2. 湖北省自然资源厅信息中心,湖北 武汉 430071; 3. 中国地质大学 工程学院,湖北 武汉 430074
  • 收稿日期:2021-12-10 修回日期:2022-07-21 出版日期:2022-10-10 发布日期:2022-10-09
  • 通讯作者: 张冬梅,女,1972年生,博士,教授,博士生导师,主要从事地学数据挖掘、滑坡智能预测的教学和科研工作。E-mail: cugzdm@foxmail.com E-mail:1202111251@cug.edu.cn
  • 作者简介:张振坤,男,1998年生,硕士研究生,主要从事滑坡智能预测方面的研究。
  • 基金资助:
    国家自然科学基金联合基金重点支持项目(No.U1911205);湖北省自然资源厅科技项目(No.ZRZY2022KJ07);湖北省自然科学基金(No.2019CFA023)。

LSTM-MH-SA landslide displacement prediction model based on multi-head self-attention mechanism

ZHANG Zhen-kun1, ZHANG Dong-mei1, LI Jiang2, WU Yi-ping3   

  1. 1. School of Computer Science, China University of Geosciences, Wuhan, Hubei 430074, China; 2. Information Center, Department of Natural Resources of Hubei Province, Wuhan, Hubei 430071, China; 3. Faculty of Engineering, China University of Geosciences, Wuhan, Hubei 430074, China
  • Received:2021-12-10 Revised:2022-07-21 Online:2022-10-10 Published:2022-10-09
  • Supported by:
    This work was supported by the Key Projects Supported by NSFC Joint Fund (U1911205), the Science and Technology Project of Department of Natural Resources of Hubei Province (ZRZY2022KJ07) and Hubei Natural Science Foundation of China(2019CFA023).

摘要: 受自身地质条件及外界周期、随机等因素影响,滑坡演变过程具有典型跃变特征。传统基于门控机制的深度学习模型对阶跃型滑坡预测能力不足,多头自注意力通过关注不同尺度时序数据的隐含信息能自适应挖掘序列的变化程度特征,有效学习数据潜在变化趋势,提升序列的预测能力。研究基于变分模态分解技术将滑坡累积位移量分解成趋势项、周期项和随机项,对各位移分量和影响因子开展动态时间规整相关性分析。结合多头自注意力机制和长短时记忆网络模型对各位移分量进行动态预测,各位移分量预测值相加得到实际预测结果。以三峡库区白水河滑坡作为研究区,对监测点ZG118开展累积位移预测,采用监测点ZG93、XD01进行模型适应性验证,试验结果表明对于降雨、库水位变化导致的阶跃数据段,新模型能大大提升预测的精度,为三峡库区滑坡位移预测研究提供新的思路。

关键词: 滑坡位移预测, 变分模态分解, 动态时间规整, 多头自注意力机制, 长短时记忆网络

Abstract: Under the influences of the geological conditions of landslide and external periodic and random factors, the evolution process of the landslide has typical abrupt characteristics. The conventional deep learning model based on gating mechanism has insufficient ability to predict step mutation sequence, while by mining the potential information of time series data with different scales, multi-head self-attention can adaptively find the alteration trend of sequences and improve the prediction ability of landslide sequence. Based on variational mode decomposition, the cumulative displacement of landslide was decomposed into trend displacement, periodic displacement and stochastic displacement. Dynamic time warping algorithm was used to analyze the correlation between each component and influencing factors. These displacement components were dynamically predicted by a modified model integrated with long short-term memory (LSTM) neural network and multi-head self-attention mechanism, and the predicted values of each component were added to obtain the cumulative displacement prediction result. The monitoring point ZG118 of Baishuihe landslide in the Three Gorges Reservoir area was taken as an example to predict the cumulative displacement in this paper. The monitoring points ZG93 and XD01 were used for model adaptability verification. The results show that the new model can greatly improve the prediction accuracy for the step data mutation caused by the changes of rainfall and reservoir water level, providing a new idea for the prediction of landslide displacement in the Three Gorges Reservoir area.

Key words: landslide displacement prediction, variational mode decomposition, dynamic time warping, multi-head self-attention mechanism, long short-term memory (LSTM) neural network

中图分类号: P642
[1] 贾宝新, 郑克楠, 周琳力, . 基于变分模态分解的采空区“三带”微震信号能量衰减规律[J]. 岩土力学, 2024, 45(4): 991-1002.
[2] 姜宇航, 王伟, 邹丽芳, 王如宾, 刘世藩, 段雪雷, . 基于粒子群−变分模态分解、非线性自回归神经网络与门控循环单元的滑坡位移动态预测模型研究[J]. 岩土力学, 2022, 43(S1): 601-612.
[3] 杨建华, 章伟鹏, 姚池, 张小波, 周创兵. 基于变分模态分解的深埋洞室爆破开挖围岩 振动特性分析[J]. 岩土力学, 2021, 42(12): 3366-3375.
[4] 张凯, 张科, 保瑞, 刘享华, 齐飞飞, . 基于优化经验模态分解和聚类分析的滑坡 位移智能预测研究[J]. 岩土力学, 2021, 42(1): 211-223.
[5] 邓冬梅,梁 烨,王亮清,王昌硕,孙自豪,王 聪,董曼曼. 基于集合经验模态分解与支持向量机回归的位移预测方法:以三峡库区滑坡为例[J]. , 2017, 38(12): 3660-3669.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!