岩土力学 ›› 2022, Vol. 43 ›› Issue (S2): 477-486.doi: 10.16285/j.rsm.2021.2091

• 岩土工程研究 • 上一篇    下一篇

基于多头自注意力机制的LSTM-MH-SA滑坡 位移预测模型研究

张振坤1,张冬梅1,李江2,吴益平3   

  1. 1. 中国地质大学 计算机学院,湖北 武汉 430074;2. 湖北省自然资源厅信息中心,湖北 武汉 430071; 3. 中国地质大学 工程学院,湖北 武汉 430074
  • 收稿日期:2021-12-10 修回日期:2022-07-21 出版日期:2022-10-10 发布日期:2022-10-09
  • 通讯作者: 张冬梅,女,1972年生,博士,教授,博士生导师,主要从事地学数据挖掘、滑坡智能预测的教学和科研工作。E-mail: cugzdm@foxmail.com E-mail:1202111251@cug.edu.cn
  • 作者简介:张振坤,男,1998年生,硕士研究生,主要从事滑坡智能预测方面的研究。
  • 基金资助:
    国家自然科学基金联合基金重点支持项目(No.U1911205);湖北省自然资源厅科技项目(No.ZRZY2022KJ07);湖北省自然科学基金(No.2019CFA023)。

LSTM-MH-SA landslide displacement prediction model based on multi-head self-attention mechanism

ZHANG Zhen-kun1, ZHANG Dong-mei1, LI Jiang2, WU Yi-ping3   

  1. 1. School of Computer Science, China University of Geosciences, Wuhan, Hubei 430074, China; 2. Information Center, Department of Natural Resources of Hubei Province, Wuhan, Hubei 430071, China; 3. Faculty of Engineering, China University of Geosciences, Wuhan, Hubei 430074, China
  • Received:2021-12-10 Revised:2022-07-21 Online:2022-10-10 Published:2022-10-09
  • Supported by:
    This work was supported by the Key Projects Supported by NSFC Joint Fund (U1911205), the Science and Technology Project of Department of Natural Resources of Hubei Province (ZRZY2022KJ07) and Hubei Natural Science Foundation of China(2019CFA023).

摘要: 受自身地质条件及外界周期、随机等因素影响,滑坡演变过程具有典型跃变特征。传统基于门控机制的深度学习模型对阶跃型滑坡预测能力不足,多头自注意力通过关注不同尺度时序数据的隐含信息能自适应挖掘序列的变化程度特征,有效学习数据潜在变化趋势,提升序列的预测能力。研究基于变分模态分解技术将滑坡累积位移量分解成趋势项、周期项和随机项,对各位移分量和影响因子开展动态时间规整相关性分析。结合多头自注意力机制和长短时记忆网络模型对各位移分量进行动态预测,各位移分量预测值相加得到实际预测结果。以三峡库区白水河滑坡作为研究区,对监测点ZG118开展累积位移预测,采用监测点ZG93、XD01进行模型适应性验证,试验结果表明对于降雨、库水位变化导致的阶跃数据段,新模型能大大提升预测的精度,为三峡库区滑坡位移预测研究提供新的思路。

关键词: 滑坡位移预测, 变分模态分解, 动态时间规整, 多头自注意力机制, 长短时记忆网络

Abstract: Under the influences of the geological conditions of landslide and external periodic and random factors, the evolution process of the landslide has typical abrupt characteristics. The conventional deep learning model based on gating mechanism has insufficient ability to predict step mutation sequence, while by mining the potential information of time series data with different scales, multi-head self-attention can adaptively find the alteration trend of sequences and improve the prediction ability of landslide sequence. Based on variational mode decomposition, the cumulative displacement of landslide was decomposed into trend displacement, periodic displacement and stochastic displacement. Dynamic time warping algorithm was used to analyze the correlation between each component and influencing factors. These displacement components were dynamically predicted by a modified model integrated with long short-term memory (LSTM) neural network and multi-head self-attention mechanism, and the predicted values of each component were added to obtain the cumulative displacement prediction result. The monitoring point ZG118 of Baishuihe landslide in the Three Gorges Reservoir area was taken as an example to predict the cumulative displacement in this paper. The monitoring points ZG93 and XD01 were used for model adaptability verification. The results show that the new model can greatly improve the prediction accuracy for the step data mutation caused by the changes of rainfall and reservoir water level, providing a new idea for the prediction of landslide displacement in the Three Gorges Reservoir area.

Key words: landslide displacement prediction, variational mode decomposition, dynamic time warping, multi-head self-attention mechanism, long short-term memory (LSTM) neural network

中图分类号: 

  • P642
[1] 姜宇航, 王伟, 邹丽芳, 王如宾, 刘世藩, 段雪雷, . 基于粒子群−变分模态分解、非线性自回归神经网络与门控循环单元的滑坡位移动态预测模型研究[J]. 岩土力学, 2022, 43(S1): 601-612.
[2] 杨建华, 章伟鹏, 姚池, 张小波, 周创兵. 基于变分模态分解的深埋洞室爆破开挖围岩 振动特性分析[J]. 岩土力学, 2021, 42(12): 3366-3375.
[3] 张凯, 张科, 保瑞, 刘享华, 齐飞飞, . 基于优化经验模态分解和聚类分析的滑坡 位移智能预测研究[J]. 岩土力学, 2021, 42(1): 211-223.
[4] 邓冬梅,梁 烨,王亮清,王昌硕,孙自豪,王 聪,董曼曼. 基于集合经验模态分解与支持向量机回归的位移预测方法:以三峡库区滑坡为例[J]. , 2017, 38(12): 3660-3669.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] 姚仰平,侯 伟. 土的基本力学特性及其弹塑性描述[J]. , 2009, 30(10): 2881 -2902 .
[2] 孙 勇. 滑坡面下双排抗滑结构的计算方法研究[J]. , 2009, 30(10): 2971 -2977 .
[3] 胡 伟,黄 义,刘增荣. 循环荷载下饱和黄土不排水强度退化规律试验与理论研究[J]. , 2009, 30(10): 2996 -3000 .
[4] 李 磊,朱 伟 ,林 城,大木宜章. 干湿循环条件下固化污泥的物理稳定性研究[J]. , 2009, 30(10): 3001 -3004 .
[5] 张明义,刘俊伟,于秀霞. 饱和软黏土地基静压管桩承载力时间效应试验研究[J]. , 2009, 30(10): 3005 -3008 .
[6] 黄平路,陈从新,肖国峰,林 健. 复杂地质条件下矿山地下开采地表变形规律的研究[J]. , 2009, 30(10): 3020 -3024 .
[7] 刘振平,贺怀建,李 强,朱发华. 基于Python的三维建模可视化系统的研究[J]. , 2009, 30(10): 3037 -3042 .
[8] 陈 松,徐光黎,陈国金,吴雪婷. 三峡库区黄土坡滑坡滑带工程地质特征研究[J]. , 2009, 30(10): 3048 -3052 .
[9] 姜领发,陈善雄,于忠久. 饱和土中任意形状衬砌对稳态压缩波的散射[J]. , 2009, 30(10): 3063 -3070 .
[10] 冷伍明,杨 奇,刘庆潭,聂如松. 软基高桥台桩-土相互作用计算新方法研究[J]. , 2009, 30(10): 3079 -3085 .