Rock and Soil Mechanics ›› 2022, Vol. 43 ›› Issue (S2): 477-486.doi: 10.16285/j.rsm.2021.2091

• Geotechnical Engineering • Previous Articles     Next Articles

LSTM-MH-SA landslide displacement prediction model based on multi-head self-attention mechanism

ZHANG Zhen-kun1, ZHANG Dong-mei1, LI Jiang2, WU Yi-ping3   

  1. 1. School of Computer Science, China University of Geosciences, Wuhan, Hubei 430074, China; 2. Information Center, Department of Natural Resources of Hubei Province, Wuhan, Hubei 430071, China; 3. Faculty of Engineering, China University of Geosciences, Wuhan, Hubei 430074, China
  • Received:2021-12-10 Revised:2022-07-21 Online:2022-10-10 Published:2022-10-09
  • Supported by:
    This work was supported by the Key Projects Supported by NSFC Joint Fund (U1911205), the Science and Technology Project of Department of Natural Resources of Hubei Province (ZRZY2022KJ07) and Hubei Natural Science Foundation of China(2019CFA023).

Abstract: Under the influences of the geological conditions of landslide and external periodic and random factors, the evolution process of the landslide has typical abrupt characteristics. The conventional deep learning model based on gating mechanism has insufficient ability to predict step mutation sequence, while by mining the potential information of time series data with different scales, multi-head self-attention can adaptively find the alteration trend of sequences and improve the prediction ability of landslide sequence. Based on variational mode decomposition, the cumulative displacement of landslide was decomposed into trend displacement, periodic displacement and stochastic displacement. Dynamic time warping algorithm was used to analyze the correlation between each component and influencing factors. These displacement components were dynamically predicted by a modified model integrated with long short-term memory (LSTM) neural network and multi-head self-attention mechanism, and the predicted values of each component were added to obtain the cumulative displacement prediction result. The monitoring point ZG118 of Baishuihe landslide in the Three Gorges Reservoir area was taken as an example to predict the cumulative displacement in this paper. The monitoring points ZG93 and XD01 were used for model adaptability verification. The results show that the new model can greatly improve the prediction accuracy for the step data mutation caused by the changes of rainfall and reservoir water level, providing a new idea for the prediction of landslide displacement in the Three Gorges Reservoir area.

Key words: landslide displacement prediction, variational mode decomposition, dynamic time warping, multi-head self-attention mechanism, long short-term memory (LSTM) neural network

CLC Number: 

  • P642
[1] JIANG Yu-hang, WANG Wei, ZOU Li-fang, WANG Ru-bin, LIU Shi-fan, DUAN Xue-lei, . Research on dynamic prediction model of landslide displacement based on particle swarm optimization-variational mode decomposition, nonlinear autoregressive neural network with exogenous inputs and gated recurrent unit [J]. Rock and Soil Mechanics, 2022, 43(S1): 601-612.
[2] YANG Jian-hua, ZHANG Wei-peng, YAO Chi, ZHANG Xiao-bo, ZHOU Chuang-bing. Characteristic analysis of rock vibrations caused by blasting excavation in deep cavern based on variational mode decomposition [J]. Rock and Soil Mechanics, 2021, 42(12): 3366-3375.
[3] ZHANG Kai, ZHANG Ke, BAO Rui, LIU Xiang-hua, QI Fei-fei, . Intelligent prediction of landslide displacements based on optimized empirical mode decomposition and K-Mean clustering [J]. Rock and Soil Mechanics, 2021, 42(1): 211-223.
[4] DENG Dong-mei, LIANG Ye, WANG Liang-qing, WANG Chang-shuo,. Displacement prediction method based on ensemble empirical mode decomposition and support vector machine regression— a case of landslides in Three Gorges Reservoir area [J]. , 2017, 38(12): 3660-3669.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] YAO Yang-ping, HOU Wei. Basic mechanical behavior of soils and their elastoplastic modeling[J]. , 2009, 30(10): 2881 -2902 .
[2] SUN Yong. Research on calculation method of double-row anti-sliding structure under sliding surface[J]. , 2009, 30(10): 2971 -2977 .
[3] HU Wei, HUANG Yi, LIU Zeng-rong. Testing and theoretical study of undrained shearing strength of saturated loess under cyclic loading[J]. , 2009, 30(10): 2996 -3000 .
[4] LI Lei, ZHU Wei, LIN Cheng, T. OHKI. Study of wet and dry properties of solidified sludge[J]. , 2009, 30(10): 3001 -3004 .
[5] ZHANG Ming-yi, LIU Jun-wei, YU Xiu-xia. Field test study of time effect on ultimate bearing capacity of jacked pipe pile in soft clay[J]. , 2009, 30(10): 3005 -3008 .
[6] HUANG Ping-lu, CHEN Cong-xin, XIAO Guo-feng, LIN Jian. Study of rock movement caused by underground mining in mines with complicated geological conditions[J]. , 2009, 30(10): 3020 -3024 .
[7] LIU Zhen-ping, HE Huai-jian, LI Qiang, ZHU Fa-hua. Study of the technology of 3D modeling and visualization system based on Python[J]. , 2009, 30(10): 3037 -3042 .
[8] CHEN Song, XU Guang-li, CHEN Guo-jin3 WU Xue-ting. Research on engineering geology characteristics of soil in sliding zone of Huangtupo landslide in Three Gorges Reservoir area[J]. , 2009, 30(10): 3048 -3052 .
[9] JIANG Ling-fa, CHEN Shan-xiong, YU Zhong-jiu. Scattering around a liner of arbitrary shape in saturated soil under dilatational waves[J]. , 2009, 30(10): 3063 -3070 .
[10] LENG Wu-ming, YANG Qi, LIU Qing-tan, NIE Ru-song. Study of new method for calcutating response of piled bridge abutment in soft ground[J]. , 2009, 30(10): 3079 -3085 .