01-03-2018 дата публикации
Номер: US20180060721A1
Принадлежит:
An apparatus and a method. The apparatus includes a plurality of long short term memory (LSTM) networks, wherein each of the plurality of LSTM networks is at a different network layer, wherein each of the plurality of LSTM networks is configured to determine a residual function, wherein each of the plurality of LSTM networks includes an output gate to control what is provided to a subsequent LSTM network, and wherein each of the plurality of LSTM networks includes at least one highway connection to compensate for the residual function of a previous LSTM network. 1. An apparatus , comprising:a plurality of long short term memory (LSTM) networks,wherein each of the plurality of LSTM networks is at a different network layer,wherein each of the plurality of LSTM networks is configured to determine a residual function,wherein each of the plurality of LSTM networks includes an output gate to control what is provided to a subsequent LSTM network, andwherein each of the plurality of LSTM networks includes at least one highway connection to compensate for the residual function of a previous LSTM network.2. The apparatus of claim 1 , wherein eachLSTM network is further configured to:{'sub': t', 'xf', 't', 'hf', 't−', 'cf', 't−1', 'f, 'sup': L+1', 'L+1', 'L+1', 'L+1', 'L+1', 'L+1', 'L+1', 'L+1, 'determine by a first function block f=sigm(Wx+Wh+W⊙c+b);'}{'sub': t', 'xi', 't', 'hi', 't−1', 'ci', 't−1', 'i, 'sup': L+1', 'L+1', 'L+1', 'L+1', 'L+1', 'L+1', 'L+1', 'L+1, 'determine by a second function block i=sigm(Wx+Wh+W⊙c+b);'}{'sub': t', 'xc', 't', 'hc', 't−1', 'j, 'sup': L+1', 'L+1', 'L+1', 'L+1', 'L+1', 'L+1, 'determine by a third function block j=tan h(Wx+Wh+b);'}{'sub': t', 'xo', 't', 'ho', 't−1', 'co', 't', 'o, 'sup': L+1', 'L+1', 'L+1', 'L+1', 'L+1', 'L+1', 'L+1', 'L+1, 'determine by a fourth function block o=sigm(Wx+Wh+Wc+b);'}{'sub': t', 't', 't−1', 't', 't, 'sup': L+1', 'L+1', 'L+1', 'L+1', 'L+1, 'determine by a fifth function block c=f⊙c+i⊙j; and'}{'sub': t', 't', 't', ...
Подробнее