Bi-LSTM

Time Series Prediction Using LSTM Neural Network

by
Time Series Prediction Using LSTM Neural Network

Click the blue text to follow us Happy New Year, wishing you good fortune in the Year of the Dragon Happy Spring Festival LSTM Neural Network Time Series Prediction Given a simple dataset, we use Long Short-Term Memory (LSTM) neural networks to implement time series prediction, with the ReLU function as the activation function. The … Read more

Essential Models for Speech Recognition: NNLM, RNNLM, LSTM-RNNLM, Bi-LSTM, and GPT-1

by
Essential Models for Speech Recognition: NNLM, RNNLM, LSTM-RNNLM, Bi-LSTM, and GPT-1

Machine Heart Column This column is produced by Machine Heart SOTA! Model Resource Station, updated weekly on the Machine Heart public account. This column will review common tasks in natural language processing, computer vision, and other fields, and provide detailed explanations of classic models that have achieved SOTA in these tasks. Visit SOTA! Model Resource … Read more

Step-by-Step Guide to Creating a Drake Lyric Generator with Python and LSTM

by
Step-by-Step Guide to Creating a Drake Lyric Generator with Python and LSTM

Produced by Big Data Digest Compiled by: Fei, Ni Ni, Mix Candy, QianTian Pei The main application of AI in the future is to establish networks that can learn from data and then generate original content. This idea has been fully applied in the field of Natural Language Processing (NLP), which is also why the … Read more

Interview: How Kika Input Method Is Built on LSTM and TensorFlow Lite

by
Interview: How Kika Input Method Is Built on LSTM and TensorFlow Lite

Original by Machine Heart Author: Siyuan Recently, Machine Heart interviewed Huang Kang, the senior technical director of Kika, who told us about the deep learning model used in the development of Kika’s input method AI engine (project code name: Alps) and the various challenges encountered in lightweight deployment on mobile devices. This article introduces the … Read more

Amazing! LSTM With Only Forget Gate Outperforms Standard LSTM

by
Amazing! LSTM With Only Forget Gate Outperforms Standard LSTM

Selected from arXiv Authors:Jos van der Westhuizen, Joan Lasenby Compiled by Machine Heart Contributors: Pedro, Lu This paper studies what happens when LSTM only has a forget gate and proposes JANET, with experiments showing that this model outperforms standard LSTM. 1. Introduction Excellent engineers ensure their designs are practical. We now know that the best … Read more

Visualizing LSTM Model Structure

by
Visualizing LSTM Model Structure

Source: Deep Learning Enthusiasts Author on Zhihu | Master Su Link | https://zhuanlan.zhihu.com/p/139617364 This article is about 3200 words, and it is recommended to read in 5 minutes This article introduces the visualization of the LSTM model structure. Recently, I have been studying the application of LSTM in time series prediction, but I encountered a … Read more

Application of Bi-LSTM + CRF in Text Sequence Labeling

by
Application of Bi-LSTM + CRF in Text Sequence Labeling

Machine Heart Column Author: Principal Engineer Dong Bingfeng, Chubao AI Lab The input vector X in traditional CRF is generally in the one-hot format of words, which loses a lot of semantic information about words. With the advent of word embedding methods, the word representation in vector form generally performs better than the one-hot representation. … Read more