The fall of RNN / LSTM

It is the year 2014 and LSTM and RNN make a great come-back from the dead. We all read Colah’s blog and Karpathy’s ode to RNN. But we were all young and unexperienced. For a few years this was the way to solve sequence learning, sequence translation (seq2seq), which also resulted in amazing results in […]

“Cracking” Morse code with RNNs

Spoiler alert: Morse code doesn’t really need cracking. Its useful because messages can be sent using this code with minimal equipment, and I say it doesn’t need cracking because the code is well known and what the combinations of dots and dashes stand for is no secret. But, in theory, it is a substitution cipher — where […]