The fall of RNN / LSTM
It is the year 2014 and LSTM and RNN make a great come-back from the dead. We all read Colah’s blog and Karpathy’s ode to RNN. But we were all young and unexperienced.
Read More
“Cracking” Morse code with RNNs
Spoiler alert: Morse code doesn’t really need cracking. Its useful because messages can be sent using this code with minimal equipment, and I say it doesn’t need cracking because the code is well known and what the combinations of dots and dashes stand for is no secret. But, in theory, it is a substitution cipher — where each letter of the alphabet (and each digit) has some representation using dots and dashes, as illustrated below.
Read More