Reptile: A Scalable Meta-Learning Algorithm

Reptile: A Scalable Meta-Learning Algorithm

  • March 8, 2018
Table of Contents

Reptile: A Scalable Meta-Learning Algorithm

We’ve developed a simple meta-learning algorithm called Reptile which works by repeatedly sampling a task, performing stochastic gradient descent on it, and updating the initial parameters towards the final parameters learned on that task. This method performs as well as MAML, a broadly applicable meta-learning algorithm, while being simpler to implement and more computationally efficient.

Source: openai.com

Share :
comments powered by Disqus

Related Posts

“Cracking” Morse code with RNNs

“Cracking” Morse code with RNNs

Spoiler alert: Morse code doesn’t really need cracking. Its useful because messages can be sent using this code with minimal equipment, and I say it doesn’t need cracking because the code is well known and what the combinations of dots and dashes stand for is no secret. But, in theory, it is a substitution cipher — where each letter of the alphabet (and each digit) has some representation using dots and dashes, as illustrated below.

Read More