Reptile: A Scalable Meta-Learning Algorithm

Reptile: A Scalable Meta-Learning Algorithm

  • March 8, 2018
Table of Contents

Reptile: A Scalable Meta-Learning Algorithm

We’ve developed a simple meta-learning algorithm called Reptile which works by repeatedly sampling a task, performing stochastic gradient descent on it, and updating the initial parameters towards the final parameters learned on that task. This method performs as well as MAML, a broadly applicable meta-learning algorithm, while being simpler to implement and more computationally efficient.

Source: openai.com

Share :
comments powered by Disqus

Related Posts

“Cracking” Morse code with RNNs

“Cracking” Morse code with RNNs

Spoiler alert: Morse code doesn’t really need cracking. Its useful because messages can be sent using this code with minimal equipment, and I say it doesn’t need cracking because the code is well known and what the combinations of dots and dashes stand for is no secret. But, in theory, it is a substitution cipher — where each letter of the alphabet (and each digit) has some representation using dots and dashes, as illustrated below.

Read More
Machine Learning Workflow on Diabetes Data : Part 02

Machine Learning Workflow on Diabetes Data : Part 02

In my last article of this series, we discussed about the machine learning workflow on the diabetes data set. And discussed about topics such as data exploration, data cleaning, feature engineering basics and model selection process. You can find the previous article below.

Read More