Deep Neural Network implemented in pure SQL over BigQuery
In this post, we’ll implement a deep neural network with one hidden layer (and ReLu and softmax activation functions) purely in SQL. The end-to-end steps for neural network training including the forward pass and back-propagation will be implemented as a single SQL query on BigQuery. As it runs on Bigquery, in effect we are performing distributed neural network training on 100s to 1000s of servers.
Sounds cool! right?