I learned today that deep learning is basically a glorified neural network. And Maze problems are best solved using recursion.
Have been chugging along the AI learning curve. I am liking the University of Washington’s Machine Learning Certificate Track very much. I think the professors are very good and the format of the lessons is very good. You’re following along and doing hands on exercises. I think all the programming courses should be like that.
I think Ben Franklin once said
Tell me and I forget. Teach me and I remember. Involve me and I learn.
Separately, I learned about Davide Maltoni’s HTM research paper. He’s a professor at a school in Italy. He used HTM for handwriting recognition and found that it outperformed other machine learning techniques. So that’s cool. I am in the process of reading through paper now.
As I am chugging along, I must tell you viewers of this blog what are my favorite things. My favorite thing in the world right now is protein powder called vega proteins and greens.
Just been chugging along through coursera courses and my weekly readings. This week, I came across FB’s AI research group’s Memory Networks paper. I thought it was interesting particularly because they are having some success with it. The paper effectively stores information in an array and retrieves it to make intelligent predictions. To me this further adds evidence that brains’ work via a memory system and this approach from FB folks is very similar to what Jeff Hawkins is proposing.
The second thing I discovered this week was on what the so called Artificial Intelligence methods (such as the Gradient Descent and Logistic classifiers) are really doing. In our brains we make prediction via our memory system and possibly using sparse codes. Sparse codes are effectively a way of zipping and storing information. In the current state of the art Artificial Intelligence Methods, the derived/fitted regression parameters are effectively mathematical ways of zipping information. Thus the point of this entire “building intelligence” exercise is to store information in ways that can help you make accurate predictions.