Unlimited Quote Collections
Organize your favorite quotes without limits. Create themed collections for every occasion with Premium.
I first of all explained to him why it wouldn't work, based on an argument in Rosenblatt's book, which showed that essentially it was an algorithm th… - Geoffrey Hinton
" "I first of all explained to him why it wouldn't work, based on an argument in Rosenblatt's book, which showed that essentially it was an algorithm that couldn't break symmetry... The next argument I gave him was that it would get stuck in local minima... We programmed a backpropagation net, and we tried to get this fast relearning. It didn't give fast relearning, so I made one of these crazy inferences that people make--which was, that backpropagation is not very interesting... [One year of trying and failing to scale up Boltzmann machines later] "Well, maybe, why don't I just program up that old idea of Rumelhart's, and see how well that works on some of the problems we've been trying?"... We had all the arguments: It's assuming that neurons can send real numbers to each other; of course they can only send bits to each other ; you have to have stochastic binary neurons; these real-valued neurons are totally unrealistic. It's ridiculous." So they just refused to work on it, not even to write a program, so I had to do it myself.
English
Collect this quote
About Geoffrey Hinton
Geoffrey Everest Hinton (born 6 December 1947) is an English-Canadian cognitive psychologist and computer scientist best known for his work on artificial neural networks. Since 2013, he divides his time working for Google (Google Brain) and the University of Toronto.
Biography information from Wikiquote
Also Known As
Alternative Names:
Geoffrey Everest Hinton
•
Geoff Hinton
•
Geoffrey E. Hinton
•
G. E. Hinton
Related quotes. More quotes will automatically load as you scroll down, or you can use the load more buttons.
Additional quotes by Geoffrey Hinton
I'm much more interested in how the brain does it. I'm only interested in applications just to prove that this is interesting stuff to keep the funding flowing. To do an application really well, you have to put your whole heart into it; you need to spend a year immersing yourself in what the application' s all about. I guess I've never really been prepared to do that.
In late 1985, I actually had a deal with Dave Rumelhart that I would write a short paper about backpropagation, which was his idea, and he would write a short paper about autoencoders, which was my idea. It was always better to have someone who didn't come up with the idea write the paper because he could say more dearly what was important. So I wrote the short paper about backpropagation, which was the Nature paper that came out in 1986, but Dave still hasn't written the short paper about autoencoders. I'm still waiting.
Loading...