[Large language models] require enormous amounts of data to… - Yann LeCun: Dark Matter of Intelligence and Self-Supervised Learning

" "
[Large language models] require enormous amounts of data to reach a level of intelligence that is not that great in the end. And they can't really reason. They can't plan anything other than things they’ve been trained on. So they're not a road towards what people call “AGI.”

Yann LeCun: Dark Matter of Intelligence and Self-Supervised Learning

Sources available for members. Sign up free to see where this quote comes from

English

Collect this quote

About Yann LeCun: Dark Matter of Intelligence and Self-Supervised Learning

Yann André LeCun (originally spelled Le Cun; born 8 July 1960) is a French-American computer scientist working primarily in the fields of machine learning, computer vision, mobile robotics and computational neuroscience. He is the Silver Professor of the Courant Institute of Mathematical Sciences at New York University and Vice-President, Chief AI Scientist at Meta. LeCun received the 2018 Turing Award, together with Yoshua Bengio and Geoffrey Hinton, for their work on deep learning. The three are sometimes referred to as the "Godfathers of AI" and "Godfathers of Deep Learning.

Also Known As

Alternative Names: #258 – Yann LeCun: Dark Matter of Intelligence and Self-Supervised Learning

All quotes from Yann LeCun: Dark Matter of Intelligence and Self-Supervised Learning Similar Quotes by other Originators

Originators like Yann LeCun: Dark Matter of Intelligence and Self-Supervised Learning:

Pedro Domingos Kai-Fu Lee Erik J. Larson Robert J. Marks II Ilya Sutskever

Additional quotes by Yann LeCun: Dark Matter of Intelligence and Self-Supervised Learning

My problem with sticking too close to nature is that it's like "cargo-cult" science... I don't use neural nets because they look like the brain. I use them because they are a convenient way to construct parameterized non-linear functions with good properties. But I did get inspiration from the architecture of the visual cortex to build convolutional nets.

The direction of history is that the more data we get, the more our methods rely on learning. Ultimately, the task use learning end to end. That's what happened for speech, handwriting, and object recognition. It's bound to happen for NLP.

I don't like to call [human intelligence] AGI because human intelligence is not general at all.

[Large language models] require enormous amounts of data to reach a level of intelligence that is not that great in the end. And they can't really re… - Yann LeCun: Dark Matter of Intelligence and Self-Supervised Learning

About Yann LeCun: Dark Matter of Intelligence and Self-Supervised Learning

Also Known As

Works in ChatGPT, Claude, or Any AI

Additional quotes by Yann LeCun: Dark Matter of Intelligence and Self-Supervised Learning

Unlimited Quote Collections