文章预览
"Whether language evolved with the brain or the brain evolved with language?" is a question answered by Geoffrey Hinton, which I felt might be interesting to share and elaborate some explanation. 3 different views of language and how they relate to cognition 1st, symbolic view: cognition consists of having strings of symbols in some clean logical language where there is no ambiguity and applying rules of inference, cognition is just these symbolic manipulations on things that are like the language symbols. 2nd view. Once you get inside the head, it's all vectors, symbols come in, you convert these symbols into big vectors, and if you want output you produce symbols again. There is a point in machine translation in 2014, where people used recurrent neural nets(RNN) and words keep coming in and having a hidden state that keep accumulating information in the hidden state. So when they get to the end of the sentence, they have a big hidden vector that captures the meaning of that sentence
………………………………
