It’s gonna turn out to be an filipino call center isn’t it.
That’s OpenAI admitting that o1’s “chain of thought” is faked after the fact. The “chain of thought” does not show any internal processes of the LLM — o1 just returns something that looks a bit like a logical chain of reasoning.
I think it’s fake “reasoning” but I don’t know if (all of) OpenAI thinks that. They probably think hiding this data prevents cot training data from being extracted. I just don’t know how deep the stupid runs.
I don’t think it’s alive, I think it’s talking to its self. They’re making a Chinese whisper machine, and it will remain so until it has embodiment, subjective and changing goals, and a will of it’s own.
That’s part of intelligence, but it’s still a reverse engineering take on things.
In actuality we have intelligence because our threat detection and social protection/survival goals became abstract enough for self-awareness to occur.
EDIT: Telephone game is what I meant.
Chinese whisper
Complete tangent but outside of the commonwealth, this game is referred to by the much less racist moniker “telephone”
I figured he was talking about Searle’s Chinese room thought experiment. Searle sucks though, so that’s probably also racist (in addition to being stupid.)
In 2024 it is, at the very least, extremely uncomfortable to read Searle describe Chinese writing as “meaningless scribbles”, “formal symbols”*, “squiggle squiggle”, and “squoggle squoggle”. Basically taking Chinese, ignoring the fact that it’s a real language used by real people and is not alien nor inscrutable nor mathematical, and using it as a prop to purposefully obfuscate a thought experiment.
But that’s like, just my opinion man.
* The paper never seems to get around to calling English letters symbols I wonder why.
the reason to pick Chinese may be racist (possibly due to the writing system looking complicated) but the thought experiment itself doesn’t have racist connotations imo, and i don’t think it’s stupid either. doesn’t have to involve Chinese or a specific language at all.
it’s a logical question to ask: if i can mimic speaking in a language to a point that it convinces native speakers, but don’t understand what I’m saying myself, am I considered a genuine speaker of that language? does what i say matter or have any value?
Thank you for explaining that. I, an American, have never heard the term “Chinese whisper”, but I’ve definitely heard of the telephone game.
It’s much more awkward as a subject of the crown. I tried explaining the game “telestrations” as pictionary + chinese whispers before I had this knowledge. I didn’t know!!! It’s even right there in the name!!! I swear I’m not racist!!!
(Note: I am of chinese origin and have heard my extended family mangle messages through the telephone. So both names are real to me)