So many people conveniently disregard facts like this. It's much easier to write it off as "impressive auto-complete", "a writing assistant", "simply regurgitating the training data", etc.
It's an alien intelligence that we barely understand. It has many limitations but also possesses insane capabilities that have not been fully explored.
What happens when you take gpt-5, give it 100x more context / "memory", the ability to think to itself in-between tokens, chain many of them together in such a way that they have more agent-like behavior, along with ten other enhancements we haven't thought of? No one knows...
The biggest limitation of GPT capabilities is our imagination.
It's an alien intelligence that we barely understand. It has many limitations but also possesses insane capabilities that have not been fully explored.
What happens when you take gpt-5, give it 100x more context / "memory", the ability to think to itself in-between tokens, chain many of them together in such a way that they have more agent-like behavior, along with ten other enhancements we haven't thought of? No one knows...
The biggest limitation of GPT capabilities is our imagination.