AI can create a chess game in code for you to play on your PC if you ask it. The results are pretty OK. In that video I linked to, all the AI overthought their moves. They made a silly move throwing the game when they forgot what they planned to move before and are literally a couple of moves before check mate. It shows that AIs are coming close to hitting the wall at the moment, need new paradigms.
Are they hitting the wall really?
I doubt that. I think you are talking about a very particular usage case - chess playing, on transformer models which were evolved for verbal interaction and are not specifically suited to the particular task. This is not AGI where the AI replicates ALL human cognitive ability. The models in use have capabilities specific to language, so they can talk about chess; they can discuss how to play chess, but if usages are contrived with strange algebraic notation to allow them to play, they don't play like a grand master, and make novice mistakes. Or if you ask a language model to write the code for a computer game that plays chess, it's current level of coding ability might not be up to the standards of Stockfish. How good was the prompt that was used to make the game?
The quality of ANY kind of response depends on the training and also the quality of the prompt.
AI planners wanted to use AI to write and debug code - they made it do that by showing it massive amounts of code and discussions about code. AI got good, or better at coding.
If there is a market for the feature, and there are particular deficiencies in performance, the AI companies just need to tweak the training.
That said - we are only 7 years out from the invention of the transformer architecture by Vaswani et.al. Seven years since the seminal idea on how to make an AI architecture which could make models understand human language and respond in a human like way. We are right at the beginning.
How long did it take to evolve human intelligence from ape-like intelligence? About 6 million years.
I think the rate of progress is astounding and don't forget the progress has been based on one particular type of model architecture.
There will be a crowd of downy chinned, geeky youths right now evolving completely new architectures which will make Chat-gpt type models look like some computer game from 1980. AGI will come pretty soon, I think - especially now that the investment in developing it is so big.
As an aside, at six this morning when I turned on the radio, I heard of some UNITE trade union dinosaurs wittering on about how AI needed to be constrained to prevent it taking people's jobs..... Fat chance of that. If unions seek to frustrate the use of AI in workplaces, the businesses being restricted will fold in the face of the non union crippled competition.