I threw together a slop project to test something. It put in some JSON for something that didn't use that. I told it it was just some plain text. It took the JSON library out again. Then I added in something that does use JSON and it tried to make a basic JSON parsing library from scratch.
It's like a very junior programmer at times, with amnesia.
It does make some menial tasks simpler, but if people think it will actually replace us then they're in for a shock.