What does it mean when people say that not even the creators of large neural networks or AIs like ChatGPT or Midjourney fully understand how they work?

Question

I’ve heard this sentiment a fair bit in recent years and I’ve never been able to find a good answer online.

In: Technology

Answer 1

It means the network started producing some results they did not expect and cannot completely understand.

Artificial neural networks of non-trivial size are impossible for us to completely understand once fully trained such that we can predict all that they can do.