What does it mean when people say that not even the creators of large neural networks or AIs like ChatGPT or Midjourney fully understand how they work?

Question

I’ve heard this sentiment a fair bit in recent years and I’ve never been able to find a good answer online.

In: Technology

Answer 1

The models themselves are built by algorithms and training datasets. The “creators” of the models designed the algorithms and curated the datasets, so they understand how those work. But the models those things spat out are a different story.