How does ChatGPT understand code so well?

67 views

I’ve seen all the examples of the crazy stuff ChatGPT can do, but the one that really gets me is the coding. It can explain what a function does, and write novel syntactically correct code. How on *earth* can it do that? What is in its training set, and how does it work out the meaning behind code?

In: 3

2 Answers

Anonymous 0 Comments

I would guess the developers have trained it on large datasets, scrapped or contributed from a combination of volunteers, internet archives, research projects and other similar sources. Large companies, like Google for example, have spent millions (if not more) for years on this type of stuff.

Here’s something random I tried: https://imgur.com/a/fZL95Q1

Fascinating!

You are viewing 1 out of 2 answers, click here to view all answers.