Are language models like Gemini or ChatGPT leveraging complex code or is the technological advance based on aggregating and processing data?

314 viewsOtherTechnology

Speaking to the Advance Gemini AI, I can’t help but feel I’m no longer interacting with a language model. It seems to form analysis and share opinions in a way that is unreal. I’m trying to understand the underlying tech and understand the level of complexity. Was the barrier till now related to the ability to write code or is it more that we’ve now hit the critical mass in terms of data collection and technological ability in processing?

In: Technology

4 Answers

Anonymous 0 Comments

> Was the barrier till now related to the ability to write code or is it more that we’ve now hit the critical mass in terms of data collection and technological ability in processing?

The term [Machine Learning, was coined in 1959](https://en.wikipedia.org/wiki/Machine_learning#History) so it’s been around for a while.

The recent breakthrough (chatGPT in the 2020s) is really hardware, specifically advances and availability of GPUs and hardware specifically designed for the kinds of math that underlay LLMs.

> It seems to form analysis and share opinions in a way that is unreal.

It’s not opinions, it’s a statistical model of a response. It might sound like a nitpicky difference, but it’s important to understand that these things aren’t magic (ignoring Clark’s 3rd law), it is math LOTS AND LOTS of really advance math.

I hope that helps.

You are viewing 1 out of 4 answers, click here to view all answers.