We do not even know if the very first language was used by Homo sapiens, language is so old that it has been with us on evolutionary scales.
After you just refer to something with a sound you can make, and the other person agrees then you can start stringing them together. Rules eventually form, even if nobody fully knows the rules some things will be right and wrong.
Latest Answers