Just to add something to the other answers:
A comprehensive answer is not really possible in ELI5. Gravity follows an inverse-square law, and that does result in elliptical (or paraboical) orbits, but WHY that is the result is not easy to explain.
Back in the day, Isaac Newton had to invent a whole new branch of mathemathics for this.
Latest Answers