Usually a modern OS will have a firewall up and block any/all incoming unsolicited traffic. So if they had your IP, they’d also need to have a program running on your machine to receive the traffic on an open port and send data back. They could really only get that if you ran some program you downloaded from an untrusted source.
Latest Answers