Eli5 – how does the new google phone know what’s behind the images it removes from pictures?

Question

I keep seeing these comerciales for this new google(?) phones that will remove background images in photos (like people and animals). How does the phone know what’s behind the images that are being removed? Have they just photographed every inch of the earth already?

In: 3

Answer 1

The trick here is that the phone doesn’t know what’s behind the image. It’s guessing, based off what is in the background and the idea that if you just put more of the existing background over the person you’re trying to erase, it will probably look okay? The ads you are seeing are for best case scenarios where adding more sand and more ocean or sky on a beach will look pretty normal.