ELI5, how does stabbot and other stabilization software work?

227 views

How can it tell the difference between true video movement and just camera shaking/twitching?

It seems like every stabilized video is perfectly stabilized, with no errors or mistaken movement.

In: 6

3 Answers

Anonymous 0 Comments

It looks at a handful of frames and tries to pick out the “objects” in the frame by looking for edges and discernible shapes. It does further analysis to try and figure out depth and distance. This sounds amazing but it’s more or less what your brain’s doing with your eyes right now. (I mean, that’s still amazing, it’s just not a new trick. What made it take so long was getting enough computational power to do it on the fly, not the math of how to do it in general.)

Then it looks at how those objects seem to have moved between several frames. If it looks like the frames are tilting one way, it can rotate the frame to try and compensate and keep things moving along a straighter path. This takes some fiddly math, as it has to try to figure out the general motion of the objects then start to work out how they’re deviating from a “straight” path. It’s guessing. But it gets to guess a lot of times every fraction of a second and given enough guesses it’s pretty good at figuring it out.

You are viewing 1 out of 3 answers, click here to view all answers.