I saw an example on Twitter recently of very well done text to video renders that look as good as Pixar animation. But these tools work in minutes apparently. How does it work when Pixar needs supercomputers to render every single frame in their movies and it’s very time consuming?
In: Technology
They are using a totally different method of rendering. Pixar would render this by tracing every path of light for every pixel a hundred times. And they would probably do it on CPUs which aren’t optimized for this because they want greater precision than a GPU can give. They also simulate materials, physics, water, air/fog, transparency, and after effects.
Meanwhile rendering video using AI is all done on GPUs. Also, it has no lighting or physics simulation. It has no ray tracing. It is guessing based on pattern recognition in that has been trained into the algorithm. This can give much much less reliable but fast and impressive results.
It is also worth noting that these videos were also probably rendered on supercomputers if they were done at decent quality very quickly.
Latest Answers