Unconstrained real photos
Appearance transfer based on real photos. Our model struggles to retain parametric control.
A new approach to reach photorealism
We leverage differentiable rendering to reach photorealism by fine tuning 3D dynamic scenes to look like a set of target real life photos.
First proof of concept - 2021
Depth oracle
Our depth oracle speeds up rendering and retains shape during appearance transfer.
Constrained real photos
We can transfer the appearance and retain the parametric control when the real photos are closer to the base scene.
Features
The contributions of this stage are threefold.
- A low-res appearance transfer pipeline that retains parametric control
- A depth oracle network to efficiently render NeRF scenes
- Shape preservation during appearance transfer