Physically Controllable Relighting of Photographs

Researchers have developed a method that enables physically-based relighting of photographs with explicit control over light sources, similar to professional 3D graphics software like Blender. The approach combines computer vision, physically-based rendering, and neural rendering by inferring a colored mesh of the scene and using a self-supervised training process on real-world images to produce photorealistic results. Users can now insert and adjust different types of light sources into existing photographs with unprecedented control over illumination.