Well, this is what Google Research is trying to achieve with this new paper called Total
The goal is to properly relight any portrait based on the lighting of the new background
This task is called “Portrait relighting and background replacement”, which, as its
name says, has two very complicated sub-tasks: Background replacement, meaning that you will
need to accurately ...