I've moved the BAR of the graphics device and this causes EFI graphics to stop working immediately. I can confirm it's moving it properly as when I boot OS with StartImage I get working video once the GPU driver loads showing the new BAR address. It looks like I need to inform the GOP driver that the BAR has changed address but I can't find any way to do that.