I finally removed the windows, caulked the seems and fastened them down permanently. I think I might have overdone the caulking.
Still some framing to do on the inside but I can do that with the windows in.
And finally. The last window (for now) is installed. I’m not yet sure which side I am putting the smallest one.