In any render engine I am aware of, the number of pixels has a major impact on rendering times. You can try any render intensive game, that is why 8k is much slower than 4k, than 2k pixels and so on.
You can even just get the same effect in Blender, if you play an animation and show the fps (and unlocked the fps from its standard 24 fps ).
Half the size leads to four times less pixels to be calculated, if I am not mistaken. So I find those values you show not surprising