Can’t think of a remedy other than ear plugs but I just got used to it.
To the extent where it’s took me a while to get used to not having a fridge going.
If it helps I don’t know but I used to prefer keeping it on constant - saves waking up and thinking “■■■■ something’s wrong” and also you don’t that the oh so non invasive pre start beeeeeeeeep and it turning over.