but we had similar issues with our son until he was almost 6. It got really old, really fast.
I think he got the behavior from me. I'm a very light sleeper and when I wake up in the middle of night - for whatever reason - I hate it when the room is totally quiet.
So we have sound machines (now we use Amazon Echo dots in our rooms) to play 'noise'. I prefer ocean waves but my son prefers white or grey noise. When he was struggling with sleeping in his own room, the sound machine we got him had all kinds of choices, so we let him choose whatever he wanted.
He usually went for the 'forest' noise back then. We made it kind of fun for him and it ended up working.
Good luck!