I kept the box there overnight and made a little entrance hole hoping to get the bees access to the queen.
Unfortunately I must not have caught the queen or she decided to leave the box because there were only 5-10 bees in there the next day compared to the thousands that I put in there initially.