We have Father & Sons and also Father Daughter camp outs separately.
No normal person is going to care if you take your daughters. Your daughters may feel uncomfortable that they’re the only girls though. Obviously, I don’t know your daughters though so I may be off.