I've had to wear costumes that would not work with garments (tights and kilts). In those cases I wear other undergarments while in costume but wear garments again once the show is done.

As long as a costume or outfit is not showing anything it shouldn't show I think it's OK to wear while in costume. For actresses I would say any time they're working - on the red carpet, photo shoots, etc. - they're in costume.