He’s in town for three days and can’t find time for even one meal or to visit?
I’ve been on business trips and I get that they’re sometimes packed. But I always had at least a couple of open hours each day. If I visited where a family member lived, I’d for sure try to arrange to meet for breakfast.
Even if I really didn’t want to meet up with my brother, I’d at least put out a token effort (although I’d maybe make sure our schedules didn’t match up or something).