Do you have to allow a union representative to be present whenever the employee wants one?

No. For example, a union representative is not appropriate in meetings to give work assignments, coaching sessions, or performance evaluation discussions. However, employees have a right to have a representative present if they reasonably believe that disciplinary action will result from a meeting.