It's fine. Just ask him in work to eat the lunch time/room meal with you and make the flirting most of it in the slotted time. It's a sure hit.
