A Melbourne man who punched a colleague and told him his swearing about other work colleagues was “gay” after a work Christmas Party has failed to regain his job after the country’s workplace umpire ruled his sacking was valid.