A High Court judge has been accused of launching a veiled attack on a fellow justice in a speech slamming those he says want to stack courts with conservatives to achieve political ends.