A doctors union has hit back at the NSW health minister after he pleaded for hundreds of psychiatrists not to quit in mere days, saying he spat the dummy because no one wants to work for them.