Are the Tories worried about a federal election?