Will Mike Duffy's allegations hurt Stephen Harper?