Climate setbacks could harm Labour says Polanski