Labour faces difficult loss