White House: Delegation ready to leave, Vance stays