Scaramucci's sudden departure comes the same day that retired Gen. John Kelly took over as chief of staff. Until this week, Kelly was Trump's secretary of Homeland Security.