Nancy Pelosi recently revealed that she and Biden have not spoken since he dropped out of the race