He can't help it. The Doctor softens a little, turning back to her; it's exactly what she's do. She's not giving up and he admires that so much about her, always has. He's silent for awhile, minutes building up.

"You don't get it. When I look at you, I just see...wrong."

Maybe if he keeps saying it to her. If he ignores everything inside him that wants to take comfort in her being here, she'll go away. Back to her home with her Doctor. Leave him here with his consequences.

But he's still not leaving.