The information Robb has collected about her siblings over the course of time is a bit of a chaotic mess, but he feels that he has a vague sort of picture. But it's the rest of what she says that makes him ask--"What do you mean they don't come to you?"