When people ask "Are you going by yourself" what do they want?

He wanted to come along, silly, and it was very rude of him to stop talking to you after you indicated you weren't going alone and didn't invite him.