What do you say when someone uses your words against you?

e.g. I went to ask my boss about a project extension which everyone else in my cubicle knows about except me (because the boss ped the word to this b**ch i hate). He asked me why i'm asking him, so I told him that it's because no one in my cubicle talks to me (which is true..its nothing more than hi/bye, and also for things that require cooperation). The next day, he saw me talking to someone in my cubicle (work-related), so as he walked by he goes "you told me that no one talks to you". He did that again on another occasion.