I shared this experience here before, but I'll do so again.
I was in a predominantly black neighborhood (like, 99% black) and went out for dinner with my then-fiance at Red Lobster. On the way in we got a lot of remarks like "hey whitey" or "damn, wish I had heels like that" (wtf does that mean?) in a mocking voice. Didn't really bother us, but when we got to the (huge) line, they started letting in a lot of people before us, even if they got there after. Eventually after waiting long enough and still not getting a seat and getting the uncomfortable side eye from everyone, we left and went somewhere else.
Is it racism? In the purest sense of the term, yes. BUT, there's no damaging effects of racism on white people other than people just generally being mean and making us feel uncomfortable or wait in lines longer. There's no race-wide history of being screwed over because of being judged or looked at differently. Discomfort and inconvenience is a whole different world to active discrimination.
So I think it's racism, I guess, but not the way we've come to know it in our society, where it's actively damaging, dangerous, and problematic. It's more like getting bullied in elementary school, which still sucks, but isn't the same.
That's just my two cents though.