Is Olivier Sarkozy’s young gal pal, Mary-Kate Olsen, bored? The pint-size fashionista looked “grumpy and irritated” in a Knicks suite with Sarkozy on Wednesday. “She looked annoyed,” said a spy. “She wasn’t smiling . . . he was rubbing her back, kissing her, making all these sweet gestures.” Then, “She perked up to take a photo, and looked grumpy again.” An Olsen rep said: “Mary-Kate was perfectly happy. They had a nice evening.” Sarkozy was also spotted entertaining Olsen at the Tribeca Ball, “doing a little dance.”