It shouldn't, but there's a very brief moment where he seems disgusted and irritated, which made me wonder if perhaps Grodd wasn't the first time traveler to come back and try to start shit.