I can and it has nothing to do with of the YA films. Like you said, I don't hold it against people like Kristen Stewart or Jennifer Lawrence or Ansel either.
I just haven't seen a good/great performance from him, in my opinion of course and I did see Baby Driver. Not saying his is the worst thing on the planet or anything, but I don't think he's all that good either.