I think he came in with giant expectations as a semi-local kid with preposterous high school stats. He ended up as a round peg in a square hole at point guard after Jalen Carey broke his thumb by beating out Brycen Goodine, earning Boeheim's respect along with the starting spot. So, when he made mistakes like sloppy turnovers or taking noticeable ill-advised shots (deep threes, especially early in the shot clock), they stuck out like sore thumbs and made people turn against him.
The following year, many felt Kadary Richmond should have been the starter over him. In reality, the backcourt should not have been a binary choice of Buddy Boeheim-plus-one, but pick two of the three.
And the die was cast.