Always a possibility. But one I'd like to avoid.
Good eye! I don't think I could have noticed that from a photo. But when you are looking at it in person, it's rather obvious. I noticed that when I first held it in place. To hit the 4 pads as much as possible, I have to pull the pulley inward. It looks like there is enough room on the shaft to hit the drive pulley. I have not looked yet, but I might also be able to push the drive pulley out a bit too. Last, but not least, the motor pulley can be reversed. Lots of ways to get there.
Since there are only 3 speeds, I am also thinking about a small 3 phase motor and a cheaper VFD. Or maybe a DC motor and speed control.
The motor I have is reversable.
I might also mount a drive crank so I can operate it manually.