Are you using a sleeve to constrain the inner races (blue to green arrow) of the ACBs?
Putting pressure on only the inner race of the first ACB @ green arrow (with your nut on the pulley end) will not properly constrain the set-up.
You could use the nut on the pulley end to push the inner...