Might be the problem
Sounds like it's side loading the the wheel bearings when you tighten the large retaining nut. Hard to prove this with cv assy turning the diff. Also if the spacer is loose between the inner bearing races after pressed in the spindle .. That isn't good either. I had to make a spacer .014 over. If you do this on the bench, put the assy together, torque the nut ...those bearings should turn as if the nut were finger tight....us a old outer cv speeds things up....Not a quick fix but it solved the problem ..Use ONLY factory bearing