Couldn't locate anything on other threads that is helpful to my situation.
So basically originally I tried solving this issue by replacing the plastic locking nut which was broken, with the aluminum one from amazon. I put it all back together and it still did not fix the issue. I can manually...