I am able to rotate the rotor when the PCB is in a vertical position.  I did experiments with both magnets and ferrite beads. Both can change the field and disrupt the working of the motor entirely. I found one configuration where ferrite used in each center of the pcb coil and as an outer ring. This led to increased strength. (forgot to write down the article).  I also had success with a magnet but it was much harder and I think it is the wrong direction.

I used SS7X4X3W from Toshiba.

I am to improve the mechanical design a bit and then do some optical tests.