So since the start I had a bug where no matter what I did, the inner shaft would move randomly, continuously. Sometimes and sometimes not. I always thought that it was my shitty breadboards that was the cause for interference. However I figured I might try to set the RESET pin to 5V input instead of the 3.3V that the ESP provides.
EVEN though the datasheet says otherwise. And of course that works..

Will need to update Schematic to insert level shifter.