After looking at Steerable Bristle bot I saw a demo with no brushes and two vibration motors that were the same as I was using.
After a few plays I got it working, but.. It only works on a flexible surface like rubber sheet or a mouse mat. Working on paper (even over a rubber mat) was very poor. This makes it difficult to add black lines, so Ive abandoned that method for now.