To bypass messing around with a cheaper sound card which plugs into USB but can't fit both jacks at the same time I decided to buy a more expensive USB hub with sound card and crack it open. This will allow me to connect the circuitry directly and also take power form the hub to bias the mic and power the pre-amp.

I chose a reasonably cheap UGreen one from amazon.

UGreen USB 2.0 hub with integrated sound card

My pre-amp was just a kit from maplin.