So everything went as planned, using SPI the whole loop executes in under 1ms (compared to 8ms with i2C at 400kHz). I didn't even have to set the SPI speed, the default for the nrf52 was plenty fast. Next, I added delay(17) at the end of the loop, so...