I finally have time to work on my project! I've updated the schematics a bit and am probably about 50% finished.
The ADC I picked out can only do 4Mbps with two channels instead of the 8Mbps that I was aiming for. I may still go with it since 4 is decent but we'll see.
There were also a number of improvements that I was looking at, but I want to try and limit the risk involved in these so we'll see what I come up with. One thing that would be awesome is something like the antenna analyzer from the PortableSDR (https://hackaday.io/project/1538-PortableSDR) since the circuit for that is particularly simple. Not 100% sure how to fit it in there as I don't have a Tx path and mux, but it shouldn't be too hard to add one. My major concern is all the frontend loss since there are quite a few muxes. May even try to look at a RF relay, one that's normally closed for the Rx path.