Just a quick update:
Currently I have the keyboard with 12 buttons and 2 rotary encoders working on a breadboard. I'm waiting on some tact switches and rotary encoders but the two missing encoders are polled nonetheless and should work when put in place.
As mentioned previously, I want to add a button that allows to switch between multiple different sets of keyboard shortcuts. Polling another button to do that should be pretty straight forward.