As a first step, you could ignore all the mapping to the panels, except for the "Menu" panel which itself leads to the other panels...so you would already gain 6 buttons ;) Well in my case I'm using a xbox controller I thought I could use the share or xbox button but that's not available. for games ...

Asking for multi key combos for extra functions for those who are short on buttons.