Best approach to implement arrow key focus navigation?

[chuckdries]

Hi,

I'm working on a game with a 2D grid of tiles.

<A11y> gives me the ability to tab through them sequentially, but since there's 45 tiles, that can be kind of inconvenient depending on where on the board you want to go. What would be the best way to go about adding arrow keys for directional "focus jumping"? Is there a way to script focus on the button elements that react-three-a11y renders, or do I need to emulate focus myself? If so, what else do I need to implement to emulate "real" focus as closely as possible?

Thank you in advance for the help, and thank you all for the amazing libraries!