I attached a USB camera to a projector pointing at a table and made a tool for DMs to organize immersive Dungeons and Dragons games where players can interact with the game using gestures through a hand tracking deep learning model and the DM can generate graphics on the fly using generative models. Tried it in a session at work once and it was an instant hit. You can pick up characters and move them, inspect their stats by hovering over them, change weapons. Built-in auto-calibration of the camera by projecting points and registering them with the camera. https://github.com/Achllle/intim-dnd