Post #3203071

@jcsteh@aus.social Last year I did something similar with a Minisforum mini PC and its HDMI output connected to my Windows desktop using an Elgato capture card. Except I then used OBS Studio's full screen projector so it was showing the HDMI video stream, which I then passed along to Gemini using the Google AI Studio website and the screen sharing option found there. Combined with the voice chat feature, this meant I was actually able to talk to the AI which also had access to the video stream, enabling me to ask Gemini what was currently visible, how to navigate to a certain option using arrow keys, whether it was currently on or off, etc. It was still kinda slow but ended up working incredibly well, once it was going it honestly was pretty mindblowing stuff.