18
Demo Star Citizen with OpenTrack Neuralnet head tracking plugin (4k 30fps)(on Linux PC)
(discuss.tchncs.de)
It has been a while that I tried Star Citizen. With the new Neuralnet Tracker plugin (AI haha) for OpenTrack we get head tracking without annoying IR LEDs or reflecting stripes just by reading the webcam video feed. This is apparently fast enough to try head tracking without a dedicated head tracker nowadays. And all that on a Linux PC. Took some fiddling but the concept still works. What a time to be alive.
Nice. How's the input lag compared to IR? Can't really tell from your video if there is a lot of delay between head movement and camera movement in SC.
Can't tell for sure either. ~~It~~ Lag feels slightly higher but perfectly fine for trying some head tracking without investing in additional hardware. This depends a lot on the processing power, of course. Cam doesn't matter that much. It seems to read with only ~540 px width or something and any webcam of the last decade should manage ~50 fps with that 🤔
I'm also uncertain what the current penalty is for running this on Wayland via gamescope, which is really bringing my rig to it's limits.