Hello!
Do you guys have experience with gaze controlled apps? I already tried WebGazer and some smaller TensorFlow based solutions. The most reliable is WebGazer but performance is so poor that it eats almost all the resources on an RTX3080Ti. FPS is around 80-90 (and it’s running only the detection stuff) but it would be a joke to require such powerful HW to use this feature in the game. The CPU based calculations are useless. I am getting around 30 FPS and even less on a 5gig i9. (maybe multiple webworkers could help here)
I tried to leave out the eye movement detection and used only face detection. It’s millon times faster but this way the player needs to rotate his head and it’s not that cool and accurate.
I am thinking of utilizing custom color detection which works pretty fast and track the eye’s white and dark areas but I’m not sure it will work.
It’s so cool to aim a Vulcan cannon at the enemies and shoot missiles just by double blinking 
so it would be quite painful to leave the feature out of the game so really any input is appreciated!
I did some research on other frameworks but don’t have enough spare time to try them all so guys if you can save me some time by shedding some light on this topic and have a working shareable solution I will be really happy and thankful!
Thanks a lot!
and thanks once again!
). Not just the tracking stuff itself but the anime character is incredible as well! 
