Our software works as fast as you can blink! We managed to translate all your facial movements to morse code which is then populated into real characters that you see while typing. Other web element interactions are all controlled by similar movements.
By utilizing Computer Vision techniques we were able to create a software that incorporates facial recognition that can be used to interact with web elements completely hands-free. Additionally, it can remember your facial thresholds after configuring it once so you save time on every recurring use.
It uses Selenium to automate the web elements and a series of facial patterns to cycle through all the interactable elements and modify them in some way such as typing on text fields or sliding through the different images on a slideshow.
Here you can find detailed information on our project.
