Maybe this could help FOSS developers make something like this for Linux or Android. This is an article from Apple Machine Learning, on how they made mobile apps accessible with machine learning:

machinelearning.apple.com/rese…

#a11y #apple #ml

Making Mobile Applications Accessible with Machine Learning

At Apple we use machine learning to teach our products to understand the world more as humans do. Of course, understanding the world better…

^{Apple Machine Learning Research}