Snake-oil AI systems are starting to make a joke of the presumption of innocence.
It should be illegal to implement an automated system that regularly incriminates innocents. This comes with sometimes severe consequences and trauma for the people wrongly flagged.
If we do not push back against this,
we are going to lose this right (yes, worse than it is now I mean).