The right to contest AI-generated decisions (e.g. about benefit allocations) rests on the assumption that people can tell whether a decision is contestable and, if so, on what grounds. I can find no support for that assumption and I believe it is false.
Nice to see some empirical evidence: "Our results show that human experts cannot reliably use explanations to flag discriminatory predictions irrespective of how much information about the predictions they have."
