One of many things I'm concerned about is the growing trend of people using Gen AI in law, presenting to clients and to courts their Professional opinion, which may or may not in fact be based on existing precedent, nobody checked.
This is coming up today because there's yet another case of contempt of court: https://beige.party/@adub/115820660155470327
I noted in the comments that someone's compiling an international database where someone presented incorrect AI law in court: https://www.damiencharlotin.com/hallucinations/
In my opinion it entirely undermines the legal system, which is theoretically based on precedent, meaning specifically "what that judge said in that prior case." Not "what judges might plausibly have said, in a format that looks like fact, as programmed by tech bros."
Generative AI, I would submit, makes a mockery of the law.