Imagine you're having a remote appointment with your doctor for a very personal health issue.
Your doctor is a tech enthusiast, and is proudly wearing the new Apple Watch with all the recording features enabled.
You don't see the "Audible and visible signals for Live Rewind", because you don't see your doctor's wrist on videochat or on speakerphone.
The "Omitted content" safeguard fails to detect the sensitive conversation, because none of the pre-selected keywords are detected.
"What about all the privacy laws protecting me?", you claim in distress.
Sadly, your doctor is unaware and thinks "surely Apple respects all the laws by default?"
The medical clinic isn't informed about privacy risks related to new technologies, and hasn't implemented any training or policies about it yet.
Your sensitive health data is collected by Apple's new features, stored on their servers, blissfully unaware of the infringements to your consent, your privacy, and all the laws supposed to protect you.
This is only one scenario of the many surveillance nightmares we might hear about in the coming months and years.
Brace yourself.
@Em0nM4stodon I think this is bigger and scary things are already happening. E.g. let's reframe the story lightly:
Imagine you're having a remote appointment with your doctor for a very personal health issue ...
The watch records the entire appointment, and after syncing via Apple servers, is transcribed using a small ML model on their iPhone making errors about your personal details. Your doctor acts on these errors and you face the consequences. There are no safeguards.
This could have been many years ago, using voice memos, syncing using iCloud. Or any other Apple device.
The unfortunate reality is that regulation desparately needs to keep up even without any of this new Apple stuff :(
E.g. in my country: most doctors now depend on *free* AI transcription sites that collect user data to sell as training data. They are meant to ask for consent. Some ask, and only fewer will listen when you say "no" since they have become dependent on this.
As far as I can tell, in a lot of the world, rights to privacy have fallen woefully behind the rights implicitly granted to corporations and individuals to spy on others 😞.
Also: terrible to learn that the "Siri Recap" thing can work on the Apple watch.............