@lavaeolus @realn2s @jonny https://github.com/iscc/iscc-sct this is unfortunately just impossible to use in a non-evil way

One of the most interesting aspects of the Semantic Text-Code is its ability to generate (near)-identical codes for translations or paraphrased versions of the same text. This means that the same content, expressed in different languages, can be identified and linked, opening up new possibilities for cross-lingual content identification and similarity detection.

it's a surprisingly interesting concept and i think hamming distance might be the right choice if you expect your quick-n-dirty translation lookup tables to be wrong for anything not obvious? if they generate a range of possible translations per word that would be pretty evil. not going to think about this more but. my mind is very much made up

also MD5 having more hash collisions but being faster is actually a good quality for surveillance and not integrity imho. but the main benefit for surveillance is just being faster so you can focus on all your other surveillance checksums more easily