Reply : Gulbasaur.
Top 1% Commenter
"Cancel the order, refund anything in full and don't let a chatbot make financial decisions for you."
Reply by original poster:
"Already refunded.
Chatbot isn't supposed to be making financial decisions. It's supposed to be answering customer questions between 6pm and 9am when I'm not around.
It's worked fine for 6+ months, then this guy spent an hour chatting with it, talked it into showing how good it was at maths and percentages, diverted the conversation to percentage discounts off a theoretical order, then acted impressed by it.
The chatbot then generated him a completely fake discount code and an offer for 25% off, later rising to 80% off as it tried to impress him."