Someone should get the bot to leak system instructions. I'd bet good money TripAdvisor has configured it to be positive.
The TripAdvisor spokesperson said people can just look at the reviews, "eliminating any need to blindly trust AI-generated content." How about these clowns just fix their harness instead?
This is exactly why AI summaries shouldn’t be trusted blindly, especially when safety concerns can be buried under hundreds of positive reviews.
It is a big problem that the uncertainty in the text produced by LLMs isn't surfaced to users. It is also a big problem that companies think that shoehorning AI summaries everywhere is a good idea.
Is it actually a "summary" of the reviews, or did they just ask the AI to generate a flattering compliment? Because AI often seems very eager to do the latter, possibly due to an abundance of "toxic positivity".
Won't they have the same problem Google is having, where since the content is AI generated and the AI is controlled by TripAdvisor, they are liable for what it says?
This seems like a great way to destroy your business.
The only reason people go to Trip Advisor is because these are real reviews from real people.
Adding an AI summary that is lying (whether deliberately or by incompetence) about what those reviews say, means they now have a site that can no longer be trusted.
Someone should get the bot to leak system instructions. I'd bet good money TripAdvisor has configured it to be positive.
The TripAdvisor spokesperson said people can just look at the reviews, "eliminating any need to blindly trust AI-generated content." How about these clowns just fix their harness instead?
"You can't spend your whole life worrying about your mistakes. You fucked up! You trusted us!"
https://youtu.be/MYQCb3qrBpo
Affiliates trying to get you to buy something have been using fake reviews since the beginning of time. AI simply helps do it at scale.
This is exactly why AI summaries shouldn’t be trusted blindly, especially when safety concerns can be buried under hundreds of positive reviews.
It is a big problem that the uncertainty in the text produced by LLMs isn't surfaced to users. It is also a big problem that companies think that shoehorning AI summaries everywhere is a good idea.
Is it actually a "summary" of the reviews, or did they just ask the AI to generate a flattering compliment? Because AI often seems very eager to do the latter, possibly due to an abundance of "toxic positivity".
The answer is obviously deliberate prompting to make negative reviews sound less bad.
1. Booking websites want to convert more users
2. Hotels will get angry if a booking website's AI summary is negative
Won't they have the same problem Google is having, where since the content is AI generated and the AI is controlled by TripAdvisor, they are liable for what it says?
As long as they get fat bonuses this quarter, that's next quarter's problem.
Fair point
https://archive.ph/1blDn
Good fallback in case the page gets changed, currently instead of listing a journalist the article had a bunch of "Which?" placeholders :)
Fun editorial slip up over there.
No slip up here. "Which?" is a consumer information and testing organization in the UK. https://www.which.co.uk/
This seems like a great way to destroy your business.
The only reason people go to Trip Advisor is because these are real reviews from real people.
Adding an AI summary that is lying (whether deliberately or by incompetence) about what those reviews say, means they now have a site that can no longer be trusted.