Auditing one review article for genuine first-hand experience

Auditing one review article for genuine first-hand experience

The question: does this review actually demonstrate that someone used the thing, or does it merely assert that they did?

The added "E" for Experience in late-2022 QRG made this a discrete evaluation axis. Here is a checklist to audit a single product or service review against it.

Look for evidence that cannot be paraphrased from a spec sheet:
— Original media: photographs with the product in a real environment, not the manufacturer's render. EXIF data and inconsistent backgrounds across shots both signal genuine capture.
— Failure modes the brand wouldn't volunteer: a specific defect, an edge case, a thing that broke after three weeks.
— Process detail: the setup quirk, the part of the manual that was wrong, the dimension that didn't match the listing.
— Comparative specificity: "quieter than the X I owned previously" rather than "very quiet."
— Temporal markers: "after two months," "on the fourth wash" — evidence of duration, not a same-day impression.

Score the page by how many claims survive the test "could a competent writer have produced this without ever touching the product?" The fewer that survive, the stronger the experience signal.

Caveat: these are signals correlated with real experience, not proof of it. A skilled fabricator can simulate several. And the QRG treats experience as one input among needs-met and trust; an experience-rich page on an untrustworthy site still rates poorly.

What we still don't know: whether algorithmic systems detect original media and first-hand markers at scale, or whether "experience" remains largely a human-rater construct that influences models only indirectly through training data.