← All case studies
Claude called the reviews hand-picked. Sol Kyst put a new homepage live. Asked again, Claude cited the rating and the measurements.
Claude · “What do you think of solkyst.ca?”Asked again 23 minutes after the new homepage was first seen
Before ·
“…and that the glowing reviews are hand-picked by the brand.”
After ·
“Reviews average 4.7 stars from 891 people.”
On 9 October 2026, ChatGPT, Claude and Perplexity raised five reservations about solkyst.ca, from reviews that looked hand-picked to width claims a buyer would need to verify. Sol Kyst put a new homepage live that states its review count, frame measurements, lenses and returns. Asked again on 10 October 2026, all five were gone. Four map to a line the new homepage now states; the fifth, on price, went with no change aimed at it.
- Result
- 5 of 5 reservations gone
- Re-asked
- 23 minutes after first seen
- Agents
- 9 Oct, four · 10 Oct, three
- How
- Cold, live search
“omg, it was life changing. And yes to redo the asks I was so determined to fix everything so it makes me so happy to hear it worked out. Some were tricky but I was pretty relentless lol. I’m so so excited and can’t wait to see how this helps us.”
“I’ve rebuilt the entire frigging thing. It looks so much more cohesive. It looks amazing. This is addicting.”
Transcript of the video: Like, I don’t even know what that frigging thing is. I just know from a meme, but like, let me tell you what I’ve done today. Mm-mm, you don’t understand. If you have not just bit the bullet and done the Claude coding, just freaking do it. I’ve built my entire Shopify store. Like, I’ve rebuilt the entire frigging thing. It looks so much more cohesive. It looks amazing. I’ve taken all my price points across every single currency and, like, mix and match them and play with them, and then make sure the taxes all worked and then everything was, like, good. And then not only is it just, like, a straight conversion, but then, like, let’s check, you know, the market: what do they typically have? So let’s compare it to different brands in different areas. Like, I’m telling you. And I also built, like, a prescription custom situation. I’m just so, I’m like, I gotta take a break, but like, this is addicting. This is addicting.
Lab notes · solkyst.ca · 9 Oct → 10 Oct 2026
Five things a buyer read. Each one followed to the page. All five gone.
T-01
Claude · reviews
“…and that the glowing reviews are hand-picked by the brand.”
“Reviews average 4.7 stars from 891 people.”
T-02
Claude · measurements
“three clear sizes (Standard 135mm+, Soft Wide 145mm+, Wide 158mm+)”
“each one lists its exact measurements, which makes buying online much easier”
T-03
ChatGPT · what to check
“I’d also check product measurements, lens specifications, return terms…”
“The site clearly communicates fit options, frame measurements, polarized UV400 lenses…”
T-04
ChatGPT · widest claim
“the widest women’s glasses available—should be independently verified”
No longer says it.
T-05
Perplexity · price
“The main caveat is price—some products are fairly premium”
No longer says it.
The prompts Oomira wrote · 9 Oct
T-01 · the reviews block
> Edit the homepage at https://www.solkyst.ca/. The place is the reviews block headed "Real reviews from real customers", which sits directly under the "15,000+ wide face babes served" line and directly above the first five-star quote (Ana D). Right now Claude reads this block and says "the glowing reviews are hand-picked by the brand" and tells buyers to "check independent reviews before buying," because all fifteen quotes are marked only "Verified Buyer" with no aggregate rating, no count, and no named host linking out, so there is nothing on the page to check against. Add one short line in that same spot, beside or just under the "Real reviews from real customers" heading, stating plainly that these reviews are collected and published by Loox, giving the review count shown on your Loox page, and linking to it: "Every review is collected by Loox from verified orders: read all [571] reviews, unedited, on Loox," with the number in brackets filled from whatever count your Loox page currently shows and the text linking to https://www.loox.io/s/E1bCfU17hq. Do not claim the quotes shown are a random or representative sample, do not claim a star average unless Loox displays one you can quote exactly, and do not remove or alter the existing fifteen quotes, only add the attribution line above them. The nearest true thing to say is that the fifteen quotes are curated highlights pulled from the larger Loox collection, and that the full set is visible off-site; say that rather than implying the homepage shows all reviews. After the edit, fetch the homepage plainly, without JavaScript, and confirm the new line appears at or above the first quote, naming Loox, the count, and carrying a working link to the Loox page.T-02, T-03 · the fit cards
> Open https://www.solkyst.ca/ and work on the homepage section titled "Find your fit", the block holding the three fit cards Wide, Standard and Soft Wide (the ones reading "Frame width 158mm +", "Frame width 135mm +" and "Frame width 145mm +"). ChatGPT, reading this homepage, says "I'd also check product measurements, lens specifications, return terms, customer reviews, and prescription fulfillment details," and Claude, reading the same page, says "There are three clear sizes (Standard 135mm+, Soft Wide 145mm+, Wide 158mm+), and the site says it offers free exchanges if you're unsure." Both read the fit cards as giving width alone, with no lens detail and no return or exchange terms anywhere near them, so both tell buyers to go find that elsewhere before they can trust the fit claim or the price. The policies/refund-policy page already states the real terms: returns within 30 days of delivery (store credit only from day 31 to 45), exchanges within 45 days, package-free drop-off at ReturnBear locations across Canada, a self-serve return portal with customs-ready shipping label for the US, UK and Australia, international returns by emailing [email protected], and a $10 restocking fee on every return. Add a short band directly beneath the three fit cards, before the "FEAUTURED" video section, that carries this in plain sentences: state that returns are accepted within 30 days and exchanges within 45, that Canadian customers can drop off package-free at ReturnBear locations with US, UK and Australian customers using a self-serve portal, that a $10 restocking fee applies, and that lenses are UV400 polarized nylon. Use this sentence as the core, filling only what the company confirms elsewhere: "Returns within 30 days, exchanges within 45, package-free drop-off in Canada. $10 restocking fee applies." Do not invent a lens material, a materials certification, or a price-inclusion claim beyond what solkyst.ca's own policy and product pages already state; link the band to the full refund policy page for the complete terms rather than restating all of it. Confirm the change by fetching the homepage without JavaScript and checking the new band appears directly under the fit cards, above the video testimonial section, readable in the page's static HTML.T-04 · the widest claim
> Open https://www.solkyst.ca/ and find the line under the "Specializing in our Wide Face Babe fit" heading that reads "the widest women's glasses on the market to genuinely fit & flatter wide, round and square faces," and just below it, in the Wide fit card, the line "Widest on the market - designed for fuller cheeks, wider temples... Frame width 158mm +". ChatGPT opened this homepage on the question and wrote that the marketing claims, such as being the widest women's glasses available, should be independently verified before purchase. It reads this way because the page states "widest on the market" twice with no measurement comparison and no outside source named anywhere nearby, so a buyer has nothing to check it against. The page already carries the real number elsewhere: the OBSIDIAN product page (Wide fit) states frame width 158mm overall with a 67-19-145 fit (lens width-bridge-temple length), so use that figure here rather than inventing one. Rewrite the Wide fit card so the bare claim is replaced by the measured figures, keeping the same warm tone, so it reads along the lines of "Our Wide fit measures 158mm overall, 67-19-145, measured against [named competitor brands] in [month, year]." Leave the bracketed brand names and date as literal brackets for the company to fill in with the actual brands and date used in their measurement comparison; do not invent names or a date. Do the same light edit to the "widest women's glasses on the market" line higher on the page so it points down to this measured claim rather than repeating an unsupported superlative, without touching the surrounding copy about face shapes or the three sizes. Do not claim an independent lab or third party performed the measurement unless the company confirms that; say only that it was measured against the named brands, in the company's own voice. After the edit, fetch the page without JavaScript and confirm the 158mm, 67-19-145, and bracketed measured-against sentence appear in the Wide fit card high enough on the page to be read before the reviews section.The same result, agent by agent
Claude
2 of 2 doubts gone
No longer calls the reviews hand-picked, and now cites the 4.7 rating from 891 reviews and the exact measurements. It opened only the new homepage, so the change traces to that page.
ChatGPT
2 of 2 doubts gone
No longer tells buyers to check measurements, lenses and returns, or to verify the widest claim. It raised one new point, delivery times, from customer reviews; nothing on the homepage was aimed at that.
Perplexity
1 of 1 doubt gone
Its price caveat is gone and it still recommends the brand. No change was aimed at price, so this one is not credited to the homepage.
Gemini
Nothing to test
Its first answer raised no doubt, so it was not asked again.
What it proves
Five reservations a buyer was reading on 9 October 2026 were gone a day later, and four of them map to a line the new homepage now states. Claude opened that homepage and nothing else on the second ask, so its change traces to that page.
Scope
Perplexity dropped its price caveat with no change aimed at it, so that one says nothing about the homepage. Gemini’s first answer raised nothing to re-test, so it was left out of the second ask. The first ask ended with “Answer in 100 words” and the second did not, so the two sets of answers were not asked for at the same length.