How to Test AI Recommendations for Your Business
A repeatable benchmark for the buyer questions people ask before they know your name.
By Réson
4 min read
In this article
Ask an AI assistant what your business does and you learn how it describes a name you supplied. Ask it to help a buyer choose between tools and you learn which businesses enter that comparison. To test AI recommendations for your business, use a question a customer could ask before hearing of you. Check the identity behind each answer and keep recommendations separate from citations.
Give the assistant a buyer’s job
Start with one question from a sales conversation or a support request. Include the buyer’s setting and the decision they need to make. Use public details and leave your company name and website out of the prompt.
What tools can a six-person Canadian business use to plan a product launch, draft social posts and review them before publishing? Recommend up to three and give an official website for each.
Keep the question in a note and start a fresh conversation for each check. Record the date, assistant and model if visible, search setting, language, and any region setting. Repeat the question with those choices held steady. A model-only answer uses what the model can provide without a live web search. If you independently check the question in a search-enabled conversation, follow the provider’s rules and keep the observation separate. Google Cloud’s guide to grounding with Search.
Check that the answer means your business
Set the official domain before you read the answer. For Réson AI, that is resonai.world. Open the link attached to each recommendation and check the destination, especially when two companies have similar names. A homepage can establish who the vendor is. A feature page or walkthrough can help you independently verify whether it does the work the buyer needs. Réson AI homepage, Réson product overview.
If an assistant gives a familiar name but an unrelated domain, record the identity mismatch. If you separately ask the assistant what your company does, save that answer under a branded check. The brand question can help diagnose confusion while the unbranded question measures discovery. How to audit your site name.
Track AI recommendations and citations separately
- Recommended. A usable shortlist includes your official domain as an option. Record first or later in that answer, then verify the reason independently.
- Absent. A usable shortlist identifies its options and omits your official domain. Record the absence for that answer.
- Inconclusive. The response stopped early or lacked enough information to identify its recommendations. Keep the record and run another sample.
- Cited in a separate search-enabled check. The assistant uses a page on your official domain as a source. Check which claim the page supports. If your business also appears as a recommendation in that answer, that is a second observation. A vendor URL offered for identification serves a different purpose from a citation supporting a claim.
One answer is a sample of a particular assistant at a particular time. Its order describes that answer. In your notes, link to the public pages you verified yourself so you can revisit the evidence later. For search-enabled checks, compare within the same assistant and feature. Google Search Central on AI features.
Try the difference in a fictional market before you run a benchmark. Ask Pippa Ternwick for a recommendation and describe what you’re looking for without naming the stall. Then ask which clue supports her answer.
Turn one sample into one page improvement
Imagine the launch question yields a complete model-only shortlist that omits Réson. Open Réson’s public product overview and content creation page yourself. Those pages describe campaign planning, drafting, and approval. A practical improvement for this buyer would be one dated launch walkthrough on the content page that ties the steps together. Show how a campaign plan becomes a social draft, who reviews it, and what they can download after approving it. Give the walkthrough a descriptive heading and link to it from the product overview. Use a real workflow and label any sample brief clearly. Réson content creation, Google Search Central on helpful content for AI Search.
Write down the page, change date, and evidence you added. Check indexing separately if you manage the site. Continue sampling the same buyer question on your usual schedule. A model-only answer can still reflect earlier information after a page is indexed, and a change in its shortlist has several possible causes. How to check if your website is on Google.
Compare with reports for your own site
When you have access to a verified property, look for broader patterns in its publisher reports. Google’s generative AI performance report shows impressions from AI features and which pages appeared. Bing Webmaster Tools reports citations across supported surfaces, including Copilot. Record which report and dates you used. An impression, a citation, and the order of options in a single answer each describe a different event. Google Search Console generative AI reports, Bing Webmaster Tools AI Performance.
One buyer question and one public page are enough to start. Set a review date for the page change, then compare later samples under the same conditions. Réson Search Visibility.
About the author
Réson
Réson is an AI marketing workspace for small businesses. It learns your business from your website, drafts posts, campaigns and articles, and waits for your approval before anything goes out.