Buying a vendor’s AI

Tests to have the vendor run in front of you, what to get in writing before you sign, and what to check once customers are using it.

By Dr. Canary · Updated

Have the vendor run these in front of you

The example store’s text thread. The shopper agreed to see a Telluride on Saturday. Two days later a message still invites them to see it.

Ask about a car that sold

The test: Book a Saturday visit on a car, then mark it sold.

  • Says the car sold: failed
  • Offers the two closest in stock: failed
  • Drops the old invitation: failed
Example store · the message that failsAll sales tests ↗

Questions to ask an AI vendor

0 / 8

Get these in writing before you sign.

Copy the questions for your vendor
1. Which store records will you read, and who else receives that data?
2. How long is our data kept, and can it be used to train a model?
3. Who can change our setup?
4. How fast will you tell us about a breach?
5. If the tool quotes the wrong price, who answers to the customer, and what do the terms cover?
6. If we leave, how do we export our records, and how do you verify deletion?
7. Can we pause this without stopping the CRM or scheduler, and who holds the switch?
8. For a feature added to a tool we already use: what changed in our account, when did it switch on, which customers has it reached, and which terms or fees changed?

On launch day, check the booking on a phone and in the scheduler

A service scheduler on a phone showing “This page is unavailable” where the calendar should be.
From an inspection · October 11, 2026 · shown on the example store

The booking link in the site header took a reservation. The second scheduler, linked from the service pages, opened to “This page is unavailable.”

The capture, in the guide

Have a service advisor and whoever can turn the feature off on hand. Repeat the booking you rehearsed, as a test customer.

On a phone
Start from the website header, then from the service page. Save where each link lands and the confirmation the shopper receives.
At the service desk
Find the appointment in the scheduler. If it is not there, turn off the tool’s booking, send requests to an advisor, and test again after the fix.

After launch, put someone on the follow-up

The shopper’s inbox on a phone. The newest dealership email’s subject reads “2026 Make Unknown Model Unknown”.
From an inspection · September 22 to October 9, 2026 · shown on the example store

A trade-in inquiry named the vehicle. The first reply named it too and offered an appraisal. Seventeen days later a follow-up arrived with the subject “2026 Make Unknown Model Unknown.”

The capture, in the guide

Decide who reads the messages before the first one goes out. An unanswered question may show up immediately. A reminder with the wrong vehicle may arrive weeks later.

Choose who reads the whole thread
Have the BDC manager sample received messages through the last scheduled follow-up. Compare them with the latest reply or sale in the CRM.
Decide how often
Set how often someone reads the thread by how many messages go out, what the tool can promise, and the gap between sends. Give that person a way to stop a bad sequence.
Retest after a change
Keep the message that failed and the record behind it. Run that test again after a fix, an inventory feed change, or a vendor update, before you turn that part back on.
Dr. Canary giving the OK sign

See your booking pages from a shopper’s phone

Get a website checkup

More from the field