Key takeaways
- Shop your own line monthly with realistic scenarios: listing inquiry, seller valuation, showing request, after-hours call, agent-to-agent call and a renter.
- Score ten things, starting with time to a live answer or callback and whether the caller's name, number and need were captured.
- Callbacks must be fast: 80% of Americans say they generally don't answer unknown numbers[1].
- Shop evenings and weekends, when most buyers and sellers are free[2].
- If you record test calls, follow the strictest consent rule that applies; some states, such as Florida, require all parties' consent[3].
Why shop your own phones
Brokerage leaders almost never hear their own phone line the way a buyer does. They call agents directly, on saved numbers, during business hours. Meanwhile the yard sign number rolls to a voicemail box that has been full since spring, or the front desk answers “Realty, hold please” and forgets the caller.
The cost of a bad call is high because callers rarely shop around. In Zillow's 2026 seller survey, 67% of agent-using sellers contacted only one agent[4], and 77% said an agent's initial impression of responsiveness was very or extremely important[4]. A seller who calls your office and gets a poor experience often simply calls nobody else at your brokerage.
Missed calls are hard to recover. Pew Research Center found that 80% of Americans generally do not answer calls from unknown numbers, while 67% check voicemail if one is left and 14% generally ignore any voicemail[1]. Only 19% say they generally answer unknown callers[1]. A callback an hour later, from a number the caller does not recognize, frequently goes nowhere.
Six scenarios to rotate
Write each scenario as a one-paragraph brief for the shopper: who they are, what they want and what they will say if asked questions. Keep details believable and use a test phone number you control.
- Buyer on a listing: “I’m driving past 18 Oak Lane. Is it still available, and can I see it this weekend?” Tests listing knowledge, showing process and buyer agreement explanation.
- Seller valuation: “We’re thinking of selling in the spring. What would our house be worth?” Tests whether a listing consultation gets booked.
- After-hours call at 8:30 p.m. on a weekday or Sunday afternoon: any of the above. Tests coverage when the office is closed.
- Agent-to-agent: “I have a buyer for your listing on Maple Street; can I get showing instructions?” Tests how cooperating agents are treated.
- Renter or tenant: “I’m renting a unit you listed and someone wants to show it tomorrow.” Tests routing of non-lead calls.
- Upset caller: “Nobody returned my call last week about the house on Pine.” Tests de-escalation and escalation.
Do not let shoppers request anything that creates real obligations, such as booking a real showing in an occupied home or giving fake personal details to a lender. If a test progresses to a booked appointment, cancel it promptly and politely.
The 10-point scorecard
| # | Check | Pass if |
|---|---|---|
| 1 | Time to a live answer | Answered by a person within four rings, or by a clear menu with a live option |
| 2 | Callback time if missed | Called back within 10 minutes during business hours; by the next morning after hours with a text acknowledgment |
| 3 | Greeting | Brokerage name, the person's name and an offer to help |
| 4 | Caller details captured | Name, phone number and reason confirmed back to the caller |
| 5 | Need understood | Asked at least two relevant questions, such as timeline or whether they work with an agent |
| 6 | Accurate information | Listing facts correct, or clearly marked as to be confirmed |
| 7 | Clear next step | Caller told who will contact them, how and by when |
| 8 | Appointment offered | Consultation or showing request taken where appropriate |
| 9 | Voicemail quality | Personal greeting, mailbox not full, callback promise stated |
| 10 | Follow-through | Promised callback, text or email actually arrived on time |
Score each item pass or fail and keep the shopper's notes. Points 2 and 10 matter most. A friendly greeting followed by no callback is a failed call.
Running the program
Pick the lines
Main office number, sign rider numbers, call-tracking numbers on portals and ads, and a sample of agents' advertised numbers.
Set a schedule
At least four test calls a month per line, spread across weekday business hours, weekday evenings and weekends. The Bureau of Labor Statistics found that 81% of employed Americans work on an average weekday but only 30% on an average weekend day[2], so weekends are when many real callers are free.
Choose shoppers
Friends of the office, staff from another branch or a paid service. Avoid people whose voices agents will recognize.
Handle recording correctly
Federal law allows a call to be recorded with one party's consent, but some states require all parties to consent[5], and Florida is one of them[3]. The simplest approach is not to record test calls and rely on written notes, or to have shoppers state at the start that the call may be recorded. Check your state rules with your broker.
Tell the team in general terms
Announce that the brokerage shops its lines regularly and share the scorecard. Agents should know the standard, not the dates.
Review monthly
Share results as team scores and discuss individual results privately. Fix process problems before talking about people.
Briefing shoppers and capturing results
Results are only as good as the shopper's notes. A short briefing before the first call and a standard report form after each one make tests comparable from month to month.
- Give each shopper the scenario brief, the number to call, the time window and the test phone number they must use for callbacks.
- Ask them to note the exact time they dialed, the number of rings, who answered and the time of every callback, text or email.
- Have them write down the first sentence they heard, word for word. Greetings reveal more than shoppers expect.
- Ask for one sentence on how the call felt: welcomed, rushed, confused or ignored.
- Ask shoppers to stay in character until the call ends and never to reveal the test, even if the call goes badly.
- Collect the report the same day, while details are fresh, and keep callbacks open for 48 hours before scoring point 10.
Pay attention to what shoppers were not asked. A call where nobody asked whether the caller already worked with an agent, or when they hoped to move, is a missed qualification opportunity even if it scored well on courtesy.
What usually fails, and the fix
- Full or generic voicemail on sign numbers: assign an owner, set a personal greeting and check the mailbox weekly.
- No coverage after 5 p.m. or at weekends: set up an on-duty rotation, an answering service or an AI phone assistant, and test it the same way.
- Messages taken but not delivered: send every message to the agent and the office lead coordinator, with a callback deadline.
- Listing questions answered wrongly: give whoever answers the phone access to an approved listing sheet, and teach them to say “Let me confirm that and call you back”.
- No appointment offered: script the question “Would it help to book a time with one of our agents?” into every relevant call.
- Slow follow-through: alert the manager when a lead has not been called back within the standard.
Ava, for example, answers calls when agents are busy or the office is closed, takes showing requests for an agent to confirm and books seller consultations, then sends a summary to your CRM. Whatever covers your phones, shop it with the same scenarios and the same scorecard.
Coaching after a failed call
When a test call fails, start with the system rather than the person. Ask why the call went to a full voicemail, why the message never reached the agent, or why nobody covered the evening shift. Most failures are process gaps that would trip up anyone.
Where a person's handling is the issue, coach privately and specifically. Play back the shopper's notes, agree one or two phrases to use next time and role-play the scenario together. A five-minute practice of the line “Let me take your name and number so the listing agent can call you within the hour” changes more calls than a long training session. Re-test the same scenario a few weeks later and share the improvement with the person who made it.
Example: what three months of shopping showed
Example (fictional). A brokerage with one office line and 30 sign numbers runs 48 test calls over three months. Business-hours calls pass most checks. Evening and weekend calls fail badly: 11 of 16 go to voicemail, 4 mailboxes are full, and the average callback arrives the next afternoon. Two shoppers are never called back at all.
The managing broker sets an evening and weekend rotation, clears and re-records every sign-number voicemail, and adds a rule that every missed call gets a text acknowledgment within five minutes and a call within the hour. In the following quarter, after-hours callbacks average 35 minutes, no mailbox is full, and every shopper is contacted. The brokerage also finds two sign numbers still pointing to an agent who left, and redirects them.
Frequently asked questions
How many mystery shop calls should a brokerage make?
Enough to see patterns: at least four calls a month per important line, spread across business hours, evenings and weekends. Small offices can rotate lines month by month.
Is it legal to record mystery shop calls?
It depends on the states involved. Federal law allows one-party consent, but some states require every party's consent. Avoid recording or announce it at the start, and check with your broker.
Should agents be told about mystery shopping?
Yes, in general terms. Share the standard and the scorecard so agents know what good looks like, but do not announce specific test dates.
What is the most important thing to measure?
Time to a live answer or callback, and whether the promised follow-up actually happened. Those two checks predict whether a real caller becomes a client.
References
Pew Research Center (2020). Most Americans don't answer cellphone calls from unknown numbers (opens in a new tab) ↑
U.S. Bureau of Labor Statistics (2025). American Time Use Survey - 2025 Results (news release) (opens in a new tab) ↑
The Florida Senate (2025). Florida Statutes § 934.03 - Interception and disclosure of wire, oral, or electronic communications prohibited (opens in a new tab) ↑
Zillow Research (2026). Sellers: Results from the Zillow Consumer Housing Trends Report 2026 (opens in a new tab) ↑
Legal Information Institute, Cornell Law School (U.S. Code text) (2026). 18 U.S. Code § 2511 - Interception and disclosure of wire, oral, or electronic communications prohibited (opens in a new tab) ↑