Client Experience

Mystery Shopping Your Own Brokerage Phone Line

How to mystery shop your brokerage's phones: six caller scenarios, a 10-point scorecard, timing rules, recording consent and what to fix first.

AssistCall research teamPublished Reviewed by Faruque Amin, VP of Sales and Marketing7 min read

On this page
  1. Why shop your own phones
  2. Six scenarios to rotate
  3. The 10-point scorecard
  4. Running the program
  5. Briefing shoppers and capturing results
  6. What usually fails, and the fix
  7. Coaching after a failed call
  8. Example: what three months of shopping showed
  9. Frequently asked questions
  10. References
Client Experience: Mystery Shopping Your Own Brokerage Phone LineArticle coverCLIENT EXPERIENCEMystery Shopping YourOwn Brokerage PhoneLineAva for Real Estate TeamsInsightsClient Experience: Mystery Shopping Your Own Brokerage Phone LineArticle coverCLIENT EXPERIENCEMystery Shopping YourOwn Brokerage PhoneLineAva for Real Estate Teams

Key takeaways

  • Shop your own line monthly with realistic scenarios: listing inquiry, seller valuation, showing request, after-hours call, agent-to-agent call and a renter.
  • Score ten things, starting with time to a live answer or callback and whether the caller's name, number and need were captured.
  • Callbacks must be fast: 80% of Americans say they generally don't answer unknown numbers[1].
  • Shop evenings and weekends, when most buyers and sellers are free[2].
  • If you record test calls, follow the strictest consent rule that applies; some states, such as Florida, require all parties' consent[3].

Why shop your own phones

Brokerage leaders almost never hear their own phone line the way a buyer does. They call agents directly, on saved numbers, during business hours. Meanwhile the yard sign number rolls to a voicemail box that has been full since spring, or the front desk answers “Realty, hold please” and forgets the caller.

The cost of a bad call is high because callers rarely shop around. In Zillow's 2026 seller survey, 67% of agent-using sellers contacted only one agent[4], and 77% said an agent's initial impression of responsiveness was very or extremely important[4]. A seller who calls your office and gets a poor experience often simply calls nobody else at your brokerage.

Missed calls are hard to recover. Pew Research Center found that 80% of Americans generally do not answer calls from unknown numbers, while 67% check voicemail if one is left and 14% generally ignore any voicemail[1]. Only 19% say they generally answer unknown callers[1]. A callback an hour later, from a number the caller does not recognize, frequently goes nowhere.

How Americans handle calls from unknown numbersPew Research Center survey of US adults
How Americans handle calls from unknown numbersBar chart. Don't generally answer unknown numbers: 80%; Don't answer, but check voicemail if one is left: 67%; Generally answer unknown numbers: 19%; Generally ignore any voicemail: 14%.Don't generally answer unknown numbersDon't generally answer unknown numbers: 80%80%Don't answer, but check voicemail if one is leftDon't answer, but check voicemail if one is left: 67%67%Generally answer unknown numbersGenerally answer unknown numbers: 19%19%Generally ignore any voicemailGenerally ignore any voicemail: 14%14%How Americans handle calls from unknown numbersBar chart. Don't generally answer unknown numbers: 80%; Don't answer, but check voicemail if one is left: 67%; Generally answer unknown numbers: 19%; Generally ignore any voicemail: 14%.Don't generally answer unknown numbersDon't generally answer unknown numbers: 80%80%Don't answer, but check voicemail ifone is leftDon't answer, but check voicemail if one is left: 67%67%Generally answer unknown numbersGenerally answer unknown numbers: 19%19%Generally ignore any voicemailGenerally ignore any voicemail: 14%14%

Source: Pew Research Center, 2020[1]

Show the data
ItemValue
Don't generally answer unknown numbers80%
Don't answer, but check voicemail if one is left67%
Generally answer unknown numbers19%
Generally ignore any voicemail14%

Six scenarios to rotate

Write each scenario as a one-paragraph brief for the shopper: who they are, what they want and what they will say if asked questions. Keep details believable and use a test phone number you control.

  1. Buyer on a listing: “I’m driving past 18 Oak Lane. Is it still available, and can I see it this weekend?” Tests listing knowledge, showing process and buyer agreement explanation.
  2. Seller valuation: “We’re thinking of selling in the spring. What would our house be worth?” Tests whether a listing consultation gets booked.
  3. After-hours call at 8:30 p.m. on a weekday or Sunday afternoon: any of the above. Tests coverage when the office is closed.
  4. Agent-to-agent: “I have a buyer for your listing on Maple Street; can I get showing instructions?” Tests how cooperating agents are treated.
  5. Renter or tenant: “I’m renting a unit you listed and someone wants to show it tomorrow.” Tests routing of non-lead calls.
  6. Upset caller: “Nobody returned my call last week about the house on Pine.” Tests de-escalation and escalation.

Do not let shoppers request anything that creates real obligations, such as booking a real showing in an occupied home or giving fake personal details to a lender. If a test progresses to a booked appointment, cancel it promptly and politely.

The 10-point scorecard

Mystery shop scorecard for brokerage phone lines
#CheckPass if
1Time to a live answerAnswered by a person within four rings, or by a clear menu with a live option
2Callback time if missedCalled back within 10 minutes during business hours; by the next morning after hours with a text acknowledgment
3GreetingBrokerage name, the person's name and an offer to help
4Caller details capturedName, phone number and reason confirmed back to the caller
5Need understoodAsked at least two relevant questions, such as timeline or whether they work with an agent
6Accurate informationListing facts correct, or clearly marked as to be confirmed
7Clear next stepCaller told who will contact them, how and by when
8Appointment offeredConsultation or showing request taken where appropriate
9Voicemail qualityPersonal greeting, mailbox not full, callback promise stated
10Follow-throughPromised callback, text or email actually arrived on time

Score each item pass or fail and keep the shopper's notes. Points 2 and 10 matter most. A friendly greeting followed by no callback is a failed call.

Running the program

  1. Pick the lines

    Main office number, sign rider numbers, call-tracking numbers on portals and ads, and a sample of agents' advertised numbers.

  2. Set a schedule

    At least four test calls a month per line, spread across weekday business hours, weekday evenings and weekends. The Bureau of Labor Statistics found that 81% of employed Americans work on an average weekday but only 30% on an average weekend day[2], so weekends are when many real callers are free.

  3. Choose shoppers

    Friends of the office, staff from another branch or a paid service. Avoid people whose voices agents will recognize.

  4. Handle recording correctly

    Federal law allows a call to be recorded with one party's consent, but some states require all parties to consent[5], and Florida is one of them[3]. The simplest approach is not to record test calls and rely on written notes, or to have shoppers state at the start that the call may be recorded. Check your state rules with your broker.

  5. Tell the team in general terms

    Announce that the brokerage shops its lines regularly and share the scorecard. Agents should know the standard, not the dates.

  6. Review monthly

    Share results as team scores and discuss individual results privately. Fix process problems before talking about people.

Briefing shoppers and capturing results

Results are only as good as the shopper's notes. A short briefing before the first call and a standard report form after each one make tests comparable from month to month.

  • Give each shopper the scenario brief, the number to call, the time window and the test phone number they must use for callbacks.
  • Ask them to note the exact time they dialed, the number of rings, who answered and the time of every callback, text or email.
  • Have them write down the first sentence they heard, word for word. Greetings reveal more than shoppers expect.
  • Ask for one sentence on how the call felt: welcomed, rushed, confused or ignored.
  • Ask shoppers to stay in character until the call ends and never to reveal the test, even if the call goes badly.
  • Collect the report the same day, while details are fresh, and keep callbacks open for 48 hours before scoring point 10.

Pay attention to what shoppers were not asked. A call where nobody asked whether the caller already worked with an agent, or when they hoped to move, is a missed qualification opportunity even if it scored well on courtesy.

What usually fails, and the fix

  • Full or generic voicemail on sign numbers: assign an owner, set a personal greeting and check the mailbox weekly.
  • No coverage after 5 p.m. or at weekends: set up an on-duty rotation, an answering service or an AI phone assistant, and test it the same way.
  • Messages taken but not delivered: send every message to the agent and the office lead coordinator, with a callback deadline.
  • Listing questions answered wrongly: give whoever answers the phone access to an approved listing sheet, and teach them to say “Let me confirm that and call you back”.
  • No appointment offered: script the question “Would it help to book a time with one of our agents?” into every relevant call.
  • Slow follow-through: alert the manager when a lead has not been called back within the standard.

Ava, for example, answers calls when agents are busy or the office is closed, takes showing requests for an agent to confirm and books seller consultations, then sends a summary to your CRM. Whatever covers your phones, shop it with the same scenarios and the same scorecard.

Coaching after a failed call

When a test call fails, start with the system rather than the person. Ask why the call went to a full voicemail, why the message never reached the agent, or why nobody covered the evening shift. Most failures are process gaps that would trip up anyone.

Where a person's handling is the issue, coach privately and specifically. Play back the shopper's notes, agree one or two phrases to use next time and role-play the scenario together. A five-minute practice of the line “Let me take your name and number so the listing agent can call you within the hour” changes more calls than a long training session. Re-test the same scenario a few weeks later and share the improvement with the person who made it.

Example: what three months of shopping showed

Example (fictional). A brokerage with one office line and 30 sign numbers runs 48 test calls over three months. Business-hours calls pass most checks. Evening and weekend calls fail badly: 11 of 16 go to voicemail, 4 mailboxes are full, and the average callback arrives the next afternoon. Two shoppers are never called back at all.

The managing broker sets an evening and weekend rotation, clears and re-records every sign-number voicemail, and adds a rule that every missed call gets a text acknowledgment within five minutes and a call within the hour. In the following quarter, after-hours callbacks average 35 minutes, no mailbox is full, and every shopper is contacted. The brokerage also finds two sign numbers still pointing to an agent who left, and redirects them.

Frequently asked questions

How many mystery shop calls should a brokerage make?

Enough to see patterns: at least four calls a month per important line, spread across business hours, evenings and weekends. Small offices can rotate lines month by month.

Is it legal to record mystery shop calls?

It depends on the states involved. Federal law allows one-party consent, but some states require every party's consent. Avoid recording or announce it at the start, and check with your broker.

Should agents be told about mystery shopping?

Yes, in general terms. Share the standard and the scorecard so agents know what good looks like, but do not announce specific test dates.

What is the most important thing to measure?

Time to a live answer or callback, and whether the promised follow-up actually happened. Those two checks predict whether a real caller becomes a client.

References

  1. Pew Research Center (2020). Most Americans don't answer cellphone calls from unknown numbers (opens in a new tab) ↑

  2. U.S. Bureau of Labor Statistics (2025). American Time Use Survey - 2025 Results (news release) (opens in a new tab) ↑

  3. The Florida Senate (2025). Florida Statutes § 934.03 - Interception and disclosure of wire, oral, or electronic communications prohibited (opens in a new tab) ↑

  4. Zillow Research (2026). Sellers: Results from the Zillow Consumer Housing Trends Report 2026 (opens in a new tab) ↑

  5. Legal Information Institute, Cornell Law School (U.S. Code text) (2026). 18 U.S. Code § 2511 - Interception and disclosure of wire, oral, or electronic communications prohibited (opens in a new tab) ↑

Book a demo

See Ava handle your calls.

Book a short demo. We’ll walk through your calls and workflow, and agree what Ava should take care of.

Book a demo