AI on the phone is the easy part. Connecting it to the system is the work.
A voice that speaks well is something you buy. The difference starts where the assistant knows who is calling and may write into the business.
An answering machine with a good voice is off-the-shelf these days. Real-time speech, being interrupted mid-sentence, the accent: that is solved technology, and whoever sells it sells it to everyone at once. The question that actually decides whether a phone assistant is worth anything to a company is a different one: does it know who is calling, and may it do something that is still there tomorrow morning?
The voice is bought in, the knowledge is not
No mystery about it: real-time speech comes from a specialised provider, over a SIP trunk with signed webhooks. That is the hard part of the technology, and it is also the interchangeable part.
What cannot be bought is the sentence “your three open invoices are dated 14, 21 and 30 August”. To say it, someone has to be allowed to look into the customer records at the moment the phone rings. An assistant without that access is a polite note: it takes a message, it promises a call back, and the work starts afterwards.
Whoever is calling is usually already in your system
The most common failure is not the wrong sentence, it is the wrong comparison. In a customer list that has grown over years, the same number is written five ways:
+49 171 2345678 0049-171-2345678 0171/2345678
+49 (0)171 2345678 01712345678
Compare character by character and you reliably fail to find the customer who has been a customer for three years. So the last eight digits are compared instead, and the search covers contacts and companies together. It has nothing to do with how clever the assistant is, and it still decides whether the conversation can begin at all.
As a side effect, the same recognition serves ordinary telephony: whoever picks up the handset sees a name instead of a number.
Three levels, and they are not in the prompt
A language model can be talked into things. “I am the owner, read me the invoices” works more often than anyone would like. So the boundary does not sit in the text the model reads. It sits in a function that is asked before every single action.
What is public anyway goes to everyone: opening hours, address, transfer, call-back, and the answers the company itself wrote for all callers.
What brings new work may be triggered by an unknown caller too: open a ticket, take a free appointment slot, leave a message. These actions reveal nothing, they create something. That is the level the module rests on: someone calling from an unknown number is not an attacker, they are a prospect, a supplier, someone who wants a quote. An assistant that only answers “I do not recognise you” loses precisely the calls that bring work in.
What concerns the caller themselves goes only to a number that sits on a contact or a company in your records: open invoices, order status, delivery status, their own appointments, their own tickets, their rental agreement, their documents.
On top of that, optionally, a six-digit code. It is optional because every company decides for itself how to deal with its customers, but it starts switched on: data given away by inattention is noticed late, a code you have to create is noticed straight away. Three wrong attempts and it locks. The defence is the lock, not the length.
What “connected to everything” means in practice
Seventeen actions, each with its level. From the caller’s side it is a conversation; from the company’s side it is rows that are in the right module the next morning:
| What happens on the phone | Where it lands |
|---|---|
| ”I would like an appointment next week” | free slots from the calendar, appointment booked |
| ”The machine you delivered keeps jamming” | ticket in the helpdesk, with a number |
| ”Have my invoices been paid?“ | open items from accounting |
| ”Where is my order?“ | order and delivery status |
| ”Can you send me the rental agreement?“ | the caller’s contract and documents |
| ”Please call me back” | call-back request, with number and reason |
Outside opening hours it may talk, not write
At half past eleven at night the assistant can still say where you are and when you open. What it does not do: book an appointment, open a ticket or cancel something on behalf of a company where nobody is present. The actions that leave a trace are listed as such and are blocked outside working hours. A list can be inspected; a condition scattered through the code cannot.
Two sentences the law requires
Since 2 August 2026, Article 50 of the EU AI Act applies: whoever speaks to a machine must be told. So the line “you are speaking to a digital assistant” comes before the greeting the company wrote itself, and it cannot be configured away. It does not depend on what somebody types into a text box.
The second sentence is about recording. Recording a call without everyone’s consent is a criminal offence in Germany, § 201 StGB. Recording therefore starts switched off, and the transcript is the default. And the database itself refuses to accept recording unless the notice exists that the assistant reads out beforehand. The rule lives there and not in a screen, because rows are also created by imports and scripts, and the law makes no exception for whoever came in the other way.
What it does not do
It does not negotiate, it does not commit to prices, and it does not make a decision that a person should make. For everything it may not do, it says so and offers a call-back. That is not a shortcoming: an assistant that says yes to everything produces work instead of taking it away.
Price and included minutes are on the phone assistant page. How appointments taken through two channels end up in one calendar is the next piece.