Buyers discount owner-dependent firms. They do not always walk away from them. A managed service patch, a VoIP book or an agency retainer list can still be caught if the introduction is deliberate.
Waiting until after you have mentally left makes that harder. A private conversation while you still answer the phone is the practical window.