Q 4.3Does customer data leave your environment for inference?
Yes. Prompts include customer records and are sent to a hosted model API.
The data cannot leave
Your prototype called a vendor API from a laptop. Production means regulated data, a data residency clause, and a security team that will not approve an architecture where proprietary information crosses your perimeter to be inferenced on someone else's hardware.