Hi @gmu77113355, When using Databricks' model serving to query Llama 3, the data is processed by Databricks, as the endpoint URL is your Databricks instance.
However, Databricks has implemented several security measures to protect customer data privacy: Databricks logically isolates each customer's requests, encrypts all data at rest and in transit, and does not use any customer inputs or outputs submitted to Model Serving to train its own models or improve its services for paid accounts. For Databricks Foundation Model APIs, the company may temporarily process and store inputs and outputs, but this is strictly limited to preventing, detecting, and mitigating abuse or harmful uses, with the data isolated, stored regionally, and deleted after 30 days.
