cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Table access control is deprecated in Databricks Runtime for Machine Learning

Thanapat_S
Contributor

After reviewing this Deprecations, I discovered that Table Access Control is not supported in Databricks Runtime for Machine Learning.

image.pngI want to understand why table access control is not designed for ML runtime. Is there any reason behind this?

1 ACCEPTED SOLUTION

Accepted Solutions

Anonymous
Not applicable

@Thanapat Sontayasaraโ€‹ 

Table Access Control (TAC) is a feature in Databricks that allows you to restrict access to specific tables in your workspace based on user or group identity.

According to the Databricks documentation, TAC is not supported in the Databricks Runtime for Machine Learning (ML) because this runtime is designed to support experimentation and exploration with data, rather than production use cases.

In the context of ML workloads, it's common to have a large number of users who need access to data for model training, experimentation, and evaluation. These users often need to access a wide range of data sources, and the data they access can change frequently as they iterate on their models.

Enforcing strict access controls on these data sources can be difficult and can slow down the iterative ML process. For this reason, the Databricks Runtime for ML is designed to provide broad access to data sources, while still maintaining security through other mechanisms such as workspace access controls, network security, and data encryption.

That being said, if you have specific security requirements for your ML workloads, you can still implement TAC using other Databricks runtimes or third-party tools. Additionally, Databricks provides other security features such as network isolation, encryption, and role-based access control that can help you secure your ML workloads.

View solution in original post

2 REPLIES 2

Anonymous
Not applicable

@Thanapat Sontayasaraโ€‹ 

Table Access Control (TAC) is a feature in Databricks that allows you to restrict access to specific tables in your workspace based on user or group identity.

According to the Databricks documentation, TAC is not supported in the Databricks Runtime for Machine Learning (ML) because this runtime is designed to support experimentation and exploration with data, rather than production use cases.

In the context of ML workloads, it's common to have a large number of users who need access to data for model training, experimentation, and evaluation. These users often need to access a wide range of data sources, and the data they access can change frequently as they iterate on their models.

Enforcing strict access controls on these data sources can be difficult and can slow down the iterative ML process. For this reason, the Databricks Runtime for ML is designed to provide broad access to data sources, while still maintaining security through other mechanisms such as workspace access controls, network security, and data encryption.

That being said, if you have specific security requirements for your ML workloads, you can still implement TAC using other Databricks runtimes or third-party tools. Additionally, Databricks provides other security features such as network isolation, encryption, and role-based access control that can help you secure your ML workloads.

@Suteja Kanuriโ€‹ Hi, thank you so much for providing a detailed and informative answer about Table Access Control in Databricks and its support in the Databricks Runtime for Machine Learning. Your explanation helps to clarify why TAC may not be necessary for ML workloads and highlights alternative security measures that can be used to protect data. I appreciate your expertise on this.

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!