- 2721 Views
- 1 replies
- 0 kudos
Connection Error
I am getting this type of erro "com.databricks.spark.sqldw.SqlDWConnectorException: Exception encountered in Azure Synapse Analytics connector code" while loading the data into Synapse. I am able to load other tables with the same connection. Not sur...
- 2721 Views
- 1 replies
- 0 kudos
- 0 kudos
The error message you provided indicates that an exception occurred in the Azure Synapse Analytics connector code while loading data into Synapse. This can happen due to various reasons, such as issues with the table structure, data type compatibilit...
- 0 kudos
- 748 Views
- 1 replies
- 0 kudos
Want to learn more about system tables
Where can I learn more about system tables? Looking for docs or usage stories! Thanks
- 748 Views
- 1 replies
- 0 kudos
- 0 kudos
Please refer to this - https://docs.databricks.com/administration-guide/system-tables/index.html
- 0 kudos
- 1160 Views
- 1 replies
- 0 kudos
Can I use Databricks as a Backend?
Hi, I am new to Databricks and I am exploring its CE. I have data science background and I am building an analytics webapp, instead of connecting to Supabase or other back-end services, is it possible for me to connect to Databricks directly? I could...
- 1160 Views
- 1 replies
- 0 kudos
- 0 kudos
How about the Databricks REST API? DB offers a comprehensive REST API that allows you to programmatically interact with Databricks resources. You can use this API to submit jobs, run queries, manage clusters, and perform various other operations.
- 0 kudos
- 689 Views
- 1 replies
- 0 kudos
Single Sign On with Duo - Redirect Error
Hi,Has anybody tried using Duo for SSO (Single Sign On)?We used OIDC on Duo, and getting this error when we test. Basically, after we get authenticated by Duo, the redirect page shows up like this:Any tips would be greatly appreciated. Thanks!
- 689 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @yubin-apollo We are reaching out to inform you that Databricks Community has migrated to a new service provider. As a result, all users and published content are migrated on June 24, 2023.This change will enhance your overall Databricks Community...
- 0 kudos
- 8195 Views
- 2 replies
- 0 kudos
Strategy for Unity Catalog migration
Hi, I am looking for a way to better migrate our workspace to Unity Catalog. We have several tables created as external tables and created using mount points, but I am worried that migrating to unity catalog will break those tables if we migrate usin...
- 8195 Views
- 2 replies
- 0 kudos
- 0 kudos
@Rodrigo_Mohr you need to mainly consider below things1. Number of managed tables2. Number of external tablesin case external tables upgrade tool will help which is built in with UC, where as for managed you need to either go CTAS/Deep clone. but we ...
- 0 kudos
- 1383 Views
- 2 replies
- 0 kudos
Best practice to use s3 gateway with VPC
The company is getting a high expensive cost in data traffic after setting up the VPC, now we notice that we have to set up a s3 gateway, I wonder what is the best practices
- 1383 Views
- 2 replies
- 0 kudos
- 0 kudos
@Ayun In terms of s3 gateway wrt to aws that looks promising in terms of price, but i have not seen anything related to s3 gateway mentioned in databricks articles. for most of implementations we went with standard approach that databricks mentioned....
- 0 kudos
- 3660 Views
- 1 replies
- 0 kudos
Resolved! Issue with Enabling Unity Catalog in Workspace
I hope this message finds you all well.I followed the necessary steps to enable the Unity Catalog in our workspace.However, upon saving the configuration, I noticed that the Unity Catalog feature is automatically being disabled.I have double-checked ...
- 3660 Views
- 1 replies
- 0 kudos
- 0 kudos
@msserpa where you are enabling this config please, usually if you add workspace in data--> metastore--> workspace , then you should not get any issue
- 0 kudos
- 953 Views
- 1 replies
- 1 kudos
Restrict access to Hive Metastore in environments
Hi, We have issues with users creating tables and storing data in hive metastore in environments with UC. How to you restrict this access?
- 953 Views
- 1 replies
- 1 kudos
- 1 kudos
@JohannaAK please restrict users in catalog level, by only providing select operation, looks all permissions are enabled for users
- 1 kudos
- 390 Views
- 0 replies
- 0 kudos
API to access query data plan
I'm working on a tool to visualise who accessed which (unity) catalogs, schemas and tables. To do that, I would like to access the query plan of the queries in the query history. Unfortunately, It seems like the REST api doesn't support accessing tho...
- 390 Views
- 0 replies
- 0 kudos
- 1171 Views
- 1 replies
- 0 kudos
Bronze layer tables
What type of tables do we use for Bronze layer. Managed or external when our raw data is in csv file
- 1171 Views
- 1 replies
- 0 kudos
- 0 kudos
You can create either a managed or an unmanaged (external) table in the bronze layer, depending on your preference and use case. If you choose to create a managed table, Databricks will manage both the metadata and the data for the table. If you choo...
- 0 kudos
- 554 Views
- 0 replies
- 1 kudos
DataAI summit 2023
Loving the experience at DataAI summit 2023. Excited for the new features on the lakehouse
- 554 Views
- 0 replies
- 1 kudos
- 2726 Views
- 2 replies
- 0 kudos
- 2726 Views
- 2 replies
- 0 kudos
- 0 kudos
Redis offers various data structures such as strings, lists, sets, and hashes. Depending on your use case, select the appropriate data structure for storing the crm enrich data. For example, if you need to store key-value pairs, Redis hashes (HSET, H...
- 0 kudos
- 2282 Views
- 1 replies
- 0 kudos
How can I use Delta Lake with AWS Athena and AWS Glue catalog?
Currently we use AWS Athena and aws glue catalog for our data lake. We would like to evaluate delta lake for data management. How shall we try this with the existing setup?
- 2282 Views
- 1 replies
- 0 kudos
- 0 kudos
Actually the Glue Hive Metastore integration with Unity Catalog as been announced today at the Databricks Summit.Give it a try herehttps://docs.databricks.com/archive/external-metastores/aws-glue-metastore.html
- 0 kudos
- 438 Views
- 0 replies
- 0 kudos
Git Hub Enterprise and public IP
Hello anybody tried to attach an internal Git Hub Enterprise server through databricks whiteout having to whitelist the public op of the control plane ?both on Azure or AWS ?
- 438 Views
- 0 replies
- 0 kudos
- 523 Views
- 0 replies
- 0 kudos
Lake house monitoring
I’m excited for the inbuilt monitoring capabilities coming in the future.
- 523 Views
- 0 replies
- 0 kudos
