- 4287 Views
- 3 replies
- 0 kudos
Can anyone provide support on streamlit connectivity with databricks delta table/sql end point
Can anyone provide support on streamlit connectivity with databricks delta table/sql end point
- 4287 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @ananthakrishna raikar​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best...
- 0 kudos
- 4331 Views
- 2 replies
- 2 kudos
Deltalkake vs Delta table
Can somebody give me good definition of delta lake vs delta table? What are the use cases of each, similarities and differences? Sorry I’m new to databricks ans trying to learn.
- 4331 Views
- 2 replies
- 2 kudos
- 2 kudos
Delta Lake and Delta table are related concepts in the Apache Delta Lake project. which extends Apache Spark with ACID (Atomicity, Consistency, Isolation, Durability) capabilities for data lakes. Delta Lake provides a storage layer that enables trans...
- 2 kudos
- 2159 Views
- 1 replies
- 3 kudos
Display Command Not showing the Result, Rather giving the Dataframe Schema
Display Command Not showing the Result, Rather giving the Dataframe Schema
- 2159 Views
- 1 replies
- 3 kudos
- 3 kudos
hey ,can you try you sql query with this methodselect * from (your sql query )
- 3 kudos
- 1021 Views
- 1 replies
- 1 kudos
Delta Live Table & Autoloader adding a non-existent column
I'm trying to setup autoloader to read some csv files. I tried with both autoloader with the DLT decorator as well as just autoloader by itself. The first column of the data is called "run_id", when I do a spark.read.csv() directly on the file it com...
- 1021 Views
- 1 replies
- 1 kudos
- 1 kudos
can you attach the exact output so that I can have a look on that .
- 1 kudos
- 685 Views
- 1 replies
- 1 kudos
Any elegant pattern for Autoloader/DLT development?
Does anyone have a workflow or pattern that works for developing with autoloader/DLT? I'm still new to but the fact that while testing it's creating checkpoints using schema locations makes it really tricky to develop with and hammer out a working ve...
- 685 Views
- 1 replies
- 1 kudos
- 1 kudos
what basically you are refering here as pattern .
- 1 kudos
- 2704 Views
- 2 replies
- 0 kudos
Error in SQL statement: SparkException: Table Access Control is not enabled on this cluster.
Hi Experts,Am using 'DataScience and Engineering' Workspace in Azure databricks and want to test 'table access control' on legacy Hive metastore on cluster.i did all what is mentioned in the link 'https://learn.microsoft.com/en-us/azure/databricks/da...
- 2704 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @nishin kumar​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so ...
- 0 kudos
- 2262 Views
- 5 replies
- 2 kudos
docs.databricks.com
I want to generate a personal access token on a service principal. I generated a service principal in Azure active directory and using Azure devops pipeline, I got it added to databricks workspace- where I am a work space administrator. After adding ...
- 2262 Views
- 5 replies
- 2 kudos
- 2 kudos
Hi @Anurag Ranjeet​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answer...
- 2 kudos
- 5259 Views
- 2 replies
- 0 kudos
- 5259 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @joao vnb​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we c...
- 0 kudos
- 2343 Views
- 2 replies
- 0 kudos
Resolved! Table access control is deprecated in Databricks Runtime for Machine Learning
After reviewing this Deprecations, I discovered that Table Access Control is not supported in Databricks Runtime for Machine Learning.I want to understand why table access control is not designed for ML runtime. Is there any reason behind this?
- 2343 Views
- 2 replies
- 0 kudos
- 0 kudos
@Thanapat Sontayasara​ Table Access Control (TAC) is a feature in Databricks that allows you to restrict access to specific tables in your workspace based on user or group identity.According to the Databricks documentation, TAC is not supported in th...
- 0 kudos
- 1380 Views
- 2 replies
- 0 kudos
Not able to merge Databricks cluster delta tables(location Abfs) with PowerBi for analytics Purpose
Hi everyone .. i have an issue while connecting azure Databricks cluster delta tables(location Abfs) with PowerBi for analytics Purpose. but after succesfully linking cluster using Server Hostname and HTTP Path with powerbi is showing an error:-Data...
- 1380 Views
- 2 replies
- 0 kudos
- 7085 Views
- 2 replies
- 0 kudos
AttributeError: module 'pyspark.dbutils' has no attribute 'fs'
`AttributeError` when attempting to transfer files from `dbfs` filestore in DataBricks to a local directory. import pyspark.dbutils as pdbutils pdbutils.fs.cp("/dbfs/Data/file1.csv", "/Users/Downloads/") Traceback (most recent call last): ...
- 7085 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Keval Shah​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers yo...
- 0 kudos
- 1983 Views
- 2 replies
- 0 kudos
Need pattern for loading a million small XML files
Hi, looking for the right solution pattern for this scenario: We have millions of relatively small XML files (currently sitting in ADLS) that we have to load into delta lake. Each XML file has to be read, parsed, and pivoted before writing to a delta...
- 1983 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Steph Swierenga​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answe...
- 0 kudos
- 8158 Views
- 4 replies
- 0 kudos
Error while mounting ADLS in python using AccountKey
I'm using the below code using Account key to mount ADLS in python but running into error:shaded.databricks.org.apache.hadoop.fs.azure.AzureException: java.lang.IllegalArgumentException: The String is not a valid Base64-encoded string. Can you pleas...
- 8158 Views
- 4 replies
- 0 kudos
- 0 kudos
Hi @Krish Lam​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers you...
- 0 kudos
- 3439 Views
- 6 replies
- 2 kudos
Resolved! Auto-Suggestion Completes with Return, want only Tab
How do I adjust the settings for the auto-suggestion? If I click Return, then it fills in the suggestion. If I click Tab, then it fills in the suggestion. I would really like it to only use the auto-suggestion value when I click Tab. How can I change...
- 3439 Views
- 6 replies
- 2 kudos
- 2 kudos
Hi @Dagart Allison​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answer...
- 2 kudos
- 2870 Views
- 2 replies
- 3 kudos
Resolved! Azure Key Vault Keys client library for Python - keys list permission issue
Dear Databricks ExpertI am trying to get a key which is stored in the Azure Key Vault, using Azure Key Vault Keys client library for Python. However error was met.Python Code:#from azure.identity import DefaultAzureCredentialfrom azure.identity impor...
- 2870 Views
- 2 replies
- 3 kudos
- 3 kudos
Hi @KS LAU​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your q...
- 3 kudos