- 4686 Views
- 2 replies
- 1 kudos
Resolved! Error - Data Masking
Hi,I was testing masking functionality of databricks and got the below error:java.util.concurrent.ExecutionException: com.databricks.sql.managedcatalog.acl.UnauthorizedAccessException:PERMISSION_DENIED: Query on table dev_retransform.uc_lineage.test_...
- 4686 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @FaizH , Are you using single user compute by any chance? Because of you do there is following limitation:Single-user compute limitationDo not add row filters or column masks to any table that you are accessing from a single-user cluster. During t...
- 1 kudos
- 3606 Views
- 3 replies
- 1 kudos
Resolved! Spark read CSV does not throw Exception if the file path is not available in Databricks 14.3
We were using this method and this was working as expected in Databricks 13.3. def read_file(): try: df_temp_dlr_kpi = spark.read.load(raw_path,format="csv", schema=kpi_schema) return df_temp_dlr_kpi except Exce...
- 3606 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi, has this been resolved? I am still seeing this issue with Runtime 14.3 LTSThanks in advance.
- 1 kudos
- 1956 Views
- 1 replies
- 0 kudos
Connection with virtual machine
I have to upload files from Azure container to Virtual machine using Databricks. I have mounted my files to Databricks.Please help me do it. If any idea about this.
- 1956 Views
- 1 replies
- 0 kudos
- 0 kudos
I am not sure if you need to further curate the data before you upload it to Virtual machine, if you not you can just mount storage on VMCreate an SMB Azure file share and connect it to a Windows VM | Microsoft LearnAzure Storage - Create File Storag...
- 0 kudos
- 4348 Views
- 2 replies
- 1 kudos
Resolved! Access to "Admin Console" and "System Tables"
I am the contributor and owner of my databricks workspace. After a recent spike of expense, I want to check the billing details of my Azure databricks usage. (i.e per cluster, per VM, etc). Databricks provides these information thorough "Admin Conso...
- 4348 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @johnp , Thank you for reaching out to our community! We're here to help you. To ensure we provide you with the best support, could you please take a moment to review the response and choose the one that best answers your question? Your feedback...
- 1 kudos
- 1179 Views
- 1 replies
- 0 kudos
Liquid clustering with incremental ingestion
We ingest data incrementally from a database into delta tables using a column updatedUtc. This column is a datetime and is updated when the row in the database table changes. What about using this non-mutable column in "cluster by"? Would it require ...
- 1179 Views
- 1 replies
- 0 kudos
- 0 kudos
It recommended to run optimize query in scheduled manner https://docs.databricks.com/en/delta/clustering.html#how-to-trigger-clustering
- 0 kudos
- 611 Views
- 0 replies
- 1 kudos
- 611 Views
- 0 replies
- 1 kudos
- 652 Views
- 0 replies
- 0 kudos
Databricks feature
would like to know if databricks supports write back feature via altreyx to databricks.
- 652 Views
- 0 replies
- 0 kudos
- 1549 Views
- 1 replies
- 0 kudos
Setting up a proxy for python notebook
Hi all,I am running a python notebook with a web scraper. I want to setup a proxy server that I can use to avoid any IP bans when scraping. Can someone recommend a way to setup a proxy server that can be used from HTTP requests send from a Databricks...
- 1549 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi Kaniz,Thanks for the reply. I know how to include HTTP proxies in my python code and redirect the requests. However, I wondered if Databricks has any functionality to setup the proxies?Thank you
- 0 kudos
- 1122 Views
- 1 replies
- 0 kudos
Unity Catalog cannot display(), but can show() table
Hello all,I'm facing the following issue in a newly setup Azure Databricks - Unity Catalog environment:Failed to store the result. Try rerunning the command.Failed to upload command result to DBFS. Error message: PUT request to create file error Http...
- 1122 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @CharlesDLW , You have similar use case to the one below. Follow my reply in that thread: https://community.databricks.com/t5/community-discussions/file-found-with-fs-ls-but-not-with-spark-read/m-p/78618/highlight/true#M5972
- 0 kudos
- 3144 Views
- 2 replies
- 2 kudos
Resolved! jdbc errors when parameter is a boolean
I'm trying to query a table from Java code. The query works when I use a databricks notebook / query editor directly in Databricks. However, when using Jdbc with Spring, I get following stacktrace. org.springframework.jdbc.UncategorizedSQLException:...
- 3144 Views
- 2 replies
- 2 kudos
- 2 kudos
As I see it, there's two things:jdbcTemplate converts boolean to bit. This is according to JDBC specs (this is a "spring-jdbc" thing and according to documentation; the jdbcTemplate.queryForList makes the best possible guess of the desired type).Data...
- 2 kudos
- 1424 Views
- 1 replies
- 0 kudos
Databricks/Terraform - Error while creating workspace
Hi - I have below code to create the credentials, storage and workspace through terraform script but only credentials and storage is created but failed to create the workspace with error. Can someone please guide/suggest what's wrong with the code/l...
- 1424 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Shrinivas , Could you share with us how you configured datbricks provider?
- 0 kudos
- 658 Views
- 0 replies
- 0 kudos
Databricks connectivity issue when it is premium account
Hello Team,Our application is running in an on-prem VM, not in Azure, and it is trying to connect to Azure Databricks. The Databricks instance on Azure is backed by ADLS Gen 2 storage. It is a Premium tier instance with private web and API endpoint U...
- 658 Views
- 0 replies
- 0 kudos
- 1140 Views
- 1 replies
- 0 kudos
Databricks exam got suspended without any reason. Immediate assistance required
Hello Team, @Cert-Team @Cert-Bricks I had my exam yesterday and had a Pathetic experience while attempting my 1st DataBricks certification. Abruptly, Proctor asked me to show my desk, after showing he/she asked multiple times.. before that somehow 2 ...
- 1140 Views
- 1 replies
- 0 kudos
- 0 kudos
@Retired_mod @Cert-Team @Cert-Bricks Thanks so much for responding. But I have been waiting from day before yesterday, and yet have not received any any response for the ticket. Can you please look into it.I appreciate it.
- 0 kudos
- 2239 Views
- 2 replies
- 0 kudos
Filtering output dataset using parameter values from different dataset
Hi Team, I am trying to build dynamic dashboard for which I have created 2 dataset and I am passing values from 1st dataset to 2nd dataset as parameter. When an user selects parameter values of 1st dataset, 2nd dataset should use those user input val...
- 2239 Views
- 2 replies
- 0 kudos
- 0 kudos
Here are a few suggestions: Ensure that your query in the second dataset is correctly set up to accept and use the parameters from the first dataset. The parameters should be correctly mapped to the catalog, schema, and table name in your "select * ...
- 0 kudos
- 791 Views
- 0 replies
- 0 kudos
Issue with Databricks repo patch
I have a strange issue when i am trying to do Databricks repo PATCH rest API using Postman it works however if i run the same curl command from Github actions it doesn't do the refresh. What could be the reason? any suggestions.
- 791 Views
- 0 replies
- 0 kudos
