- 2536 Views
- 3 replies
- 4 kudos
Resolved! cannot list all tokens with account admin
I'm trying to list all tokens (both user and service principal) for a given workspace; using an Account level admin I've tried both the CLI as well as the API endpoint to list tokens, however each time, only the admin's tokens are returned.I've confi...
- 2536 Views
- 3 replies
- 4 kudos
- 1215 Views
- 0 replies
- 0 kudos
Kaka stream on databricks via SCRAM-SHA-512 mecchanism and SASL_SSL protocal
I ma trying to stream kafka events on databricks but it keeps initializing for hours and don't give any output can someone help what is actually happening and why data is not publishing? I couldn't find anything for this on community.
- 1215 Views
- 0 replies
- 0 kudos
- 4486 Views
- 2 replies
- 4 kudos
Date schema issues with pyspark dataframe creation
I'm having some issues with creating a dataframe with a date column. Could I know what is wrong?from pyspark.sql import SparkSession from pyspark.sql.types import StructType from pyspark.sql.types import DateType, FloatType spark = SparkSession.bui...
- 4486 Views
- 2 replies
- 4 kudos
- 4 kudos
Hi @Kaniz Fatma​,I actually changed the date format to 'M/d/Y' and it didn't throw any errors. I found in my csv file that it had dates like '3/1/2022'. Could that be the issue? But some dates also were like '12/1/2022. So I'm kind of confused.
- 4 kudos
- 25005 Views
- 8 replies
- 5 kudos
Resolved! Can I change from default showing first 1,000 to return all records when query?
I have to query a data for showing in my dashboard.But it truncated the results and showing only first 1,000 rows.In the dashboard view, there is no option to re-execute with maximum result limits.I don't want to switch back to standard view and clic...
- 25005 Views
- 8 replies
- 5 kudos
- 5 kudos
@Thanapat Sontayasara​ 10000 limit is available as an option in the notebook(which propagates to dashboard after its run in notebook) while 1000 rows still is the default. 10000 limit is experimental and it can be made as default depending on the num...
- 5 kudos
- 943 Views
- 0 replies
- 2 kudos
Databricks SQL user has limitation with 10 queries ?
•Power BI is a publisher that uses AD group authentication to publish result sets. Since the publisher's credentials are maintained, the same user can access the data bricks database.•Number of the users are retrieving the data from the power bi or i...
- 943 Views
- 0 replies
- 2 kudos
- 3855 Views
- 8 replies
- 19 kudos
Databricks-connect not available on Databricks Runtime > 10.4
Hello Databricks Team,Databricks-connect doesn't work on databricks runtime 11.3.Databricks recommends that we use dbx for Databricks Lab instead of databricks-connect. Databricks plans no new feature development for Databricks Connect at this time.D...
- 3855 Views
- 8 replies
- 19 kudos
- 19 kudos
thx @Landan George​ do you have any ETA about the public preview ?
- 19 kudos
- 5744 Views
- 8 replies
- 29 kudos
Resolved! Are Python External UDFs supported in Databricks SQL warehouse?
I tried running a python UDF in the Databricks SQL warehouse but it did not run and gave the "Python UDF is not supported" error.Can i get a clear picture if the Python External UDFs are supported or not?
- 5744 Views
- 8 replies
- 29 kudos
- 29 kudos
It's a private preview and It will be supported only in PRO SQL Warehouse and the Serverless SQL Warehouse
- 29 kudos
- 2112 Views
- 0 replies
- 5 kudos
Azure Databricks Jobs Connection Timeout (Read Failed)
Azure Databricks Jobs failed intermittently due to connection timeout (Read Failed) while executing a MS SQL stored procedure which is in Azure SQL database.My requirement is to process delta records(Get delta records using last refresh date) from Da...
- 2112 Views
- 0 replies
- 5 kudos
- 3067 Views
- 3 replies
- 2 kudos
Resolved! Databricks hiding error stack trace when plotting?
Hi,I have been working with data visualisations in Databricks the last week and came across a very peculiar behaviour where it seems like Databricks is actively suppressing errors to the user. An example:```import matplotlib.pyplot as pltx = [1, 2, 3...
- 3067 Views
- 3 replies
- 2 kudos
- 2 kudos
It might be the DBR version. I ran that code on DBR 11.3 and I got the plot + error. Let me confirm if it's the DBR and get back to you here
- 2 kudos
- 1325 Views
- 0 replies
- 14 kudos
Automating DDLs and Privilege management
How do you automate table creation and management of privilege / grants on securable objects (tables, views, etc.).I had idea to use terraform to manage above, but terraform doesn't work with managed tables - it allows to create table but then there ...
- 1325 Views
- 0 replies
- 14 kudos
- 1811 Views
- 1 replies
- 2 kudos
Databricks - DBeaver error
Hello experts. While trying to setup the connection between DBeaver and Databricks, we receive the following error:[Databricks][DatabricksJDBCDriver](700120) Host adb-xxxxxxxxxx.azuredatabricks.net cannot be resolved through DnsResolver com.databrick...
- 1811 Views
- 1 replies
- 2 kudos
- 2 kudos
We identified the problem. It was due to the proxy that the hostname couldn't be resolved.
- 2 kudos
- 13115 Views
- 4 replies
- 17 kudos
Resolved! SQL query takes too long to run
Hi all,I have a set up SQL query run with 5 hours but the SQL endpoint take too long to start up with each run. Currently I don't know how to fix this Could you please help me how to improve this?
- 13115 Views
- 4 replies
- 17 kudos
- 17 kudos
or refer on this : Faster SQL Queries on Delta Lake with Dynamic File Pruninghttps://www.databricks.com/blog/2020/04/30/faster-sql-queries-on-delta-lake-with-dynamic-file-pruning.html
- 17 kudos
- 3474 Views
- 3 replies
- 7 kudos
Photon does not fully support the query because of dynamic pruning
Does it still make sense to run this job on a cluster with Photon enable when I am receiving the following?This is the code I ran:CREATE OR REPLACE TABLE ${tbl_name}_dups SELECT src.*, ROW_NUMBER() OVER ( PARTITION BY src.id ...
- 3474 Views
- 3 replies
- 7 kudos
- 6514 Views
- 3 replies
- 8 kudos
Resolved! Auto termination for clusters, jobs, and delta live tables does not terminate clusters on GCP.
Hello,I am new to Databricks, and I have been trying to understand how auto termination works, but I am unsure if it is a problem based on my configuration or something else. The problem is the same in all cases, the cluster on GCP created by Databri...
- 6514 Views
- 3 replies
- 8 kudos
- 8 kudos
Hi @Tilemachos Charalampous​ ,The compute resources in your GCP account might not be the Spark clusters, rather the GKE cluster that Databricks spins up for the Databricks architecture in your account. The note in the blue highlight in docs here http...
- 8 kudos
- 1374 Views
- 0 replies
- 0 kudos
How to change branch without using UI?
Hi, I want to change the branch in Databricks Repo. When I click on the current branch name, there is a message that: As you can see in the above image, I cannot see the list of branches to select. In fact, I selected a branch by mistake and I am not...
- 1374 Views
- 0 replies
- 0 kudos
| User | Count |
|---|---|
| 1611 | |
| 768 | |
| 347 | |
| 286 | |
| 252 |
