- 3718 Views
- 3 replies
- 2 kudos
I'm trying to create a table in databricks sql using widget values in table naming. The idea is that the users could select / enter table naming values as they create their tables. This can be done in notebooks but I can't get the syntax working in DBSQL.
Here's an example: CREATE OR REPLACE TABLE {{workspace}}.{{TableNameFirstPart}}_{{TableNameEndPart}} AS SELECT ...
- 3718 Views
- 3 replies
- 2 kudos
- 2 kudos
Have you figured out what the problem was? Could the issue be permission related?
- 2 kudos
- 1966 Views
- 2 replies
- 3 kudos
Why am I getting shown estimated costs and charges (DBU in $) during community trial edition?
I recently signed up for the 14 day community trial and I noticed it was incurring or showing estimate costs on my Usage page shortly after I created my first workspace linked through AWS. Is this only for monitoring purposes or am I actually going t...
- 1966 Views
- 2 replies
- 3 kudos
- 3 kudos
Hi @Fast_Lanes No, you will not be charged for the trial period on databricks usage.It's just showing the usual charges that will be charged when you will not be using trial version.
- 3 kudos
- 1727 Views
- 1 replies
- 1 kudos
Resolved! Community Edition SignUp option not visible
I would like to do some practical scenarios testing thro communication edition. For that, i check signup for community edition , but this option is not visible/shows in login page itself whereas shows only sign-in .. Can anyone help?
- 1727 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @ADataBricksSP Please find below URL for signup as new user please all the required details click continue then you will find the option to signup as community edition -Databricks Community Signup Link
- 1 kudos
- 8632 Views
- 3 replies
- 0 kudos
Amazon returns a 403 error code when trying to access an S3 Bucket
Hey! So far I have followed along with the Configure S3 access with instance profiles article to grant my cluster access to an S3 bucket. I have also made sure to disable IAM role passthrough on the cluster. Upon querying the bucket through a noteboo...
- 8632 Views
- 3 replies
- 0 kudos
- 0 kudos
I had the same issue and I found a solutionFor me, the permission problems only exist when the Cluster's (compute's) Access mode is "Shared No Isolation". When the Access Mode is either "Shared" or "Single User" then the IAM configuration seems to a...
- 0 kudos
- 3477 Views
- 1 replies
- 0 kudos
Intermittent secret resolution error service fault in GCP
Experiencing the error below in GCP when starting a cluster (both manually and in jobs). It's causing our ETL and other production jobs to fail multiple times a week. Its intermittent, but requires manual intervention to retry scheduled jobs. run fai...
- 3477 Views
- 1 replies
- 0 kudos
- 0 kudos
Thanks @Retired_mod . 1 and 2 are confirmed fine. I would imagine 3 to not result in intermittent failures if it were a config issue, but perhaps it's another network related issue that would be susceptible to intermittent failure.The link you provid...
- 0 kudos
- 4746 Views
- 3 replies
- 2 kudos
StreamingQueryListener onQueryTerminated in Databricks Job
I am defining a StreamingQueryListener that collects metrics on my Spark Structured Streaming tasks and sends them to a Prometheus Pushgateway.When the job is terminated, I want to use the onQueryTerminated to cleanup the metrics for each job from th...
- 4746 Views
- 3 replies
- 2 kudos
- 2 kudos
@Starki - Per documentation, StreamingQueryListener.onQueryTerminated is called when the query is stopped, e.g., StreamingQuery.stop.and each of these Python observable APIs work asynchronously. https://www.databricks.com/blog/2022/05/27/how-to-moni...
- 2 kudos
- 2625 Views
- 2 replies
- 0 kudos
Resolved! Disable welcome emails
Is it possible to disable the welcome emails that go to users when added to the workspace?
- 2625 Views
- 2 replies
- 0 kudos
- 0 kudos
I have found that it is possible to suppress welcome emails if users are added via the API using flags.
- 0 kudos
- 2809 Views
- 2 replies
- 1 kudos
maven libraries installation issue on 11.3/12.2 LTS
we've encountered issue while attempting to install Maven libraries on Databricks clusters version 11.3 LTS. Specifically, we are encountering SSL handshake errors during the installation process. It's worth noting that these same libraries install w...
- 2809 Views
- 2 replies
- 1 kudos
- 5088 Views
- 4 replies
- 1 kudos
Resolved! Accessing ADLS Gen 2 Raw Files with UC ?
We are using service principal to access data from raw files such as json, CSV .I saw a video suggesting that it could be done via unity catalog as well.Could someone comment on this please ?
- 5088 Views
- 4 replies
- 1 kudos
- 1 kudos
@Loki wrote:We are using service principal to access data from raw files such as json, CSV .Car GamesI saw a video suggesting that it could be done via unity catalog as well.Could someone comment on this please ?That's great! Service principals are a...
- 1 kudos
- 2713 Views
- 2 replies
- 1 kudos
QRY Results incorrect but Exported data is OK
I ran a query "Select * from fact_Orders". This presented a lot of garbage, The correct column headers, but the contents were extremely random, e.g. blanks in the key column, VAT rates of 12282384234E-45 . When I export to CSV , it presents fi...
- 2713 Views
- 2 replies
- 1 kudos
- 1146 Views
- 0 replies
- 0 kudos
speed issue DBR 13+ for R
I got a notebook running on DBR 12.2 with the following R code: install.packages("microbenchmark") install.packages("furrr") library(microbenchmark) library(tidyverse) # example tibble df_test <- tibble(id = 1:100000, street_raw = rep("Bahnhofs...
- 1146 Views
- 0 replies
- 0 kudos
- 2652 Views
- 2 replies
- 0 kudos
How to unload a Jar for UDF without restart spark context?
In the scala notebook of databricks, I created a temporary function with a certain Jar and class name. Then I want to update the Jar. But without restart the context, I can not reload the new Jar, the temporary function always reuses the old classes....
- 2652 Views
- 2 replies
- 0 kudos
- 2382 Views
- 1 replies
- 0 kudos
Structured Streaming Delta Table - Reading and writing from same table
Hi I have a structured streaming job that reads from a delta table "A" and pushes to another delta table "B".A Schema - group_key, id, timestamp, valueB Schema - group_key, watermark_timestamp, derived_valueOne requirement is that i need to get the m...
- 2382 Views
- 1 replies
- 0 kudos
- 1152 Views
- 0 replies
- 0 kudos
Migrate von non-CDC sources to CDC. Downstream consequences?
I have a question regarding streaming with CDC.We currently have a delta table where CDC is not yet enabled, and its the source for other following streams that read from that table.To catch the changes for a new usecase, we need to enable CDC on tha...
- 1152 Views
- 0 replies
- 0 kudos
- 39580 Views
- 1 replies
- 1 kudos
Migrating legacy SSAS cube to databricks
We have SQL database. Database is designed in star schema. We are migrating data from SQL to databricks. There are cubes designed using SSAS. These cubes are used for end users in excel for analysis purpose. We are now looking for solution for:1) Can...
- 39580 Views
- 1 replies
- 1 kudos
- 1 kudos
Databricks itself does not deliver semantic models like SSAS cubes. So Databricks cannot migrate them because there is nothing to migrate to.However, there are some options:- use of PowerBI instead of SSAS (there might even be a migrate option?). W...
- 1 kudos
| User | Count |
|---|---|
| 1619 | |
| 790 | |
| 493 | |
| 349 | |
| 287 |
