- 38938 Views
- 9 replies
- 5 kudos
Resolved! SQL Declare Variable equivalent in databricks
Hello. What would be the equivalent of the below in databricks?DECLARE @LastChangeDate as dateSET @LastChangeDate = GetDate()I already tried the below and worked. However I need to know how set a sql variable dynamicallySET da.dbname = test;SELECT "$...
- 38938 Views
- 9 replies
- 5 kudos
- 2186 Views
- 1 replies
- 0 kudos
Resolved! How to send Task Specific Parameters using run-now REST API.
I am using Following job trigger API -https://docs.databricks.com/api/workspace/jobs/runnowHere is what I want to achieve -I have complex workflow with multiple tasks and each task has python parameter named "--conf-file".While using runnow REST API ...
- 2186 Views
- 1 replies
- 0 kudos
- 0 kudos
@p4pratikjain wrote:I am using Following job trigger API - Popeyes Guest Experience Surveyhttps://docs.databricks.com/api/workspace/jobs/runnowHere is what I want to achieve - I have complex workflow with multiple tasks and each task has python param...
- 0 kudos
- 779 Views
- 0 replies
- 0 kudos
Data bricks Exam got suspended
Hello Team, I encountered Pathetic experience while attempting my 1st DataBricks certification. Abruptly, Proctor asked me to show my desk, after showing he/she asked multiple times.. wasted my time and then suspended my exam. I want to file a compla...
- 779 Views
- 0 replies
- 0 kudos
- 2666 Views
- 3 replies
- 2 kudos
I'm trying to create a table in databricks sql using widget values in table naming. The idea is that the users could select / enter table naming values as they create their tables. This can be done in notebooks but I can't get the syntax working in DBSQL.
Here's an example: CREATE OR REPLACE TABLE {{workspace}}.{{TableNameFirstPart}}_{{TableNameEndPart}} AS SELECT ...
- 2666 Views
- 3 replies
- 2 kudos
- 2 kudos
Have you figured out what the problem was? Could the issue be permission related?
- 2 kudos
- 1677 Views
- 2 replies
- 3 kudos
Why am I getting shown estimated costs and charges (DBU in $) during community trial edition?
I recently signed up for the 14 day community trial and I noticed it was incurring or showing estimate costs on my Usage page shortly after I created my first workspace linked through AWS. Is this only for monitoring purposes or am I actually going t...
- 1677 Views
- 2 replies
- 3 kudos
- 3 kudos
Hi @Fast_Lanes No, you will not be charged for the trial period on databricks usage.It's just showing the usual charges that will be charged when you will not be using trial version.
- 3 kudos
- 1372 Views
- 1 replies
- 1 kudos
Resolved! Community Edition SignUp option not visible
I would like to do some practical scenarios testing thro communication edition. For that, i check signup for community edition , but this option is not visible/shows in login page itself whereas shows only sign-in .. Can anyone help?
- 1372 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @ADataBricksSP Please find below URL for signup as new user please all the required details click continue then you will find the option to signup as community edition -Databricks Community Signup Link
- 1 kudos
- 7351 Views
- 3 replies
- 0 kudos
Amazon returns a 403 error code when trying to access an S3 Bucket
Hey! So far I have followed along with the Configure S3 access with instance profiles article to grant my cluster access to an S3 bucket. I have also made sure to disable IAM role passthrough on the cluster. Upon querying the bucket through a noteboo...
- 7351 Views
- 3 replies
- 0 kudos
- 0 kudos
I had the same issue and I found a solutionFor me, the permission problems only exist when the Cluster's (compute's) Access mode is "Shared No Isolation". When the Access Mode is either "Shared" or "Single User" then the IAM configuration seems to a...
- 0 kudos
- 3151 Views
- 1 replies
- 0 kudos
Intermittent secret resolution error service fault in GCP
Experiencing the error below in GCP when starting a cluster (both manually and in jobs). It's causing our ETL and other production jobs to fail multiple times a week. Its intermittent, but requires manual intervention to retry scheduled jobs. run fai...
- 3151 Views
- 1 replies
- 0 kudos
- 0 kudos
Thanks @Retired_mod . 1 and 2 are confirmed fine. I would imagine 3 to not result in intermittent failures if it were a config issue, but perhaps it's another network related issue that would be susceptible to intermittent failure.The link you provid...
- 0 kudos
- 4020 Views
- 3 replies
- 2 kudos
StreamingQueryListener onQueryTerminated in Databricks Job
I am defining a StreamingQueryListener that collects metrics on my Spark Structured Streaming tasks and sends them to a Prometheus Pushgateway.When the job is terminated, I want to use the onQueryTerminated to cleanup the metrics for each job from th...
- 4020 Views
- 3 replies
- 2 kudos
- 2 kudos
@Starki - Per documentation, StreamingQueryListener.onQueryTerminated is called when the query is stopped, e.g., StreamingQuery.stop.and each of these Python observable APIs work asynchronously. https://www.databricks.com/blog/2022/05/27/how-to-moni...
- 2 kudos
- 2296 Views
- 2 replies
- 0 kudos
Resolved! Disable welcome emails
Is it possible to disable the welcome emails that go to users when added to the workspace?
- 2296 Views
- 2 replies
- 0 kudos
- 0 kudos
I have found that it is possible to suppress welcome emails if users are added via the API using flags.
- 0 kudos
- 2470 Views
- 2 replies
- 1 kudos
maven libraries installation issue on 11.3/12.2 LTS
we've encountered issue while attempting to install Maven libraries on Databricks clusters version 11.3 LTS. Specifically, we are encountering SSL handshake errors during the installation process. It's worth noting that these same libraries install w...
- 2470 Views
- 2 replies
- 1 kudos
- 4321 Views
- 4 replies
- 1 kudos
Resolved! Accessing ADLS Gen 2 Raw Files with UC ?
We are using service principal to access data from raw files such as json, CSV .I saw a video suggesting that it could be done via unity catalog as well.Could someone comment on this please ?
- 4321 Views
- 4 replies
- 1 kudos
- 1 kudos
@Loki wrote:We are using service principal to access data from raw files such as json, CSV .Car GamesI saw a video suggesting that it could be done via unity catalog as well.Could someone comment on this please ?That's great! Service principals are a...
- 1 kudos
- 2440 Views
- 2 replies
- 1 kudos
QRY Results incorrect but Exported data is OK
I ran a query "Select * from fact_Orders". This presented a lot of garbage, The correct column headers, but the contents were extremely random, e.g. blanks in the key column, VAT rates of 12282384234E-45 . When I export to CSV , it presents fi...
- 2440 Views
- 2 replies
- 1 kudos
- 975 Views
- 0 replies
- 0 kudos
speed issue DBR 13+ for R
I got a notebook running on DBR 12.2 with the following R code: install.packages("microbenchmark") install.packages("furrr") library(microbenchmark) library(tidyverse) # example tibble df_test <- tibble(id = 1:100000, street_raw = rep("Bahnhofs...
- 975 Views
- 0 replies
- 0 kudos
- 2332 Views
- 2 replies
- 0 kudos
How to unload a Jar for UDF without restart spark context?
In the scala notebook of databricks, I created a temporary function with a certain Jar and class name. Then I want to update the Jar. But without restart the context, I can not reload the new Jar, the temporary function always reuses the old classes....
- 2332 Views
- 2 replies
- 0 kudos
| User | Count |
|---|---|
| 1613 | |
| 771 | |
| 349 | |
| 286 | |
| 253 |
