- 21 Views
- 0 replies
- 0 kudos
from The customers who are actively seeking the possible health advantages of in a formulation that is both convenient and pleasurable have shown a strong preference for. One of the compounds that can be found in cannabis plants is called cannabidiol...
- 21 Views
- 0 replies
- 0 kudos
by
Surajv
• New Contributor III
- 150 Views
- 2 replies
- 0 kudos
Hi Community, I have setup a jupyter notebook in a server and installed databricks connect in its kernel to leverage my databricks cluster compute in the notebook and write pyspark code. Whenever I run my code it gives me below warning: ```WARN Spark...
- 150 Views
- 2 replies
- 0 kudos
- 44 Views
- 0 replies
- 0 kudos
attended data engineering with databricks in summit 2023. Being first time to summit, this was a great experience. Training was highly productive for beginners. Delta Live Tables rocks!! Workflowa in databricks are super efficient way for job schedul...
- 44 Views
- 0 replies
- 0 kudos
by
Surajv
• New Contributor III
- 47 Views
- 1 replies
- 0 kudos
Hi community, When I use pyspark rdd related functions in my environment using databricks connect, I get below error: Databricks cluster version: 12.2. `RuntimeError: Python in worker has different version 3.9 than that in driver 3.10, PySpark cannot...
- 47 Views
- 1 replies
- 0 kudos
Latest Reply
Hi @Surajv, The error message you’re encountering indicates a Python version mismatch between the Spark worker and the Spark driver.
To resolve this issue, follow these steps:
Install Correct Python Version on Worker Node:
Ensure that the correct Py...
- 132 Views
- 2 replies
- 0 kudos
Full error here:Aws Authorization Failure:Failure happened when talking to AWS, AWS API error code: AccessDenied AWS error message: User: arn:aws:iam::414351767826:user/ConsolidatedManagerIAMUser-ConsolidatedManagerUser-VX02FYW0SSCY is not authorized...
- 132 Views
- 2 replies
- 0 kudos
Latest Reply
Hi @jvk, The “AccessDenied” error message you’re encountering in AWS indicates that the user “arn:aws:iam::414351767826:user/ConsolidatedManagerIAMUser-ConsolidatedManagerUser-VX02FYW0SSCY” does not have the necessary permissions to perform the “sts:...
1 More Replies
- 173 Views
- 1 replies
- 0 kudos
Hi!I'm new to Databricks. I'm trying to create a data pipeline with structured streaming. A minimal example data pipeline would look like: read from upstream Kafka source, do some data transformation, then write to downstream Kafka sink. I want to do...
- 173 Views
- 1 replies
- 0 kudos
Latest Reply
Ok I figured out why I was getting an error on the usage of `read_kafka`. My default cluster was set up with the wrong Databricks runtime
- 1951 Views
- 3 replies
- 0 kudos
Hi,Suppose one use having access 'Select' permission the table but user not having any permission to table external location in the 'external location'.. User will be able to read the data from table?? if yes how can user will be able to read the wh...
- 1951 Views
- 3 replies
- 0 kudos
Latest Reply
Hi @Kaniz , thanks for response.. Why the hyperlink command not showing full?
2 More Replies
by
RobinK
• New Contributor III
- 246 Views
- 5 replies
- 0 kudos
Hello,In various webinars and videos featuring Databricks instructors, I have noticed that it is possible to switch between different workspaces using the top menu within a workspace. However, in our organization, we have three separate workspaces wi...
- 246 Views
- 5 replies
- 0 kudos
Latest Reply
Hi @RobinK looking at screenshots provided i can see you have access to different workspaces but still the dropdown is not visible for you, i also checked if there is any setting for same but i didnt found it.you can raise a ticket to databricks and ...
4 More Replies
- 436 Views
- 1 replies
- 1 kudos
I have recently signed up for Databricks Community Edition and have yet to succesfully create a cluster.I get this message when trying to create a cluster:"Self-bootstrap failure during launch. Please try again later and contact Databricks if the pro...
- 436 Views
- 1 replies
- 1 kudos
Latest Reply
Hi @dustint121 It's Databricks internal issue; wait for some time and it will resolve.
- 594 Views
- 3 replies
- 1 kudos
I am getting this error when trying to create a cluster: "Self-bootstrap failure during launch. Please try again later and contact Databricks if the problem persists. Node daemon fast failed and did not answer ping for instance"
- 594 Views
- 3 replies
- 1 kudos
Latest Reply
I still have this issue, and have yet to successfully create a cluster instance.Please advise on how this error was fixed.
2 More Replies
by
Chinu
• New Contributor III
- 725 Views
- 3 replies
- 0 kudos
Hi Experts!We enabled UC and also the system table (Billing) to start monitoring usage and cost. We were able to create a dashboard where we can see the usage and cost for each workspace. The usage table in the billing schema has workspace_id but I'd...
- 725 Views
- 3 replies
- 0 kudos
Latest Reply
@Kaniz Im also not seeing the compute names logged in the system billing tables. Is this located elsewhere?
2 More Replies
by
phguk
• New Contributor II
- 1239 Views
- 2 replies
- 0 kudos
Can anyone share experience (or point me to another reference) that describes how to configure Azure Blob storage which has NFS enabled as an external volume to Databricks ?I've succeeded in adding SMB storage to Databricks but (if I understand prope...
- 1239 Views
- 2 replies
- 0 kudos
Latest Reply
Apologies for the delay & many thanks for responding. Yes I've been able to mount my premium storage + NFS container as an external volume to Databricks.
1 More Replies
by
kp12
• New Contributor II
- 2907 Views
- 4 replies
- 1 kudos
Hello,I'm trying to write to Azure PostgreSQL flexible database from Azure Databricks, using PostgreSQL connector in Databricks Runtime in 12.2LTS.I'm using df.write.format("postgresql").save() to write to PostgreSQL database, but getting the follow...
- 2907 Views
- 4 replies
- 1 kudos
Latest Reply
Yes, this stack overflow was my reference too and adding below option made load go with no error on UUID data type in postgres columnSpoiler.option(stringtype, "unspecified").option(stringtype, "unspecified")https://stackoverflow.com/questions/409739...
3 More Replies
- 204 Views
- 1 replies
- 0 kudos
Whenever I try to open my company file over a network or multi-user mode, I keep getting QB Desktop Error 6000 and something after that. The error messages on my screen vary every time I attempt to access the data file. I cannot understand the error,...
- 204 Views
- 1 replies
- 0 kudos
Latest Reply
Hi, @faithlawrence98 Don’t worry; we’re here to help you.To open your company file over the network, it is required to run the QB Database Server Manager on your server computer. In case this tool isn’t running, you will most probably face QB Desktop...
- 195 Views
- 1 replies
- 0 kudos
I have two workflows (jobs) in data bricks (AWS) with below cluster specs (job base cluster NOT general purpose)Driver: i3.xlarge · Workers: i3.xlarge · 2-8 workers Job 1 takes 10 min to completeJob 2 takes 50 min to completeQuestions:DBU cost is sam...
- 195 Views
- 1 replies
- 0 kudos
Latest Reply
Hi @Raja_fawadAhmed,
DBU Cost for Both Jobs:
Databricks pricing is based on DBUs (Databricks Units) consumed. The cost depends on the type of compute instances used and the specific workload.For your two jobs, the DBU cost would be calculated...