cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
sharpbetty
by • New Contributor II
  • 1937 Views
  • 3 replies
  • 0 kudos

Workflows: Running dependent task despite earlier task fail

I have a scheduled task running in workflow.Task 1 computes some parameters then these are picked up by a dependent reporting task: Task 2.I want Task 2 to report "Failure" if Task 1 fails. Yet creating a dependency in workflows means that Task 2 wil...

Get Started Discussions
tasks
Workflows
Reply
  • 1937 Views
  • 3 replies
  • 0 kudos
View Replies
Latest Reply
NerdSan
New Contributor II
  • 0 kudos

Hi @sharpbetty , Any suggestions how I can keep the parameter sharing and dependency from Task 1 to Task 2, yet also allow Task 2 to fire even on failure of Task 1?Setup:Task 2 dependent on Task1 Challenge: To Fire Task 2 even on Task 1 FailureSoluti...

  • 0 kudos
2 More Replies
faithlawrence98
by • New Contributor II
  • 746 Views
  • 2 replies
  • 2 kudos

Why I am getting QB Desktop Error 6000 recurringly?

Whenever I try to open my company file over a network or multi-user mode, I keep getting QB Desktop Error 6000 and something after that. The error messages on my screen vary every time I attempt to access the data file. I cannot understand the error,...

Get Started Discussions
Reply
  • 746 Views
  • 2 replies
  • 2 kudos
View Replies
Latest Reply
larsonkristen06
New Contributor II
  • 2 kudos

Hi, @faithlawrence98  and  @judithphillips5  I appreciate you both taking the time to share your expertise. This is a well-written and insightful post. Keep up the great work!Thanks Regards!Larson Kristen

  • 2 kudos
1 More Replies
mano7438
by • New Contributor III
  • 27944 Views
  • 4 replies
  • 1 kudos

How to create temporary table in databricks

Hi Team,I have a requirement where I need to create temporary table not temporary view.Can you tell me how to create temporary table in data bricks ?

Get Started Discussions
Reply
  • 27944 Views
  • 4 replies
  • 1 kudos
View Replies
Latest Reply
NandiniN
Honored Contributor
  • 1 kudos

I just learnt, the above is a LEGACY support and hence must not be used. This isn't supported syntax, so there would be a lot of restrictions on the usage of this. Internally it is just a view and hence we should go for create temp view instead.  I k...

  • 1 kudos
3 More Replies
Prashanthkumar
by • New Contributor III
  • 1375 Views
  • 2 replies
  • 1 kudos

Databricks Users Access Control via Azure AAD?

Hi All,Looking for suggestions to see if it is possible to control users via Azure AD (outside of Azure Databricks). As i want to create a new users in Azure and then I want to give RBAC to individual users and rather than control their permissions f...

Get Started Discussions
Reply
  • 1375 Views
  • 2 replies
  • 1 kudos
View Replies
Latest Reply
Prashanthkumar
New Contributor III
  • 1 kudos

Thank you Kaniz, let me try some of the options as my Databricks is integrated with AAD. Let me try Option 1 as thats my primary requirement.

  • 1 kudos
1 More Replies
Prashanthkumar
by • New Contributor III
  • 3507 Views
  • 6 replies
  • 0 kudos

Is it possible to view Databricks cluster metrics using REST API

I am looking for some help on getting databricks cluster metrics such as memory utilization, CPU utilization, memory swap utilization, free file system using REST API.I am trying it in postman using databricks token and with my Service Principal bear...

Prashanthkumar_0-1705104529507.png
Get Started Discussions
Reply
  • 3507 Views
  • 6 replies
  • 0 kudos
View Replies
Latest Reply
Prashanthkumar
New Contributor III
  • 0 kudos

OK thank you, any plans to introduce a new feature in Databricks to capture CPU usage?

  • 0 kudos
5 More Replies
jvk
by • New Contributor III
  • 2567 Views
  • 4 replies
  • 1 kudos

Resolved! Cant create cluster: "Aws Authorization Failure:" .. not authorized to perform: sts:AssumeRole

Full error here:Aws Authorization Failure:Failure happened when talking to AWS, AWS API error code: AccessDenied AWS error message: User: arn:aws:iam::414351767826:user/ConsolidatedManagerIAMUser-ConsolidatedManagerUser-VX02FYW0SSCY is not authorized...

Get Started Discussions
Reply
  • 2567 Views
  • 4 replies
  • 1 kudos
View Replies
Latest Reply
jvk
New Contributor III
  • 1 kudos

Never mind, I see it now thanks!

  • 1 kudos
3 More Replies
Surajv
by • New Contributor III
  • 3937 Views
  • 2 replies
  • 0 kudos

Getting client.session.cache.size warning in pyspark code using databricks connect

Hi Community, I have setup a jupyter notebook in a server and installed databricks connect in its kernel to leverage my databricks cluster compute in the notebook and write pyspark code. Whenever I run my code it gives me below warning: ```WARN Spark...

Get Started Discussions
Reply
  • 3937 Views
  • 2 replies
  • 0 kudos
View Replies
Latest Reply
Surajv
New Contributor III
  • 0 kudos

Thank you @Riyakh 

  • 0 kudos
1 More Replies
chloeh
by • New Contributor II
  • 750 Views
  • 1 replies
  • 0 kudos

Using SQL for Structured Streaming

Hi!I'm new to Databricks. I'm trying to create a data pipeline with structured streaming. A minimal example data pipeline would look like: read from upstream Kafka source, do some data transformation, then write to downstream Kafka sink. I want to do...

Get Started Discussions
Reply
  • 750 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
chloeh
New Contributor II
  • 0 kudos

Ok I figured out why I was getting an error on the usage of `read_kafka`. My default cluster was set up with the wrong Databricks runtime

  • 0 kudos
RakeshRakesh_De
by • New Contributor III
  • 3227 Views
  • 3 replies
  • 0 kudos

Resolved! if any user has only permission 'select table' in unityCatalog but not having permission to ext loc

Hi,Suppose one use having access 'Select' permission the table but user not having any permission to table external location in the 'external location'..  User will be able to read the data from table?? if yes how can user will be able to read the wh...

Get Started Discussions
unitycatalog
Reply
  • 3227 Views
  • 3 replies
  • 0 kudos
View Replies
Latest Reply
RakeshRakesh_De
New Contributor III
  • 0 kudos

Hi @Kaniz_Fatma , thanks for response.. Why the hyperlink command not showing full?

  • 0 kudos
2 More Replies
RobinK
by • Contributor
  • 1207 Views
  • 5 replies
  • 0 kudos

How to switch Workspaces via menue

Hello,In various webinars and videos featuring Databricks instructors, I have noticed that it is possible to switch between different workspaces using the top menu within a workspace. However, in our organization, we have three separate workspaces wi...

Get Started Discussions
Reply
  • 1207 Views
  • 5 replies
  • 0 kudos
View Replies
Latest Reply
Rajani
Contributor
  • 0 kudos

Hi @RobinK looking at screenshots provided i can see you have access to different workspaces but still the dropdown is not visible for you, i also checked if there is any setting for same but i didnt found it.you can raise a ticket to databricks and ...

  • 0 kudos
4 More Replies
dustint121
by • New Contributor II
  • 1924 Views
  • 1 replies
  • 1 kudos

Resolved! Issue with creating cluster on Community Edition

I have recently signed up for Databricks Community Edition and have yet to succesfully create a cluster.I get this message when trying to create a cluster:"Self-bootstrap failure during launch. Please try again later and contact Databricks if the pro...

Get Started Discussions
Reply
  • 1924 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
Ajay-Pandey
Esteemed Contributor III
  • 1 kudos

Hi @dustint121 It's Databricks internal issue; wait for some time and it will resolve.

  • 1 kudos
halox6000
by • New Contributor III
  • 1921 Views
  • 3 replies
  • 1 kudos

Resolved! Databricks community edition down?

I am getting this error when trying to create a cluster: "Self-bootstrap failure during launch. Please try again later and contact Databricks if the problem persists. Node daemon fast failed and did not answer ping for instance"

Get Started Discussions
Reply
  • 1921 Views
  • 3 replies
  • 1 kudos
View Replies
Latest Reply
dustint121
New Contributor II
  • 1 kudos

I still have this issue, and have yet to successfully create a cluster instance.Please advise on how this error was fixed.

  • 1 kudos
2 More Replies
Chinu
by • New Contributor III
  • 1394 Views
  • 3 replies
  • 0 kudos

System Tables - Billing schema

Hi Experts!We enabled UC and also the system table (Billing) to start monitoring usage and cost. We were able to create a dashboard where we can see the usage and cost for each workspace. The usage table in the billing schema has workspace_id but I'd...

Get Started Discussions
Reply
  • 1394 Views
  • 3 replies
  • 0 kudos
View Replies
Latest Reply
Kaizen
Contributor III
  • 0 kudos

@Kaniz_Fatma Im also not seeing the compute names logged in the system billing tables. Is this located elsewhere?

  • 0 kudos
2 More Replies
kp12
by • New Contributor II
  • 4738 Views
  • 4 replies
  • 1 kudos

column "id" is of type uuid but expression is of type character varying.

Hello,I'm trying to write to Azure PostgreSQL flexible  database from Azure Databricks, using PostgreSQL connector in Databricks Runtime in 12.2LTS.I'm using df.write.format("postgresql").save() to write to PostgreSQL database, but getting the follow...

Get Started Discussions
Reply
  • 4738 Views
  • 4 replies
  • 1 kudos
View Replies
Latest Reply
Student-Learn
New Contributor II
  • 1 kudos

Yes, this stack overflow was my reference too and adding below option made load go with no error on UUID data type in postgres columnSpoiler.option(stringtype, "unspecified").option(stringtype, "unspecified")https://stackoverflow.com/questions/409739...

  • 1 kudos
3 More Replies
Raja_fawadAhmed
by • New Contributor
  • 458 Views
  • 1 replies
  • 0 kudos

databricks job compute price w.r.t running time

I have two workflows (jobs) in data bricks (AWS) with below cluster specs (job base cluster NOT general purpose)Driver: i3.xlarge · Workers: i3.xlarge · 2-8 workers Job 1 takes 10 min to completeJob 2 takes 50 min to completeQuestions:DBU cost is sam...

Get Started Discussions
Reply
  • 458 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

  Hi @Raja_fawadAhmed, DBU Cost for Both Jobs: Databricks pricing is based on DBUs (Databricks Units) consumed. The cost depends on the type of compute instances used and the specific workload.For your two jobs, the DBU cost would be calculated...

  • 0 kudos
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!

Labels
Top Kudoed Authors
View all