cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

yeungcase
by New Contributor III
  • 6131 Views
  • 7 replies
  • 3 kudos

Writing a single huge dataframe into Azure SQL Database using JDBC

Hi All,I am currently trying to read data from a materialized view as a single dataframe which contains around 10M of rows and then write it into an Azure SQL database. However, I don't see the spark job moving a bit even an hour is passed. I have al...

yeungcase_0-1719991764991.png yeungcase_0-1719991355253.png yeungcase_1-1719991508190.png
  • 6131 Views
  • 7 replies
  • 3 kudos
Latest Reply
RishabhTiwari07
Databricks Employee
  • 3 kudos

Hi @yeungcase , Thank you for reaching out to our community! We're here to help you. To ensure we provide you with the best support, could you please take a moment to review the response and choose the one that best answers your question? Your feedba...

  • 3 kudos
6 More Replies
Elcio
by New Contributor
  • 1110 Views
  • 1 replies
  • 0 kudos

Mounts in Databricks

How is it possible to prohibit a certain user from being able to see the mounts created in Databricks. Even if the user issues the %fs ls /mnt command, it doesn't return anything.

  • 1110 Views
  • 1 replies
  • 0 kudos
Latest Reply
RishabhTiwari07
Databricks Employee
  • 0 kudos

Hi @Elcio , Thank you for reaching out to our community! We're here to help you. To ensure we provide you with the best support, could you please take a moment to review the response and choose the one that best answers your question? Your feedback n...

  • 0 kudos
pjv
by New Contributor III
  • 7284 Views
  • 6 replies
  • 3 kudos

Driver and worker node utalisation

Hi all! Can anyone tell me if having a worker node(s) of the same type as my driver node make a difference performance-wise if I am running normal python code on a notebook as a job on this cluster? I am running mostly machine learning libraries such...

  • 7284 Views
  • 6 replies
  • 3 kudos
Latest Reply
SeanRay
New Contributor II
  • 3 kudos

Yes, you are right, I agree with you.

  • 3 kudos
5 More Replies
Prasad_Koneru
by New Contributor III
  • 3364 Views
  • 2 replies
  • 1 kudos

Resolved! Profile setup for databricks Account

Hi Team,we usually do setup profile for databrikcs at workspace level, and i have done this using host url and token which is working fine like below.[DEFAULT]host = workspaceurlusername = ****password = tokenNow my question is how we set for databri...

  • 3364 Views
  • 2 replies
  • 1 kudos
Latest Reply
Walter_C
Databricks Employee
  • 1 kudos

You cannot create a PAT token for you Account Console authentication, on this case you will have 2 options to authenticate:Using Basic auth, on which on your profile you will set you username and password to log in, same as you do to log in in the br...

  • 1 kudos
1 More Replies
sathya08
by New Contributor III
  • 1188 Views
  • 0 replies
  • 0 kudos

Databricks Asset Bundle Error 'KEY of the resource to run"

Hello Team,I am new to DAB and running it for the first time through the Databricks CLI.The bundle validation is successful but while running it errors out error="expected a KEY of the resource to run".Can anyone help me on what to check to resolve t...

  • 1188 Views
  • 0 replies
  • 0 kudos
AswinGovindan77
by New Contributor II
  • 1180 Views
  • 1 replies
  • 1 kudos

Databricks community group in Kerala

  Calling All Data Enthusiasts in Kerala! Hey everyone,I'm excited about the idea of launching a Databricks Community Group here in Kerala! This group would be a hub for learning, sharing knowledge, and networking among data enthusiasts, analysts, a...

  • 1180 Views
  • 1 replies
  • 1 kudos
Latest Reply
Sujitha
Databricks Employee
  • 1 kudos

Hi @AswinGovindan77 , Do you have an estimate of how many enthusiasts will be joining you? If you provide a rough number, we can create a group for you on Community!

  • 1 kudos
DavidKxx
by Contributor
  • 6850 Views
  • 6 replies
  • 2 kudos

Can't create branch of public git repo

Hi,I have cloned a public git repo into my Databricks account.  It's a repo associated with an online training course.  I'd like to work through the notebooks, maybe make some changes and updates, etc., but I'd also like to keep a clean copy of it. M...

  • 6850 Views
  • 6 replies
  • 2 kudos
Latest Reply
DavidKxx
Contributor
  • 2 kudos

It occurs to me that one valid solution to this problem is simply to fork the repo and work there.  Pretty standard approach, I guess, although not something I've ever been in the habit of doing.

  • 2 kudos
5 More Replies
Aman_Dahiya
by New Contributor
  • 1173 Views
  • 1 replies
  • 1 kudos

Resolved! DATABRICKS FESTVAL VOUCHER

what should be the timezone which we have to consider for earning the voucher 

  • 1173 Views
  • 1 replies
  • 1 kudos
Latest Reply
Sujitha
Databricks Employee
  • 1 kudos

@Aman_Dahiya Guessing you are referring to this event! There is no categorization for time zones, it is open to all. You can earn the voucher regardless of your timezone.

  • 1 kudos
himanmon
by New Contributor III
  • 2631 Views
  • 3 replies
  • 2 kudos

Resolved! When does the cost of JOB COMPUTE start to be calculated?

I'm trying to run a workflow with job compute.Job compute needs to be pending for about 5 to 7 minutes before executing the workflow. I think it takes time to find a suitable instance in the cloud, configure the environment, install libraries, etc.An...

  • 2631 Views
  • 3 replies
  • 2 kudos
Latest Reply
jacovangelder
Honored Contributor
  • 2 kudos

There is a big discrepancy to take note of here. It is the difference between Databricks job costs (DBUs) and billing for the cloud provider (the actual VM doing the the work). Billing for the Databricks job starts when the Spark context is being ini...

  • 2 kudos
2 More Replies
GeKo
by Contributor
  • 1308 Views
  • 0 replies
  • 0 kudos

Asset Bundle template: ignore file based on variable value

Hello,I am creating an asset-bundle-template which should be able to include/exclude certain files, depending on the value of a parameter, e.g. if parameter "include_file" is set to true, then the bundle init command should include the template file(...

  • 1308 Views
  • 0 replies
  • 0 kudos
SHS
by New Contributor
  • 1456 Views
  • 1 replies
  • 1 kudos

Error with: %run ../Includes/Classroom-Setup-SQL

Hi Guys,Just started the ASP 2.1L Spare SQL Lab and I get this error, when I run the first setup SQL command:%run ../Includes/Classroom-Setup-SQLThe execution of this command did not finish successfullyPython interpreter will be restarted.Python inte...

  • 1456 Views
  • 1 replies
  • 1 kudos
Latest Reply
cibele
New Contributor II
  • 1 kudos

You can create a cluster compatible with the notebooks. So It will work.

  • 1 kudos
thibault
by Contributor III
  • 2267 Views
  • 1 replies
  • 1 kudos

Databricks CLI bundle run multiple jobs

Hi!I am using bundles to deploy various workflows, and as part of a CI pipeline, I want to run integration tests. They are in notebooks that I deploy and run with databricks CLI bundle with Azure DevOps.This allows me to run only one job at a time as...

  • 2267 Views
  • 1 replies
  • 1 kudos
Latest Reply
thibault
Contributor III
  • 1 kudos

Hi @Retired_mod and thanks for your reply.I see, so all tests will need to be defined in one config file under one job.

  • 1 kudos
OnerFusion-AI
by New Contributor
  • 61504 Views
  • 3 replies
  • 3 kudos

Resolved! How to import excel on databricks

To import an Excel file into Databricks, you can follow these general steps:1. **Upload the Excel File**:- Go to the Databricks workspace or cluster where you want to work.- Navigate to the location where you want to upload the Excel file.- Click on ...

  • 61504 Views
  • 3 replies
  • 3 kudos
Latest Reply
AhmedAlnaqa
Contributor
  • 3 kudos

The question here is how to read the multi-excel files based on path.The mentioned solution interacts with one file only, do we have the ability to read all the Excel files in the folder?

  • 3 kudos
2 More Replies
LLLMMM
by New Contributor III
  • 1906 Views
  • 3 replies
  • 2 kudos

Resolved! Try Databricks sign up failed

Hi, I am trying to use Databricks with the community edition. However, when I tried to create an account, the sign-up failed after I completed the puzzle. 

Screenshot 2024-07-05 at 20.45.53.png
  • 1906 Views
  • 3 replies
  • 2 kudos
Latest Reply
lovinchanglei
New Contributor II
  • 2 kudos

Thank you so much for sharing, this is really helpful.

  • 2 kudos
2 More Replies

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels