cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

tomos_phillips1
by New Contributor II
  • 3773 Views
  • 10 replies
  • 1 kudos

GeoPandas Insall

hi,I cannot install geopandas in my notebook, ive tried all different forms of generic fix, pip installs etc but always get this error:CalledProcessError: Command 'pip --disable-pip-version-check install geopandas' returned non-zero exit status 1.---...

  • 3773 Views
  • 10 replies
  • 1 kudos
Latest Reply
shan_chandra
Esteemed Contributor
  • 1 kudos

@brian999 - Conda is subjected to commercial licensing. Referenced here:  https://docs.databricks.com/en/archive/legacy/conda.html

  • 1 kudos
9 More Replies
jlagos
by New Contributor
  • 48 Views
  • 0 replies
  • 2 kudos

Survey about Databricks

Hi everyone, I hope you are very well.In the research for my university we are conducting a survey to Databricks users, aimed to gather information about how cluster configuration and optimization is faced in the industry.If you like you can answer i...

  • 48 Views
  • 0 replies
  • 2 kudos
Artman23
by New Contributor
  • 728 Views
  • 3 replies
  • 0 kudos

DLT Pipeline Issue with New Version of Advanced Data Engineering with Databricks training

I am currently taking the new Advanced Data Engineering with Databricks training. I am stuck in the Demo: Auto Load to Bronze section of Streaming ETL Patterns with DLT. Looks to be an access issue to AWS as the pipeline errors out with the following...

  • 728 Views
  • 3 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi, Could you please paste the error stack here? 

  • 0 kudos
2 More Replies
PKD28
by New Contributor
  • 119 Views
  • 3 replies
  • 0 kudos

Resolved! Databricks Cluster job failure issue

Jobs within the all purpose DB Cluster are failing with "the spark driver has stopped unexpectedly and is restarting. Your notebook will be automatically reattached"In the event log it says "Event_type=DRIVER_NOT_RESPONDING & MESSAGE= "Driver is up b...

  • 119 Views
  • 3 replies
  • 0 kudos
Latest Reply
PKD28
New Contributor
  • 0 kudos

 just now there is one cluster issuecluster error: Driver is unresponsive likely due to GCcluster conf:worker: Standard_D8ads_v5Driver: standard_E16d_v4What do you suggest here ??

  • 0 kudos
2 More Replies
Zahid-CSA
by New Contributor
  • 91 Views
  • 1 replies
  • 0 kudos

PowerBi to Databricks SQL warehouse Inactivity error on refreshing

Hello Team, we are trying to refreshing a dataset which has near about 1 billion rows and we have partiotioned it to run periodicaly and in parralel-distrubted mechansism but the refrshing is failing after hours stating inactivity time out error are ...

  • 91 Views
  • 1 replies
  • 0 kudos
Latest Reply
Slash
Contributor
  • 0 kudos

Hi @Zahid-CSA ,You can take a look at below thread, kind of similar problem. @SethParker suggested one possible solution, maybe worth a try:Re: Power BI Import Model Refresh from Databricks ... - Databricks Community - 51661

  • 0 kudos
Pranav_jha
by New Contributor II
  • 280 Views
  • 4 replies
  • 0 kudos

Unable to Login - Account Verification Loop

I'm having trouble logging in to my Databricks account at databricks.com. Here's what happens:I enter my email address and password.I receive an account verification code via email.I enter the verification code on the login page.Instead of logging me...

  • 280 Views
  • 4 replies
  • 0 kudos
Latest Reply
tinkinc
New Contributor
  • 0 kudos

did this resolve for you? 

  • 0 kudos
3 More Replies
phanisaisrir
by New Contributor
  • 90 Views
  • 1 replies
  • 0 kudos

Accessing table in Unity Catalog

What is the preferred way of accessing a UC enabled SqlWarehouse table from Databricks Spark Cluster . My requirement is to fetch the data from a sqlwarehouse table using complex queries, transform it using Pyspark notebook and save the results.But t...

  • 90 Views
  • 1 replies
  • 0 kudos
Latest Reply
filipniziol
New Contributor II
  • 0 kudos

Hi @phanisaisrir ,Use spark sql. This is the native and most integrated way to interact with data within Databricks.

  • 0 kudos
MM4
by New Contributor II
  • 114 Views
  • 2 replies
  • 1 kudos

"Data" is not available in the left hand side menu

Hi, "Data" is not showing up in the left hand side menu. I have attached the cluster to the notebook, pfa snapshot for the reference.Any idea, how can it be resolved ?  

MM4_0-1724877598621.png
  • 114 Views
  • 2 replies
  • 1 kudos
Latest Reply
MM4
New Contributor II
  • 1 kudos

Thanks for the response @Slash .Actually, I am having community edition. It seems data pane is unavailable for the community edition.

  • 1 kudos
1 More Replies
jq2024
by New Contributor II
  • 392 Views
  • 2 replies
  • 1 kudos

Resolved! I cannot curl a URL in a notebook

I tried to curl the following url in a notebook %sh curl https://staging-api.newrelic.com/graphql -v  But I got the following error message { [5 bytes data] * TLSv1.2 (OUT), TLS header, Supplemental data (23): } [5 bytes data] * TLSv1.2 (IN), TLS he...

  • 392 Views
  • 2 replies
  • 1 kudos
Latest Reply
jq2024
New Contributor II
  • 1 kudos

Thank you for the suggestion. It works

  • 1 kudos
1 More Replies
prad18
by New Contributor II
  • 563 Views
  • 6 replies
  • 2 kudos

Unity catalog implementation

Hello Databricks Community,We are in the process of planning a Unity Catalog implementation for our organization, and I'd like to seek input on some architectural decisions. We're considering various approaches to workspace separation, storage accoun...

  • 563 Views
  • 6 replies
  • 2 kudos
Latest Reply
filipniziol
New Contributor II
  • 2 kudos

Hi @prad18,I have experience working with Databricks on Azure, and here are some considerations regarding your Unity Catalog implementation:Important Consideration:The most important fact on Azure is that you can only have a single metastore per tena...

  • 2 kudos
5 More Replies
brady_tyson
by New Contributor
  • 72 Views
  • 0 replies
  • 0 kudos

Databricks Connect Vscode. Cannot find package installed on cluster

I am using Databricks Connect v2 to connect to a UC enabled cluster. I have a package I have made and installed in a wheel file on the cluster.  When using vscode to import the package and use it I get a module not found error when running cell by ce...

Community Platform Discussions
databricks-connect
package
python
VSCode
  • 72 Views
  • 0 replies
  • 0 kudos

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Top Kudoed Authors