cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Madalian
by New Contributor III
  • 2282 Views
  • 0 replies
  • 0 kudos

Adding new field to Delta live Table

Hi Experts,I have on Bronze layer all delta merge files (Parquet) format.I am converting these files into delta live tables in silver layer. While doing so, I am unable to add current time stamp column.Following is the script:from pyspark.sql.functio...

  • 2282 Views
  • 0 replies
  • 0 kudos
Praveen587
by New Contributor III
  • 2327 Views
  • 2 replies
  • 0 kudos

Unable to Spin a cluster in community Edition

Bootstrap Timeout:Node daemon ping timeout in 780000 ms for instance i-0943508bf00d6e86f @ 10.172.185.100. Please check network connectivity between the data plane and the control plane.

  • 2327 Views
  • 2 replies
  • 0 kudos
Latest Reply
Praveen587
New Contributor III
  • 0 kudos

Hi Kaniz,It seems issue is with all community Edition accounts. Can you please look into it.

  • 0 kudos
1 More Replies
crvkumar
by Databricks Partner
  • 2452 Views
  • 1 replies
  • 0 kudos

AWS Firewall Websocket Settings

Hello,Our architecture has customer-managed VPC which sits behind the AWS Firewall. I followed the databricks documentation and I created a stateful domain rule group for .cloud.databricks.com but I am not clear about creating outbound Websocket open...

  • 2452 Views
  • 1 replies
  • 0 kudos
evgvain
by New Contributor II
  • 12942 Views
  • 2 replies
  • 3 kudos

Read notebooks programmatically from databricks python notebook

I need programmatically read the content of the specific notebook in my databricks workspace from another notebook in the same workspace. Following the databricks documentation, I extract the path to my notebook and then list all other notebooks in t...

Get Started Discussions
databrickas
ipython
jupyter
  • 12942 Views
  • 2 replies
  • 3 kudos
Latest Reply
evgvain
New Contributor II
  • 3 kudos

I was able to do this by using databricks.sdk.WorkspaceClient. However, I looks like a workaround. I would prefer to read the content of notebooks directly.databricksURL = dbutils.notebook.entry_point.getDbutils().notebook().getContext().apiUrl().get...

  • 3 kudos
1 More Replies
Ahk
by New Contributor
  • 1544 Views
  • 1 replies
  • 0 kudos

Uanble to connect to a cluster on Databricks community version

I've been trying out the Databricks Community Edition, Every time I try to connect to a cluster I'm getting one of the following 2 errorsBootstrap Timeout:Node daemon ping timeout in 780000 ms for instance i-04d14165ecb322e53 @ 10.172.223.53. Please ...

  • 1544 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ajay-Pandey
Databricks MVP
  • 0 kudos

Hi @Ahk This is mostly internal error with databricks, this will resolve within a day

  • 0 kudos
manuel_john
by New Contributor II
  • 1517 Views
  • 0 replies
  • 0 kudos

Bootstrap Timeout

Bootstrap Timeout:Node daemon ping timeout in 780000 ms for instance i-04258dad0f5aff74e @ 10.172.249.26. Please check network connectivity between the data plane and the control plane. I'm getting this error when trying to start my CE cluster. Does ...

  • 1517 Views
  • 0 replies
  • 0 kudos
_raman_
by New Contributor III
  • 2173 Views
  • 0 replies
  • 2 kudos

ERROR WHILE CREATING CLUTER IN COMMUNITY VERSION

From past two hours i am trying to create a cluster but it is getting failed after trying of 15-20 minutes.the red sign is coming after the cluster name which says that : Bootstrap Timeout:Node daemon ping timeout in 780000 ms for instance i-05ff43bc...

  • 2173 Views
  • 0 replies
  • 2 kudos
Sid1805
by New Contributor II
  • 3798 Views
  • 2 replies
  • 0 kudos

Azure Databricks SQL Execution API Authentication

Hi Team,If a cloud application wants to read some data from Databricks we realize that Azure Databricks can expose its Tables via REST API.For its authentication what is the most recommended method - I see we can have PAT token tagged to a Service Pr...

  • 3798 Views
  • 2 replies
  • 0 kudos
Latest Reply
Ramakrishnan83
New Contributor III
  • 0 kudos

Hi @Sid1805 ,I am in the same situation as you. I am looking for guidance how to setup the authentication for REST API to connect with Databricks SQL. I started with PAT and used  the user id as "token" and pwd as PAT Token to connect with Databricks...

  • 0 kudos
1 More Replies
juanchochuy
by New Contributor
  • 6388 Views
  • 1 replies
  • 1 kudos

How Connect Powerbi with sql endpoint with no public access only private?

 we are making configuration adjustments in the workspaces to disable public access. My concern is whether this will impact the Power BI dashboards that currently consume data from our workspace's SQL Data Warehouse. 

Get Started Discussions
Endpoint SQL
PowerBI
Public Access
  • 6388 Views
  • 1 replies
  • 1 kudos
Latest Reply
gmiguel
Databricks Partner
  • 1 kudos

If you're using Azure Databricks, you can create a vnet data gateway on Azure.https://learn.microsoft.com/en-us/data-integration/vnet/create-data-gatewayshttps://learn.microsoft.com/en-us/data-integration/vnet/high-availability-load-balancingYou need...

  • 1 kudos
KVK
by New Contributor II
  • 1193 Views
  • 0 replies
  • 0 kudos

Unable to reset my Community edition password

I created a new Databricks community account a few days ago. Unfortunately, I seem to have forgotten the password associated with it. Despite trying the "forgot password" option multiple times on the login page, I haven't received any emails to reset...

  • 1193 Views
  • 0 replies
  • 0 kudos
Surajv
by New Contributor III
  • 4407 Views
  • 2 replies
  • 0 kudos

Limit the scope of workspace level access token to access only specific REST APIs of Databricks

Hi Community, Is there a way to limit the scope of workspace level token to hit only certain REST APIs of Databricks.In short, Once we generate a workspace level token following this doc. Link: https://docs.databricks.com/en/dev-tools/auth/oauth-m2m....

  • 4407 Views
  • 2 replies
  • 0 kudos
Latest Reply
Surajv
New Contributor III
  • 0 kudos

 <Replied to previous message as response to @Retired_mod's answer> 

  • 0 kudos
1 More Replies
Subratpanigrahi
by New Contributor II
  • 2195 Views
  • 0 replies
  • 0 kudos

Unity catalog unable to identify Managed Identity

Hello all,We have encountered a problem while running a notebook on a unity catalog cluster by using Azure data factory managed identity. When we add the managed identity directly to the unity catalog table it’s working but if we add the managed iden...

  • 2195 Views
  • 0 replies
  • 0 kudos
Ruby8376
by Valued Contributor
  • 1817 Views
  • 1 replies
  • 0 kudos

Function/system id for tableau databricks connector

currently, we are using PAT token for authentication purposes to generate tableau reports form data in databricks delta tables using databricks tableau connector. Would somebody know if system/function ID can be used from Tableau to  Databricks inste...

  • 1817 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ruby8376
Valued Contributor
  • 0 kudos

@-werners- @Retired_mod can you help here plz?

  • 0 kudos
Ruby8376
by Valued Contributor
  • 4034 Views
  • 3 replies
  • 1 kudos

Resolved! Can data be unified based on client profile (unified profile) in databricks?

Hi All,my question is in regard to how data in salesforce data cloud gets unified based on client profiles. Can similar action be done on data in databricks. i believe unity catalog just provides unified layer for security and governance. is there a ...

  • 4034 Views
  • 3 replies
  • 1 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 1 kudos

You want to identify actual persons based on one or more profiles (based on e-mail address etc).  That is something that is not available out-of-the box in Databricks.  The 'unified' in Databricks means you have a single platform for several data top...

  • 1 kudos
2 More Replies
Labels