cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Anusha95
by New Contributor II
  • 127 Views
  • 2 replies
  • 0 kudos

Filtering output dataset using parameter values from different dataset

Hi Team, I am trying to build dynamic dashboard for which I have created 2 dataset and I am passing values from 1st dataset to 2nd dataset as parameter. When an user selects parameter values of 1st dataset, 2nd dataset should use those user input val...

  • 127 Views
  • 2 replies
  • 0 kudos
Latest Reply
Walter_C
Honored Contributor
  • 0 kudos

Here are a few suggestions: Ensure that your query in the second dataset is correctly set up to accept and use the parameters from the first dataset. The parameters should be correctly mapped to the catalog, schema, and table name in your "select * ...

  • 0 kudos
1 More Replies
FerArribas
by Contributor
  • 607 Views
  • 1 replies
  • 1 kudos
  • 607 Views
  • 1 replies
  • 1 kudos
Latest Reply
jacovangelder
Contributor III
  • 1 kudos

There is no distinction to make, it's VM's and you can't choose. Databricks SQL Serverless Warehouses uses K8s under the hood though. 

  • 1 kudos
wellington
by New Contributor III
  • 728 Views
  • 2 replies
  • 0 kudos

Log notebook activities

Hi friends;I'm working on a project where we are 4 programmers. We are working in a single environment, using only the "Workspaces" folder. Each has its own user, which is managed by Azure AD.We had a peak in consumption on the 5th Feb. So I can see ...

  • 728 Views
  • 2 replies
  • 0 kudos
Latest Reply
wellington
New Contributor III
  • 0 kudos

Hi @Kaniz_Fatma , thanks for your quick answer.There is no other way to monitor notebook runs. I ask this because adding tags to the cluster and workspace does not solve my problem, considering that everyone uses the same cluster and the same workspa...

  • 0 kudos
1 More Replies
Lucidity
by New Contributor II
  • 11951 Views
  • 3 replies
  • 1 kudos

Resolved! Deny assignment modification to allow attach/detach of disks in azure databricks

Our application does storage autoscaling on Azure. We would like to deploy our solution with Azure databricks. But even though the service principal associated with our application has the necessary roles and permissions to attach/detach a disk from ...

  • 11951 Views
  • 3 replies
  • 1 kudos
Latest Reply
Lucidity
New Contributor II
  • 1 kudos

Thank you for your replyIs there any way databricks provides to bypass the deny assignment for specific apps? I noticed in the deny assignment unity-catalog-access-connector has been provided exlusion under the excludePrincipals section. is there a w...

  • 1 kudos
2 More Replies
Data_Engineer3
by Contributor II
  • 2251 Views
  • 2 replies
  • 0 kudos

Resolved! spark context in databricks

Hi @all,In Azure Databricks,I am using structured streaming for each batch functionality, in one of the functions I am creating tempview with pyspark dataframe (*Not GlobalTempView) and trying to access the same temp view by using spark.sql functiona...

  • 2251 Views
  • 2 replies
  • 0 kudos
Latest Reply
Lakshay
Esteemed Contributor
  • 0 kudos

Do you face this issue without spark streaming as well? Also, could you share a minimal repo code preferably without streaming?

  • 0 kudos
1 More Replies
valjas
by New Contributor III
  • 3087 Views
  • 3 replies
  • 1 kudos

Clusters are really slow

We have two environments for our Azure Databricks. Dev and Prod. We had clusters created and tested in Dev environment, then they were exported to the prod environment through APIs. The clusters in Dev are performing as expected. Whereas, the cluster...

  • 3087 Views
  • 3 replies
  • 1 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 1 kudos

Hi @valjas, Workspace Creation and Cluster Performance: Actions taken during the creation of a workspace can indeed impact cluster performance. When setting up a workspace, consider the following factors: Configuration Settings: Ensure that the wor...

  • 1 kudos
2 More Replies
wellington
by New Contributor III
  • 5654 Views
  • 3 replies
  • 2 kudos

Resolved! Not able to access Account console page

Hello All,I'm not be able to access the account console page. I'm a portal admin, my workspace is premium, and yet the Databricks portal stays in a loop, always returning to the Workspaces Overview page and not going to the accounts console page so t...

Get Started Discussions
Account Console
Account Management
  • 5654 Views
  • 3 replies
  • 2 kudos
Latest Reply
wellington
New Contributor III
  • 2 kudos

Guys, the problem is that I was not signed in as a Global Administrator in Azure AD. After that, I reset all the Browser settings and I was able to do that. Here's the tip.

  • 2 kudos
2 More Replies
Farzana
by New Contributor II
  • 9092 Views
  • 3 replies
  • 0 kudos

Databricks cluster launch time

Hi Team,We have an @adf pipeline which will run some set of activities before #Azure databricks notebooks get called.As and when the notebooks are called our pipeline will launch a new cluster for every job with job compute as Standard F4 with a sing...

  • 9092 Views
  • 3 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @Farzana , If the cluster pool has enough idle instances and the slow image download from the artefact storage is not the issue, then a few things can be done to reduce the cluster launch time. Preload the runtime on the instance pool to improve t...

  • 0 kudos
2 More Replies
Ajay-Pandey
by Esteemed Contributor III
  • 2320 Views
  • 3 replies
  • 0 kudos

Databricks Pub-Sub Data Recon

I am trying to setup a recon activity between GCP Pub-Sub and databricks, Is there any way to fetch the last 24hrs record count from Pub-Sub?I tried but not got any direct solution for it, It will be great if any one can suggest me the way t#pubsub, ...

  • 2320 Views
  • 3 replies
  • 0 kudos
Latest Reply
Anonymous
Not applicable
  • 0 kudos

Hi @Ajay-Pandey  Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too. Cheers!

  • 0 kudos
2 More Replies
Labels