- 1021 Views
- 1 replies
- 1 kudos
How to get a list of users in a workspace with Account Level APIs
Hi There,We are planning to move to Unity Catalog soon so started replacing workspace API with Account Level APIs. One use case I have is getting a list of users, pretty straight forward with workspace:{workspaceUrl}api/2.0/preview/scim/v2/Users?coun...
- 1021 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @unseen007 ,To get a list of all users in a given workspace, you should use api/2.0/preview/scim/v2/Users api endpoint. Why do you assume this API is inappropriat? Unity Catalog has nothing to do with this. One API let's you list user at account l...
- 1 kudos
- 1475 Views
- 1 replies
- 1 kudos
Resolved! Task runs missing from system database
I have a workflow with 11 tasks (each task executes one notebook) that run in sequence. The task was run on 9/1 and again today (9/10). I am working reporting task history and status using system table `system.lakeflow.job_task_run_timeline`. The...
- 1475 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @DavidKxx ,There are chances that the table has not been updated today.Check tomorrow.Here what the documentation says:
- 1 kudos
- 4333 Views
- 2 replies
- 0 kudos
Resolved! exclude (not like) filter using pyspark
I am trying to exclude rows with a specific variable when querying using pyspark but the filter is not working. Similar to the "Not like" function in SQL. e.g. not like '%var4%'. The part of the code that is not working is: (col('col4').rlike('var...
- 4333 Views
- 2 replies
- 0 kudos
- 1763 Views
- 3 replies
- 2 kudos
Resolved! Curl command working in 12.2 but not in 13.3
Hello, one my teammate is trying to put some obversability on our Databricks flows.When he tries to contact our Open Telemetry server, he gets a timeout.I had a look, and the same command (on the same Databricks workspace) works well with runtime 12....
- 1763 Views
- 3 replies
- 2 kudos
- 2 kudos
Hello,thank you for your answer.I tried to update library version and it was almost the solution.It realized it neither works in 12.2 but the output was pretty different and it misled me.Probably a network config to set up in the target server.
- 2 kudos
- 603 Views
- 0 replies
- 0 kudos
show document name in AI agent
Hi everyone!I have successfully deployed the Review App of my AI agent following those instructions: Create and log AI agents | Databricks on AWSHowever, one question came up regarding the sources (names). To be precise, is there a possibility to sho...
- 603 Views
- 0 replies
- 0 kudos
- 8599 Views
- 10 replies
- 10 kudos
Resolved! how to include checkboxes in markdown cells in databricks notebook
Hi has anyone else tried to include checkboxes in markdown cells in databricks notebook?I believe I followed the correct way for checkbox: - [ ] and - [x]but the result I got is still no checkboxes.Please help! Thanks! %md #to do: - [x] static vari...
- 8599 Views
- 10 replies
- 10 kudos
- 10 kudos
Hi @teaholicI faced the same problem and found the ✓ and ✗ notation that did work for me. Hope that helps.
- 10 kudos
- 6749 Views
- 11 replies
- 4 kudos
Resolved! Unity catalog implementation
Hello Databricks Community,We are in the process of planning a Unity Catalog implementation for our organization, and I'd like to seek input on some architectural decisions. We're considering various approaches to workspace separation, storage accoun...
- 6749 Views
- 11 replies
- 4 kudos
- 4 kudos
Hi @prad18 ,I'm glad the previous response was helpful! Let's address your remaining questions:Cost Differences Between Single vs. Multiple Azure Storage Accounts: The cost difference between using a single Azure storage account for both Unity Catalo...
- 4 kudos
- 550 Views
- 0 replies
- 0 kudos
API Results filename have tomorrow's date
Hi, I'm downloading data in chunks using API api/2.0/preview/sql/queries Today I've realized hat, the chunks have different date.. For example results_2024-09-10T10_30_32Z_acf798b5-2a5c-474f-a3b0-b83a2a8eb35a.csv I'm in the UTC timezone, I know that...
- 550 Views
- 0 replies
- 0 kudos
- 8706 Views
- 9 replies
- 1 kudos
GeoPandas Insall
hi,I cannot install geopandas in my notebook, ive tried all different forms of generic fix, pip installs etc but always get this error:CalledProcessError: Command 'pip --disable-pip-version-check install geopandas' returned non-zero exit status 1.---...
- 8706 Views
- 9 replies
- 1 kudos
- 1 kudos
@brian999 - Conda is subjected to commercial licensing. Referenced here: https://docs.databricks.com/en/archive/legacy/conda.html
- 1 kudos
- 455 Views
- 0 replies
- 0 kudos
Free voucher awaited
Hi team , I cleared datalake fundamentals exam attended webinar and completed survey ( my id s100rab@gmail.com ) when can I expect voucher
- 455 Views
- 0 replies
- 0 kudos
- 469 Views
- 0 replies
- 0 kudos
Googles finds databricks community topics but databricks community search does not
Every time I ask Google a Databricks question, and a link comes up to this community, and I click the link, it goes right to the topic and I get to read the question and the answer. But then a pop-up appears asking me to login to the community. Since...
- 469 Views
- 0 replies
- 0 kudos
- 1235 Views
- 0 replies
- 2 kudos
Survey about Databricks
Hi everyone, I hope you are very well.In the research for my university we are conducting a survey to Databricks users, aimed to gather information about how cluster configuration and optimization is faced in the industry.If you like you can answer i...
- 1235 Views
- 0 replies
- 2 kudos
- 1598 Views
- 1 replies
- 0 kudos
DLT Pipeline Issue with New Version of Advanced Data Engineering with Databricks training
I am currently taking the new Advanced Data Engineering with Databricks training. I am stuck in the Demo: Auto Load to Bronze section of Streaming ETL Patterns with DLT. Looks to be an access issue to AWS as the pipeline errors out with the following...
- 1598 Views
- 1 replies
- 0 kudos
- 3705 Views
- 3 replies
- 0 kudos
Resolved! Databricks Cluster job failure issue
Jobs within the all purpose DB Cluster are failing with "the spark driver has stopped unexpectedly and is restarting. Your notebook will be automatically reattached"In the event log it says "Event_type=DRIVER_NOT_RESPONDING & MESSAGE= "Driver is up b...
- 3705 Views
- 3 replies
- 0 kudos
- 0 kudos
just now there is one cluster issuecluster error: Driver is unresponsive likely due to GCcluster conf:worker: Standard_D8ads_v5Driver: standard_E16d_v4What do you suggest here ??
- 0 kudos
- 1323 Views
- 1 replies
- 0 kudos
PowerBi to Databricks SQL warehouse Inactivity error on refreshing
Hello Team, we are trying to refreshing a dataset which has near about 1 billion rows and we have partiotioned it to run periodicaly and in parralel-distrubted mechansism but the refrshing is failing after hours stating inactivity time out error are ...
- 1323 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Zahid-CSA ,You can take a look at below thread, kind of similar problem. @SethParker suggested one possible solution, maybe worth a try:Re: Power BI Import Model Refresh from Databricks ... - Databricks Community - 51661
- 0 kudos
