- 1660 Views
- 2 replies
- 2 kudos
All I could find in terms of API bindings for python is https://pypi.org/project/databricks-cli/, and this does not include the Account API and it is also not official.I will just use the OpenAPI spec, but just want to be sure I'm not doing unnecessa...
- 1660 Views
- 2 replies
- 2 kudos
Latest Reply
@Iwan Aucamp : Yes, there are Python API bindings available for the Databricks Account API.For Databricks Account API with Python, please refer to the Databricks documentation: https://docs.databricks.com/dev-tools/api/latest/accounts.html#python-ap...
1 More Replies
- 2004 Views
- 1 replies
- 2 kudos
We will be given an excel file, in which we can see column sender_city and destination_city. We have to find the distance between these two cities and the distance calculated should be written in a column total_distance. All these processes should be...
- 2004 Views
- 1 replies
- 2 kudos
Latest Reply
sher
Valued Contributor II
heywithout using latitude and longitude it is hard to find out but you can try some distance-based algorithm
- 2629 Views
- 4 replies
- 6 kudos
Hello ,For a support request, Microsoft support ask me to add spark.databricks.driver.strace.enabled trueto my cluster configuration.MS was not able to send me a link to the documentation and I did not find it on the databricks website.Can someone he...
- 2629 Views
- 4 replies
- 6 kudos
Latest Reply
Yes no problem. I have a python program, called "post ingestion", that run on a databricks job cluster during the night and consist of :inserting data to a deltalake tableexecuting an optimize command on that tableexecuting a vacuum command on that t...
3 More Replies
- 2452 Views
- 1 replies
- 1 kudos
My Solutions Architect is asking for my workspaceID. I do not know where to look for it. All I see is the user settings menu.
- 2452 Views
- 1 replies
- 1 kudos
Latest Reply
The workspaceID is usually in the URL of the workspace. For example:https://myworkspace.com/?o=12345The workspace id in this case is 12345. You can also just share the URL with your solutions architect.
- 7842 Views
- 11 replies
- 5 kudos
Dear connections,I'm unable to run a shell script which contains scheduling a Cron job through init script method on Azure Data bricks cluster nodes.Error from Azure Data bricks workspace:"databricks_error_message": "Cluster scoped init script dbfs:/...
- 7842 Views
- 11 replies
- 5 kudos
Latest Reply
Hello @Sugumar Srinivasan Could you please enable cluster log delivery and inspect the INIT script logs in the below path dbfs:/cluster-logs/<clusterId>/init_scripts path.https://docs.databricks.com/clusters/configure.html#cluster-log-delivery-1
10 More Replies
- 3530 Views
- 1 replies
- 0 kudos
I had a cluster that I used in the past. I do not see the cluster any longer. I checked with the admin and my team and everyone confirmed that there no user deletion.
- 3530 Views
- 1 replies
- 0 kudos
Latest Reply
If the cluster is unsued for 30 days, Databricks removes the cluster. This is a general clean-up policy. It's possible to whitelist a cluster from this clean-up by Pinning the cluster. https://docs.databricks.com/clusters/clusters-manage.html#pin-a-c...
- 1984 Views
- 1 replies
- 0 kudos
Looking to pull a list of all the users in their workspaces (including the ones who have never done anything), is there a way to do that? This for AWS
- 1984 Views
- 1 replies
- 0 kudos
Latest Reply
You can use the SKIM APIs. Endpoint: https://docs.databricks.com/dev-tools/api/latest/scim/scim-users.html#get-users Or you can use the Workspace API. The workspace API does not have a direct list users command, but you can use the workspace API to l...
- 6979 Views
- 1 replies
- 1 kudos
My team and I were using a cluster for some days and it disappeared without any apparent reason. I recreate the cluster, but after some days it disappeared again. Do you know why my cluster disappeared? how to avoid that?
- 6979 Views
- 1 replies
- 1 kudos
Latest Reply
A cluster is deleted after 30 days after a cluster is terminated. To keep an all-purpose cluster configuration even after a cluster has been terminated for more than 30 days, an administrator can pin the cluster. Up to 70 clusters can be pinned.To av...