- 1824 Views
- 1 replies
- 1 kudos
API to get Databricks Status AWS.
Hi, Do you have an api endpoint to call to get the databricks status for AWS?Thanks,
- 1824 Views
- 1 replies
- 1 kudos
- 1 kudos
@Chinu Lee​ you have webhook/slack that can be used to fetch status https://docs.databricks.com/resources/status.html#webhookare you specifically looking for your account workspace/above one
- 1 kudos
- 2322 Views
- 1 replies
- 3 kudos
Create (account wide) groups without account admin permissions
The use case is quite simple: each environment - databricks workspace (prod, test, dev) will be created by a separate service principal (which for isolation purpose should not have account wide admin permission) with terraform, but will belong to the...
- 2322 Views
- 1 replies
- 3 kudos
- 3 kudos
Another thing would be also to assign workspace to a metastore without account admin permission - for similar reason.
- 3 kudos
- 9483 Views
- 6 replies
- 2 kudos
Resolved! Delta Sharing - Unity Catalog difference
Delta Sharing and Unity catalog both have elements of data sharing. Can you please explain when one would use Delta sharing vs Unity Catalog?
- 9483 Views
- 6 replies
- 2 kudos
- 2 kudos
Based on the Databricks reply from the post below: "Unity Catalog does not currently support separating data by workspace or Azure subscription. As you noted, data from all catalogs within a region can be accessed by any workspace within that region,...
- 2 kudos
- 9255 Views
- 7 replies
- 9 kudos
Can't able to run following queries
I cannot able to run following queriesALTER TABLE iot_events ADD ATTRIBUTE pii ON emailALTER TABLE users ADD ATTRIBUTE pii ON phoneGRANT SELECT ON DATABASE iot_data HAVING ATTRIBUTE NOT IN (pii) TO product_managersand GRANT SELECT ON iot_events TO ...
- 9255 Views
- 7 replies
- 9 kudos
- 9 kudos
@Kaniz Fatma​ can anyone from data Bircks help on why attribute-based access control function is not working in unity catalog @Rahul Mishra​ below commands ALTER TABLE iot_events ADD ATTRIBUTE pii ON emailALTER TABLE users ADD ATTRIBUTE pii ON phoneG...
- 9 kudos
- 6112 Views
- 1 replies
- 2 kudos
Resolved! The Jupiter note-book doesn't update imports after updating the .py file
Please help. Here's an example:I have one .py file and one .ipynb, and the .py file contains the test function, but after adding the new function test1, it doesn't appear in .ipynb. Even after re-running the .py file and reimporting it in .ipynb. How...
- 6112 Views
- 1 replies
- 2 kudos
- 2 kudos
%load_ext autoreload%autoreload 2
- 2 kudos
- 2417 Views
- 1 replies
- 0 kudos
clickfortranslation.com
What are the Different Types of Industry Specific Translation Services Manual ?GET TO KNOW MORE CLICK THE LINK BELOW.https://clickfortranslation.com/manual-translation.php
- 2417 Views
- 1 replies
- 0 kudos
- 0 kudos
Do you provide all types of industry-specific translation services? I'm asking because many translation companies pretend to provide all industry-specific translation services, but the final result is far from being a qualitative and professional one...
- 0 kudos
- 3473 Views
- 2 replies
- 2 kudos
Does anyone run Databricks jobs using Docker + ARM (Graviton) instances?
Graviton instances do not support Container services on paper (https://docs.databricks.com/clusters/graviton.html#unsupported-features) but if you try to build Docker ARM image and run it on Graviton, it will work. Does anyone use this combination in...
- 3473 Views
- 2 replies
- 2 kudos
- 2 kudos
Graviton is not supported by Databricks Container Services. How are you planning to run it on Databricks? Please tag @Debayan​ with your next comment so that I will get notified. Thank you!
- 2 kudos
- 10624 Views
- 2 replies
- 2 kudos
Resolved! How to resolve SAT driver errors
I was able to follow the SAT setup instructions, but ran into the same error whether I ran it "manually" or via terraform. The initialization seemed to run fine. Can anyone suggest any steps to troubleshoot this?
- 10624 Views
- 2 replies
- 2 kudos
- 2 kudos
Thanks - I also spoke with Arun, who was very helpful. Our databricks admin users all require an okta login, which is causing the error. We're looking into a "break glass" admin user for this purpose.
- 2 kudos
- 8399 Views
- 5 replies
- 4 kudos
Is there a way to clone job cluster or edit cluster using JSON?
I've created workflow job (let say job A) and set up job cluster configuration for it.Now I want to create another workflow job (job B) but use almost the same settings for job cluster.I can see cluster settings in JSON (for both jobs) but I can't ed...
- 8399 Views
- 5 replies
- 4 kudos
- 4 kudos
Also you can use terraform exporter with -match flag to get a .tf definition for a job A. Once initialized, you can define job B.Another option is to use dbx
- 4 kudos
- 4406 Views
- 1 replies
- 1 kudos
IDENTITY column duplication when using BY DEFAULT parameter
Hi, I created delta table with identity column using this syntax:Id BIGINT GENERATED BY DEFAULT AS IDENTITYMy steps:1) Created table with Id using syntax above.2) Added two rows with Id = 1 and Id = 2 (BY DEFAULT allows to do that).3) Run Insert (wit...
- 4406 Views
- 1 replies
- 1 kudos
- 1 kudos
Use below alter command to sync the identity column.alter table table_name change column col_name sync identity
- 1 kudos
- 3029 Views
- 3 replies
- 0 kudos
databricks-connect in Azure DevOps Pipeline jobs runs not showing on remote cluster
Hi Team,I am trying to run Azure DevOps pipeline as mentioned in the blog below.​​https://benalexkeen.com/unit-testing-with-databricks-part-2/​The pipeline is running successfully however I am not able to see any runs in remote cluster.​Does databric...
- 3029 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Rey Jhon​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your...
- 0 kudos
- 2478 Views
- 2 replies
- 1 kudos
DataBricks Extension on Azure using SPN
Is there any extension for deploying Databricks in Azure DevOps using SPN?
- 2478 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Amadin Naomi​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers ...
- 1 kudos
- 1118 Views
- 0 replies
- 2 kudos
community.databricks.com
We're excited to announce the first four winners of our Raffle, and we want to thank everyone who has participated so far. If you haven't yet entered, don't worry! We still have four more tickets to give away for the world's largest Data + AI summit...
- 1118 Views
- 0 replies
- 2 kudos
- 7306 Views
- 3 replies
- 5 kudos
Databricks Job run logs only shows prints/logs from driver and not executors
Hi,​In Databricks Job run output, only logs from driver are displayed. We have a function parallelized to run on executor nodes. The logs/prints from that function are not displayed in job run output. Is there a way to configure and show those logs i...
- 7306 Views
- 3 replies
- 5 kudos
- 5 kudos
Thanks @Debayan Mukherjee​ . This is to enable executor logging. However, the executor logs do not appear in Databricks Job run output. Only driver logs are displayed.
- 5 kudos
- 16643 Views
- 10 replies
- 12 kudos
Limitations with UDFs wrapping modules imported via Repos files?
We have been importing custom module wheel files from our AzDevOps repository. We are pushing to use the Databricks Repos arbitrary files to simplify this but it is breaking our spark UDF that wraps one of the functions in the library with a ModuleNo...
- 16643 Views
- 10 replies
- 12 kudos
- 12 kudos
If your notebook is in the same Repo as the module, this should work without any modifications to the sys path.If your notebook is not in the same Repo as the module, you may need to ensure that the sys path is correct on all nodes in your cluster th...
- 12 kudos
| User | Count |
|---|---|
| 1644 | |
| 793 | |
| 573 | |
| 349 | |
| 287 |
