Hello,I would like to ask a question regarding user permissions.Currently, all team members are admins. Recently, we plan to change the admin roles so that only I and another user, A, will be admins. The other members will retain general usage permis...
Hello,I would like to ask a question regarding user permissions:In a situation where all team members are admins, is it possible to restrict access to a specific notebook in Databricks so that only I can view and write it?Thank you
Hi @weilin0323 ,If Worskspace Access Control is enabled, you are able to manage access to directories and individual notebooks, so you will be able to remove the access, but since all the other users are admins, they will be able to grant access to t...
Hello,I successfully installed the extension and connected it to my databricks account. But when I try to select the repo (which already exists under repos in my databricks repo account) for syncing , I don't see it.I use Azure Devops (Git repo) as s...
I think the building spinner can be confusing - we are looking at improving that experience. Did the cell-by-cell execution work for you now?
I’m currently working on a project using Delta Lake on Databricks and would like to optimize performance for both batch and streaming workloads.
Hi @joshbuttler ,It's a big topic and it really depends on the use case. You can follow some guides/recommendations from databricks documentation:- Optimization recommendations on Databricks | Databricks on AWS- Use liquid clustering for Delta tables...
I'm trying to connect to the Databricks cluster from the Excel using ODBC and following this official guide:https://docs.databricks.com/en/integrations/excel.html#connect-from-microsoft-excelBut the authentication is always failing, returning "500 In...
Hi @Vadimalk ,Could you check if you have following options enabled in simba driver configuration:
Hi I would like to learn databricks so that I could look for job opportunities as a ML engineer. I have background with python programming, computer vision (OpenCV) .not having much of experience with azure , aws so on.which course here is good with ...
Hi everyone,I’m having trouble with a query in Databricks. My code seems correct, but I’m getting unexpected results. Can anyone help me troubleshoot this or provide tips for debugging in Databricks?Thanks in advance! locksmith
It's hard to advice when you didn't provide any code. But you can try to use debugger inside notebook:
Hello, I would like to change the Metastore location in Databricks Account Console. I have one metastore created that is in an undesired container/storage account. I could see that it's not possible to edit a metastore that is already created. I coul...
We ended up 1) deleting the metastore (which only contained catalogs/schemas/tables), 2) creating a new one in the desired storage account and 3) re-populating it by running all Delta Live Tables pipeline. All our underlying raw data is stored in ano...
Hello,I’m looking for study materials or resources to help me learn Databricks more effectively. Any recommendations would be greatly appreciated!
@igor779, @Rishabh-Pandey and @szymon_dybczak .Thank you all for the suggestions! Unfortunately, I don’t have access to content from partner companies and mainly rely on free resources for my studies.
Hello Databricks Team,I understand that the mask function can be used to mask columns, but I have a few questions:When users with access use a masked TABLE to create a downstream TABLE, the downstream TABLE does not inherit the mask function directly...
Hi @weilin0323, How are you doing today?As per my understanding, When creating a downstream table from a masked table, you’ll need to reapply the mask function to the necessary columns in the new table if you want to maintain the same level of data p...
Hi has anyone else tried to include checkboxes in markdown cells in databricks notebook?I believe I followed the correct way for checkbox: - [ ] and - [x]but the result I got is still no checkboxes.Please help! Thanks! %md #to do: - [x] static vari...
Hi @teaholicI faced the same problem and found the ✓ and ✗ notation that did work for me. Hope that helps.
Hi, seeing this on all new clusters (single or multi-node) I am creating. As soon as the metrics start showing up, the memory consumption shows 90% already consumed between Used and Cached (something like below). This is the case with higher or lower...
Hi, I'm downloading data in chunks using API api/2.0/preview/sql/queries Today I've realized hat, the chunks have different date.. For example results_2024-09-10T10_30_32Z_acf798b5-2a5c-474f-a3b0-b83a2a8eb35a.csv I'm in the UTC timezone, I know that...
Hi im trying to connect to Databricks using the mulesoft database connector, using databricks JDBC, I already connect using personal access token, but i need to use OAuth2 M2M, and only return a error 500151 Invalid local Address:org.mule.runtime.api...
Assuming you followed the guide (https://learn.microsoft.com/en-us/azure/databricks/integrations/jdbc/authentication#--oauth-machine-to-machine-m2m-authentication), is it possible your workspace uses private link?because that won't work.Also: only Da...
When running a Databricks notebook,an error occurs stating that SOME_TABLE is not a Delta table.However, after executing the describe detail command and checking the format,the table is shown as Delta.Without taking any specific actions, re-running ...
