- 2826 Views
- 2 replies
- 2 kudos
Resolved! issue on databricks bundle deploy
HiI am trying to configure Databricks Asset Bundle, but got error on deploymentDatabricks bundle init ----------- OKDatabricks bundle validate ----- OKDatabricks bundle deploy ------ Failerror : PS C:\Databricks_DABs\DABs_Init\DABS_Init> databricks b...
- 2826 Views
- 2 replies
- 2 kudos
- 2 kudos
Thank you AdvilaI was enable to enable worspace files with scrip :from databricks.sdk.core import ApiClientclient = ApiClient()client.do("PATCH", "/api/2.0/workspace-conf", body={"enableWorkspaceFilesystem": "true"}, headers={"Content-Type": "applica...
- 2 kudos
- 1609 Views
- 1 replies
- 0 kudos
How to stop access SQL AI Functions usage
Hi Guys,Recently, Databricks came up with a new feature SQL AI FunctionsIs there a way to stop users from using it without downgrading the runtime on cluster? by using Policies?Also, is there a way to stop users from using serverless, before there w...
- 1609 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @ankit001mittal! Currently, there's no direct way to disable SQL AI Functions in Databricks. To restrict the use of serverless compute, you can set up serverless budget policies that allow you to monitor and limit usage to some extent. However,...
- 0 kudos
- 15429 Views
- 6 replies
- 2 kudos
Unable to run python script from git repo in Databricks job
I'm getting cannot read python file on running this job which is configured to run a python script from git repo. Run result unavailable: run failed with error message Cannot read the python file /Repos/.internal/7c39d645692_commits/ff669d089cd8f93e9...
- 15429 Views
- 6 replies
- 2 kudos
- 2 kudos
Hi @Divya_Bhadauria, I'm facing the same internal commit issue from my end. I don't gave any internal path in the databricks workflow. I gave the source to azure DevOps services with branch name. But when I ran the workflow it gives the below error a...
- 2 kudos
- 1925 Views
- 4 replies
- 0 kudos
Adding a New Column for Updated Date in Pipeline
I've successfully set up my pipeline and everything is working fine. I'd like to add a new column to our table that records the date whenver any records got updated. Could you advise on how to go about this?
- 1925 Views
- 4 replies
- 0 kudos
- 4195 Views
- 2 replies
- 0 kudos
Optimize and Vaccum Command
Hi team,I am running a weekly purge process from databricks notebooks that cleans up chunk of records from my tables used for audit purposes. Tables are external tables. I need clarification on below items1.Should I need to run Optimize and Vacuum c...
- 4195 Views
- 2 replies
- 0 kudos
- 0 kudos
That's a valid point about minimal read queries! However, while immediate storage reduction might not be necessary, consistent data integrity and potential future reporting needs might still warrant occasional optimize and vacuuming, even with extern...
- 0 kudos
- 4277 Views
- 6 replies
- 2 kudos
Resolved! Catch Metadata Workflow databricks
Hello community,Is it possible to get metadata workflow of a databricks job that is running? Like the start time, end time, triggered by etc.? Using dbutils.widgets.get()?
- 4277 Views
- 6 replies
- 2 kudos
- 2 kudos
Now The best practice for this is not using the API (some functions were deprecated for this objective) instead you should use job parameters job_id = dbutils.widgets.get("job parameter name with job_id") job_run = dbutils.widgets.get("job parameter ...
- 2 kudos
- 2042 Views
- 2 replies
- 1 kudos
Databricks JDBC Driver Version 42 Limitations
We found that the Databricks JDBC driver does not support:Connection.setAutoCommit(false)Connection.commit()Connection.rollback()Execution of BEGIN TRANSACTIONCan you help us understand why these operations are not supported by the Databricks JDBC dr...
- 2042 Views
- 2 replies
- 1 kudos
- 1 kudos
Thank you, @SP_6721 , for your input!Could you please share an example snippet demonstrating how to handle batch processing, similar to what we typically do in a relational database?
- 1 kudos
- 16107 Views
- 5 replies
- 7 kudos
Passing proxy configurations with databricks-sql-connector python?
Hi,I am trying to connect to databricks workspace which has IP Access restriction enabled using databricks-sql-connector. Only my Proxy server IPs are added in the allow list.from databricks import sql connection = sql.connect( server_hostname ='...
- 16107 Views
- 5 replies
- 7 kudos
- 7 kudos
Is there any resolution for the above setting up proxy with databricks sql connector
- 7 kudos
- 5768 Views
- 4 replies
- 0 kudos
Resolved! How to enable Databricks Apps User Authorization?
Hi All,I am working on implementation of user authorization in my databricks app. but to enable user auth it is asking:"A workspace admin must enable this feature to be able to request additional scopes. The user's API downscoped access token is incl...
- 5768 Views
- 4 replies
- 0 kudos
- 0 kudos
Hi All, We can find this setting under Previews. Go to workspace>click your username>Previews
- 0 kudos
- 1517 Views
- 1 replies
- 0 kudos
databricks Data Engineer associate
Hi everyone , can anyone guide me about any test papers or any test materials anyone can go through for the databricks data engineer associate exam
- 1517 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @Ipshi! You can find resources for the Databricks Certified Data Engineer Associate exam in the Getting Ready for the Exam section of the exam-specific webpage on the website. This section includes a detailed list of topics covered and sample q...
- 0 kudos
- 3807 Views
- 4 replies
- 0 kudos
Blank Page after Logging In
On Feb 8 Singapore time, our Singapore workspace displayed a blank page (no interface or content) after login. Meanwhile our workspace in Tokyo reason worked normally. This lasted whole day and none of our troubleshooting yielded any clues. Then ever...
- 3807 Views
- 4 replies
- 0 kudos
- 0 kudos
After logging in, I’m getting a white screen, and it won’t load. I’ve tried clearing my cache and switching browsers, but nothing seems to work. This feels like something that really needs to be looked into. Has anyone figured out a way to fix it?
- 0 kudos
- 1267 Views
- 1 replies
- 0 kudos
feature store delta sharing
Hi, I have 2 workspaces one for data engineers and one for data science team and I need to create in data engineering workspace the bronze and silver.I want to built them a feature store should I do it from data science workspace or data engineering ...
- 1267 Views
- 1 replies
- 0 kudos
- 0 kudos
I like the idea of using Feature Store with Delta Sharing, but I’m a bit worried about its limits like no partition filtering and no streaming support. These could cause problems with performance and scaling in real situations.
- 0 kudos
- 9941 Views
- 12 replies
- 0 kudos
Permission issue in Fundamentals of the Databricks Lakehouse Platform Quiz
Hi ,I am getting this Error,when i am trying to give the exam ofFundamentals of the Databricks Lakehouse Platform.403FORBIDDENYou don't have permission to access this page2023-05-20 12:37:41 | Error 403 | https://customer-academy.databricks.com/I al...
- 9941 Views
- 12 replies
- 0 kudos
- 0 kudos
Hello, everyone! We are sorry to hear you're having trouble accessing the Quiz. Please note that the Lakehouse Fundamentals course has been replaced by Databricks Fundamentals along with the updated content.Try logging into your account directly by u...
- 0 kudos
- 1652 Views
- 1 replies
- 0 kudos
Delta Live Table (Streaming Tables) for excel (.xlsx, .xls)
What's the native way to ingest excel files using a streaming table? I wish that when the excel files land in unity catalog, it can pick up those and load it in to the Streaming Table. Data is Small, so we can afford some kind of UDF, but we really n...
- 1652 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @NathanC0926 Ingesting Excel files with streaming tables requires a combination of Databricks Autoloader(for file discovery and exactly-once processing) and a custom UDF for Excel parsing.Here's the native approachKey Features of This Solution1. E...
- 0 kudos
- 2081 Views
- 3 replies
- 1 kudos
Notebook ID in DESCRIBE HISTORY not showing
We've recently installed Databricks 14.3 LTS with Unity Catalog and for some reason that is escaping me the Notebook Id is not showing up when I execute the DESCRIBE HISTORY SQL command. Example below for table test_catalog.lineagedemo.lm_lineage_tes...
- 2081 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @RameshRetnasamy first off thank you so much for taking the time to reply to my question. In my case they were indeed created via Notebooks, but I'll re-evaluate on my end as I might've missed something. If the issue persists, I'll re-assert the q...
- 1 kudos
| User | Count |
|---|---|
| 1645 | |
| 793 | |
| 582 | |
| 349 | |
| 287 |
