- 10032 Views
- 2 replies
- 2 kudos
Databricks Asia-Pacific LLM Cup 2023 - So you think you can hack?
You are invited to participate in Databricks Asia-Pacific LLM Cup 2023, an exciting virtual hackathon which kicks off in the month of October. Businesses across Asia-Pacific and Japan will have the opportunity to build, iterate and polish your LLM id...
- 10032 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi! This sounds like a great opportunity for anyone interested in machine learning and wanting to develop their skills through real projects. B If you are looking for additional resources to promote your ideas or want to increase the effectiveness of...
- 2 kudos
- 6094 Views
- 4 replies
- 2 kudos
Editor lags
Does anyone else experiencing lags on the Databricks notebook editor?The typing is sometimes very slow causes the cell to hang for a moment. (Using python)
- 6094 Views
- 4 replies
- 2 kudos
- 2 kudos
The notebook editor has been sluggish for me regardless of splitting up between cells and the language in use. Very frustrating.
- 2 kudos
- 1869 Views
- 1 replies
- 1 kudos
Restricting Notebook Access in a Team of Admins
Hello,I would like to ask a question regarding user permissions:In a situation where all team members are admins, is it possible to restrict access to a specific notebook in Databricks so that only I can view and write it?Thank you
- 1869 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @weilin0323 ,If Worskspace Access Control is enabled, you are able to manage access to directories and individual notebooks, so you will be able to remove the access, but since all the other users are admins, they will be able to grant access to t...
- 1 kudos
- 2263 Views
- 2 replies
- 0 kudos
CICD Unity Catalog
Hello How do you handle deploying Databricks Unity Catalog resources (schemas, tables, views, permissions) across environments? What are the strategies for building (compiling), validating and deploying these resources and ensure they’re error-free a...
- 2263 Views
- 2 replies
- 0 kudos
- 0 kudos
Thanks, yes DAB can be used, but I'm still wondering how to validate the syntax, dependencies, permissions, etc. before deploying the DAB. Example: when you deploy an SQL Database DACBAC file, first you need to build the project and generate a DACBAC...
- 0 kudos
- 4121 Views
- 3 replies
- 2 kudos
Resolved! Specify cluster when using dbutils.notebook API
Hello! Anyone know if there is a way of specifying cluster when using dbutils.notebook.run() ? As i understand it, this command will create a job compute on the run? but what if I want to use my general purpose cluster? I have been thinking of %run b...
- 4121 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi @ErikJ ,Check the docs:Also you may run the help method:.The parameters of the method are:1. path2. timeoutSeconds3. arguments
- 2 kudos
- 2911 Views
- 2 replies
- 0 kudos
Lake house monitoring prodile_metrics and drift_metrics are empty
I am wondering why when i create a lakehouse monitor using either the API or UI, that my profile_metrics and data_drift tables are empty. This error came after i changed my date from type date to timestamp. Any information would be greatly appreciate...
- 2911 Views
- 2 replies
- 0 kudos
- 0 kudos
The issue comes where you don't include data with a timestamp that's within the last 30 days, as the analysis done on the table is only done within the last 30 days worth of data.
- 0 kudos
- 783 Views
- 0 replies
- 1 kudos
deleteing old databricks workspace but keeping the data
Hi! I am currently working on a old databricks workspace where we have stored a lot of data, we have migrated over to a new workspace and i want to delete the old one. Before deleting the workspace i want to store the data in a blob storage in azure....
- 783 Views
- 0 replies
- 1 kudos
- 10728 Views
- 9 replies
- 2 kudos
Create a Workflow Schedule with varying Parameters
We aim to reduce the amount of notebooks we create to a minimum and instead make these fairly flexible. Therefore we have a Factory setup that takes in a parameter to varies the logic.However when it comes to Workflows we are forced to create multipl...
- 10728 Views
- 9 replies
- 2 kudos
- 2 kudos
We're also running into this issue on my team where having multiple cron schedules would be handy. We have some pipelines that we want run on multiple schedules, say to refresh data "Run every Sunday at midnight" and "Run on the first day of the mont...
- 2 kudos
- 1687 Views
- 0 replies
- 1 kudos
Unable to login to community addition account
Hello, I created a community edition account yesterday. Earlier today, I was still able to sign in and everything worked as expected. Now, whenever I try to sign in, I get the following error: "We were not able to find a Community Edition workspace w...
- 1687 Views
- 0 replies
- 1 kudos
- 1580 Views
- 0 replies
- 1 kudos
Accessing data in Databricks/Unity Catalog from a SharePoint list
Our organization is moving all of it's corporate master data to Databricks. Our business operations units need access to this data in various tools in the form of look-ups or drop-down lists in tools like Excel and SharePoint lists. It's simple eno...
- 1580 Views
- 0 replies
- 1 kudos
- 1190 Views
- 1 replies
- 1 kudos
Best Practices for Optimizing Delta Lake Performance
I’m currently working on a project using Delta Lake on Databricks and would like to optimize performance for both batch and streaming workloads.
- 1190 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @joshbuttler ,It's a big topic and it really depends on the use case. You can follow some guides/recommendations from databricks documentation:- Optimization recommendations on Databricks | Databricks on AWS- Use liquid clustering for Delta tables...
- 1 kudos
- 3374 Views
- 4 replies
- 0 kudos
Has anyone being able to connect to Databricks using ODBC?
I'm trying to connect to the Databricks cluster from the Excel using ODBC and following this official guide:https://docs.databricks.com/en/integrations/excel.html#connect-from-microsoft-excelBut the authentication is always failing, returning "500 In...
- 3374 Views
- 4 replies
- 0 kudos
- 0 kudos
Hi @Vadimalk ,Could you check if you have following options enabled in simba driver configuration:
- 0 kudos
- 957 Views
- 0 replies
- 0 kudos
Account Level API GET Call requiring User-Agent Header
We recently Enabled Unity Catalog so using Account Level API and little stuck on a GET call. For some reason, just the GET call requires a User-Agent header while POST, PUT, PATCH.. all work without it. For workspace API, there was no need for User-A...
- 957 Views
- 0 replies
- 0 kudos
- 1786 Views
- 1 replies
- 1 kudos
Summit23
I have really enjoyed the summit so far! I am a biostatistics graduate student at Harvard and am learning so much here.
- 1786 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi,If you had a great time at the Summit, be sure to visit our community events portal for upcoming events and join your regional user group for meetups.Thanks,Anushree
- 1 kudos
- 1766 Views
- 1 replies
- 0 kudos
Summit 2024
It has been an exciting event that brought together industry leaders, researchers, and practitioners to explore the latest advancements in artificial intelligence and data science. With cutting-edge presentations, hands-on workshops, and networking o...
- 1766 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi,If you had a great time at the Summit, be sure to visit our community events portal for upcoming events and join your regional user group for meetups.Thanks,Anushree
- 0 kudos
