Hi everyone,I’m new to Databricks and really excited to explore how data analytics can be applied to online communities. I want to analyze discussion trends, common topics, and patterns in user engagement across forums and blogs.While researching dat...
I’m new to Databricks and still exploring the platform. One of our requirements is to share a Databricks dashboard with multiple external customers (for example, Customer 1 and Customer 2).The key requirement is data isolation:When a user from Custom...
So just to clarify here, you want to control what the users can see but you don’t know who the users are? how do you know if a user is coming from customer1 or customer2 in this case? Would you rely on the domains?users need to be added in UC to see ...
Hello everyone,Yesterday I saw a demo of Lakeflow Designer, and it looked very interesting. I tried to find this option in the UI, but I was not able to locate it.Could anyone please guide me on where I can access or try out this feature?I would real...
Hey @nafikazi , @balajij8 has it right: You’re looking in the right place. Lakeflow Designer does not appear in the UI as its own separate “Lakeflow Designer” menu item. Instead, it shows up through the ETL pipeline entry points. You can get to it ei...
Hi there,I am locked out of my account - https://community.databricks.com/t5/user/viewprofilepage/user-id/99755 - due to adding a passkey improperly. The reset passkey doesnt work and I submitted a request 00859868 but the service rep is saying they...
Hello @Danny2, I’ve sent you a direct message to collect a few more details and help resolve this.
I am here looking for Data governance solution for organization. I also searched this on many different website and found many solutions. We are bit confused to which one to choose. One of my friend suggest me this platform, and i am hoping i will ge...
You can use Unity Catalog for Databricks Lakehouse. You can use Collibra/Open Metadata along with Unity Catalog for complete governance
Hi Community Members,I'm working as a Power BI Developer and interested to upskill into Databricks platform as a Data Analyst and Data Engineering.Request to share the resources(documentation/video tutorials) in a sequential order.Thank You!Best Rega...
For Bite-size overviews check the demo center - https://www.databricks.com/resources/demos/library This youtube channel is great for more detailed oriented discussion around specific features .https://www.youtube.com/@nextgenlakehouseFor more structu...
In the rapidly evolving world of big data, Databricks has emerged as a leading platform for data engineering, data science, and machine learning. Whether you're a data professional or someone looking to expand your knowledge, understanding Databricks...
This is a clear and helpful guide to Databricks. You explained its key features and learning steps in a beginner-friendly way, making it easy for readers to get started and build practical skills in data analytics and machine learning. There is sone ...
I’m building a fact table in Databricks where the grain is one row per case per 15-minute segment. For example, if a case lasts 90 minutes, I expect about 6 rows.I generate the 15-minute segments and MERGE into a Delta table (incremental load). Howev...
MERGE causes duplicates if the ON clause does not enforce the target grain. Validate if ON uniquely identifies each row at the fact grain
I’m currently working with Databricks autoscaling configurations and trying to better understand how Spark decides when to spin up additional worker nodes. My cluster has a minimum of one worker and can scale up to five. I know that tasks are assigne...
Is the above information true for job clusters as well? Looks like the enhanced auto scalar is only available for pipelines
Hello Community,I have a couple of continuous workflows (jobs) running in production, and they’ve been working well so far. However, we’re seeing some transient failures that are causing the entire job to restart — which I’d prefer to avoid.While we ...
@Kirankumarbs the option would remove default retries and then you can add custom retry logic within script and can dynamically change number of retries as a task parameter.hope this helps
Hello Community,I’d like to check with the contributors whether the article I recently published follows the correct approach. Did I choose the right options and the appropriate place to publish it in the Databricks Community?https://community.databr...
Hi @Kirankumarbs ,Yes, you did everything in correct manner. You put your article in correct place which is "Community Articles".Anyway, thanks for sharing with us
Hello,when I try setting up a model with provisioned throughput, the deployment fails with the message “Provisioned throughput is not enabled for this workspace.”. It doesn’t work for databricks-hosted models nor for 3rd party models from the marketp...
Can you try following - https://docs.databricks.com/aws/en/workspace/navigate-workspace#get-helphttps://docs.databricks.com/aws/en/resources/supporthttps://www.databricks.com/company/contactSupport based on your tier . https://www.databricks.com/supp...
Comparing versions of Jupyter Notebooks (new preferred format on Databricks) in Bitbucket is much more difficult than the previous format. TPlease use the link below vote on adding better Jupyter Notebooks comparison to Bitbucket.Enable rich renderin...
Hi,I have the following directory structure:- mypkg/ - setup.py - mypkg/ - __init__.py - module.py - scripts/ - main # notebook From the `main` notebok I have a cell that runs:%pip install -e /path/to/mypkgThis command appears to succ...
Sorry to triple post but I have another update: it seems to work for standalone clusters, but it refuses to build the wheel (I get a write permission error) on the job clusters.
Having problem in connecting to Databrikcs with service principal from tableau . Wanted to how how tableau extracts refreshing connecting to databricks , is it via individual Oauth or service principal
Hi @cheerwthraj, To connect Tableau to Databricks and refresh extracts, you can use either OAuth or service principal authentication. For best practices, please refer to the below link, https://docs.databricks.com/en/partners/bi/tableau.html#best-pr...
