cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

carolpeixinho
by New Contributor
  • 1195 Views
  • 1 replies
  • 0 kudos

Sharing Opportunities with Databricks

Hi everyone,I would like to talk to someone that could set up a process of deals sharing with Databricks following the GDPR.Thanks,Carol.

  • 1195 Views
  • 1 replies
  • 0 kudos
Latest Reply
SathyaSDE
Contributor
  • 0 kudos

Hi,Can you pls share some more details on what you are looking for ?If you are trying to share the data to/from Databricks, you can use Delta sharing , Clean rooms option - these provide data sharing options with strong security & governance.or if yo...

  • 0 kudos
Zoraida
by New Contributor
  • 955 Views
  • 1 replies
  • 0 kudos

Databricks Destiny with Fivetrans best practices

Hello! we are trying to use Fivetran for ingesting different sources into the data lake so we will have multiple connectors. We would like to know what are the recommendations when selecting the SQL warehouses. Since the new serverless SQL warehouses...

  • 955 Views
  • 1 replies
  • 0 kudos
Latest Reply
SathyaSDE
Contributor
  • 0 kudos

Hi,To understand about the Databricks SQL Serverless cost, you can see here - https://www.databricks.com/product/pricing/databricks-sqlIn terms of comparison, Databricks is said to be the most cost efficient & high performant in the market amongst it...

  • 0 kudos
Phani1
by Valued Contributor II
  • 826 Views
  • 1 replies
  • 0 kudos

code vulnerabilities, code smells, and bugs

Hi Team, is there a way in Databricks to check for code vulnerabilities, code smells, and bugs?Note :Databricks native functionality only  

  • 826 Views
  • 1 replies
  • 0 kudos
Latest Reply
SathyaSDE
Contributor
  • 0 kudos

Hi,As far as I am aware, for security scanning/monitoring at Databricks account level, we have belowSAT - https://github.com/databricks-industry-solutions/security-analysis-toolhttps://www.databricks.com/trust/trusthttps://learn.microsoft.com/en-us/a...

  • 0 kudos
fridthoy
by New Contributor II
  • 1978 Views
  • 7 replies
  • 0 kudos

Cluster logs folder

Hi,  I can't see to find the cluster_logs folder, anyone that can help me find where the cluster logs are stored? Best regards

fridthoy_0-1729764812475.png
  • 1978 Views
  • 7 replies
  • 0 kudos
Latest Reply
fiff
New Contributor II
  • 0 kudos

Thank you for the help! I have enabled predictive optimization for unity catalog, thinking it would automatically preform VACCUM on the tables i have in my delta lake. With that in mind, I assumed VACCUM wouldn't require further attention.Would it be...

  • 0 kudos
6 More Replies
ChristopherQ1
by New Contributor
  • 1801 Views
  • 1 replies
  • 0 kudos

Can we share Delta table data with Salesforce using OData?

Hello!I'm seeking recommendations for streaming on-demand data from Databricks Delta tables to Salesforce. Is OData a viable choice?Thanks.

  • 1801 Views
  • 1 replies
  • 0 kudos
Latest Reply
matthew_m
Databricks Employee
  • 0 kudos

Hi @ChristopherQ1, Salesforce has released a zero-copy connection that relies on the SQL Warehouse to ingest data when needed. I suggest you consider that instead of OData.   Matthew

  • 0 kudos
Mo_menzje
by New Contributor
  • 767 Views
  • 0 replies
  • 0 kudos

Paralellizing XGBoost Hyperopt run using Databricks

Hi there!I am implementing a classifier for classifying documents to their respective healthcare type.My current setup implements the regular XGBClassifier of which the hyperparameters are to be tuned on my dataset, which is done using Hyperopt. Base...

Mo_menzje_0-1729782213124.png Mo_menzje_1-1729784402354.png
  • 767 Views
  • 0 replies
  • 0 kudos
Phani1
by Valued Contributor II
  • 925 Views
  • 1 replies
  • 0 kudos

CDC for Unstructured data

Hi All,how we can handle CDC for unstructured data in Databricks. What are some best practices we should follow to make this work effectively?Regards,Phani

  • 925 Views
  • 1 replies
  • 0 kudos
Latest Reply
filipniziol
Esteemed Contributor
  • 0 kudos

Hi @Phani1 ,Handling CDC for unstructured data—such as audio, images, or video files—in Databricks involves efficiently detecting and processing changes to these files as they occur.Here's how you can approach this:Use Databricks Autoloader: Autoload...

  • 0 kudos
mathijs-fish
by New Contributor III
  • 5444 Views
  • 5 replies
  • 3 kudos

Resolved! "with open" not working with Shared Access Cluster on mounted location

Hi All,For an application that we are building, we need a encoding detector/utf-8 enforcer. For this, we used the python library chardet in combination with "with open". We open a file from a mounted adls location (we use a legacy hive-metastore)When...

mathijsfish_1-1701785425743.png mathijsfish_2-1701785466668.png
Get Started Discussions
glob
Mount
os
with open
  • 5444 Views
  • 5 replies
  • 3 kudos
Latest Reply
nagND
New Contributor II
  • 3 kudos

Hi @mathijs-fish @Ayushi_Suthar  - I am having the same issue with shared cluster. I can see the list of PDF files on the mount using dbutils.fs.ls(mount_point), but when I am trying to read the PDF files using PyPDF, I am getting - FileNotFoundError...

  • 3 kudos
4 More Replies
trevormccormick
by New Contributor III
  • 1469 Views
  • 3 replies
  • 0 kudos

Embed Dashboard - GraphQL Operation Not Authentic

I have added a domain to my list of approved domains for embedding dashboards from my Databricks instance. This domain hosts my Docusaurus site. When the page with the embedded dashboard loads, it makes some network requests to Databricks that are fa...

  • 1469 Views
  • 3 replies
  • 0 kudos
Latest Reply
trevormccormick
New Contributor III
  • 0 kudos

is it possible that this is happening because the website is not HTTPS?

  • 0 kudos
2 More Replies
RobsonNLPT
by Contributor III
  • 18449 Views
  • 4 replies
  • 4 kudos

Permissions on Unity Catalog Table Constraints

Hi all.I've used new options to add constraints to UC tablesEven granting permissions to an user (ALL PRIVILEGES) on particular schema we have errors when trying to add PKs. The message doesn't make sense (PERMISSION_DENIED: User is not an owner of T...

  • 18449 Views
  • 4 replies
  • 4 kudos
Latest Reply
dmart
New Contributor III
  • 4 kudos

So how does one grant these permissions to non-owners?

  • 4 kudos
3 More Replies
brandocomando8
by New Contributor III
  • 4343 Views
  • 15 replies
  • 1 kudos

Sql Error on MultiNode cluster, but fine on SingleNode

If I run the following code on a cluster in SingleNode mode it works fine, but if I run the exact same cell on a MultiNode Cluster It throws:SparkConnectGrpcException: (java.sql.SQLTransientConnectionException) Could not connect to address=(host=HOST...

  • 4343 Views
  • 15 replies
  • 1 kudos
Latest Reply
gchandra
Databricks Employee
  • 1 kudos

data_security_mode": "NONE":  This is a non-Unity Catalog Cluster. No Governance enforced. "data_security_mode": "USER_ISOLATION": This is a UC Shared Compute cluster that has certain limitations when accessing Low-Level APIs, RDDs, and dbfs/data bri...

  • 1 kudos
14 More Replies
Makanee_purvi
by New Contributor II
  • 1847 Views
  • 4 replies
  • 0 kudos

Unity Catalog

I want to create Unity Catalog but can't find option "Manage Account" in drop down. I am using Azure one month free trial subscription. Is it because of free trial account?

  • 1847 Views
  • 4 replies
  • 0 kudos
Latest Reply
gchandra
Databricks Employee
  • 0 kudos

If you are an Account admin, you should see it under the workspace name. Please check whether you logged in as Account Admin.

  • 0 kudos
3 More Replies
ihrushi
by New Contributor II
  • 7414 Views
  • 3 replies
  • 1 kudos

How to connect to Databricks from Oracle Analytics Cloud

How to connect to Databricks from #Oracle Analytics Cloud (#OAC)? It is not listed as a validated BI tool on Databricks documentation. Is JDBC tested with Oracle Analytics Cloud ? Is there any other way or 3rd party connector for Oracle Analytics Clo...

  • 7414 Views
  • 3 replies
  • 1 kudos
Latest Reply
BenjaminArnulf
New Contributor II
  • 1 kudos

Hi, the DataBricks connector has been added to the Oracle Analytics Product Roadmap!You can find more information in the Oracle Analytics Community and ask questions.

  • 1 kudos
2 More Replies
Murtaza-007-007
by New Contributor III
  • 1366 Views
  • 1 replies
  • 1 kudos

Connection between Azure Databricks workspace and Microsoft Power BI on Remote Server ( Jump Box)

Both (Azure Databricks workspace & Microsoft Power)  resided on  Jump box server (Remote Environment) Azure Databricks connector is not visible their, the connection is possible through Third Party tool but not directly with the built in connector, a...

  • 1366 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @Murtaza-007-007 ,You can take a look at below thread. In my company it was due to firewall rules blocking some dns required for connector.https://community.fabric.microsoft.com/t5/Desktop/PowerBi-Desktop-App-missing-databricks-connector/td-p/3474...

  • 1 kudos
olivia-32
by New Contributor III
  • 1900 Views
  • 1 replies
  • 0 kudos

Resolved! Lakehouse Fundamentals Training Videos Not Playing

Hello, I am new to learning about Azure Databricks and decided to take the free online training to learn about it. When I try to access the videos, they will not work for me. I keep seeing a message that says to click here and accept cookies, but not...

olivia32_0-1729422806221.png
  • 1900 Views
  • 1 replies
  • 0 kudos
Latest Reply
olivia-32
New Contributor III
  • 0 kudos

Nevermind. I figured it out. It was because I have Malwarebytes browser guard enabled on my browser. Once I paused it, I could play the videos. 

  • 0 kudos

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now
Labels