- 6099 Views
- 15 replies
- 1 kudos
Sql Error on MultiNode cluster, but fine on SingleNode
If I run the following code on a cluster in SingleNode mode it works fine, but if I run the exact same cell on a MultiNode Cluster It throws:SparkConnectGrpcException: (java.sql.SQLTransientConnectionException) Could not connect to address=(host=HOST...
- 6099 Views
- 15 replies
- 1 kudos
- 1 kudos
data_security_mode": "NONE": This is a non-Unity Catalog Cluster. No Governance enforced. "data_security_mode": "USER_ISOLATION": This is a UC Shared Compute cluster that has certain limitations when accessing Low-Level APIs, RDDs, and dbfs/data bri...
- 1 kudos
- 2793 Views
- 4 replies
- 0 kudos
Unity Catalog
I want to create Unity Catalog but can't find option "Manage Account" in drop down. I am using Azure one month free trial subscription. Is it because of free trial account?
- 2793 Views
- 4 replies
- 0 kudos
- 0 kudos
If you are an Account admin, you should see it under the workspace name. Please check whether you logged in as Account Admin.
- 0 kudos
- 8753 Views
- 3 replies
- 1 kudos
How to connect to Databricks from Oracle Analytics Cloud
How to connect to Databricks from #Oracle Analytics Cloud (#OAC)? It is not listed as a validated BI tool on Databricks documentation. Is JDBC tested with Oracle Analytics Cloud ? Is there any other way or 3rd party connector for Oracle Analytics Clo...
- 8753 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi, the DataBricks connector has been added to the Oracle Analytics Product Roadmap!You can find more information in the Oracle Analytics Community and ask questions.
- 1 kudos
- 2136 Views
- 1 replies
- 1 kudos
Connection between Azure Databricks workspace and Microsoft Power BI on Remote Server ( Jump Box)
Both (Azure Databricks workspace & Microsoft Power) resided on Jump box server (Remote Environment) Azure Databricks connector is not visible their, the connection is possible through Third Party tool but not directly with the built in connector, a...
- 2136 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Murtaza-007-007 ,You can take a look at below thread. In my company it was due to firewall rules blocking some dns required for connector.https://community.fabric.microsoft.com/t5/Desktop/PowerBi-Desktop-App-missing-databricks-connector/td-p/3474...
- 1 kudos
- 2422 Views
- 1 replies
- 0 kudos
Resolved! Lakehouse Fundamentals Training Videos Not Playing
Hello, I am new to learning about Azure Databricks and decided to take the free online training to learn about it. When I try to access the videos, they will not work for me. I keep seeing a message that says to click here and accept cookies, but not...
- 2422 Views
- 1 replies
- 0 kudos
- 0 kudos
Nevermind. I figured it out. It was because I have Malwarebytes browser guard enabled on my browser. Once I paused it, I could play the videos.
- 0 kudos
- 1906 Views
- 1 replies
- 0 kudos
Data Ingestion into DLT from Azure Event hub batch processing
I am building my first DLT pipeline and I want to ingest data from Azure event hub for batch processing.But, I can just see documentation for streaming by using kafka.Can we do batch processing with DLT & Azure Event hub?
- 1906 Views
- 1 replies
- 0 kudos
- 0 kudos
Hey @pranay , There seems to be a new documented way to achieve this: https://learn.microsoft.com/en-us/azure/databricks/delta-live-tables/event-hubs Thanks, Gab
- 0 kudos
- 689 Views
- 0 replies
- 0 kudos
save page views in Databricks?
Hi everyone,I'm considering an architecture that will store page views for later analysis on Dynamo so to move them later on in Databricks. I wonder if there's a use case to save those pages views in Databricks directly with the same level of perform...
- 689 Views
- 0 replies
- 0 kudos
- 4403 Views
- 5 replies
- 0 kudos
Resolved! Issues with Content Writing on Databricks Community
Hi @Sujitha , @RishabhTiwari07 ,I wanted to bring to your attention that whenever I’m writing content on Databricks, I often encounter errors due to invalid HTML. Additionally, some terms seem to be prohibited by the Databricks community, which is pu...
- 4403 Views
- 5 replies
- 0 kudos
- 0 kudos
@Rishabh-Pandey I understand. Please be assured that I am actively working on this and tracking these posts to update our filter on a regular basis. If you come across something similar again, feel free to tag me, and I'll take care of that.
- 0 kudos
- 1445 Views
- 0 replies
- 1 kudos
Live, Virtual Workshop How to build a Golden Data Warehouse in Financial Services with Databricks
Reasons to join: Most Financial Services organizations have major on-prem investments. You can use that as your starting point to activate your organization on gold-level insights in the cloud.Providing a path to easier and quicker migration to the c...
- 1445 Views
- 0 replies
- 1 kudos
- 1276 Views
- 1 replies
- 1 kudos
Databricks Certifications
Hello Everyone , My name is Sourav Das. I am from Kolkata, currently working as Azure Data Engineer in Cognizant.I have cleared multiple databricks certifications(Databricks data engineer associate, databricks data engineer professional, databricks d...
- 1276 Views
- 1 replies
- 1 kudos
- 1 kudos
Good luck. You can continue to improve your skills by helping other community members on this platform.
- 1 kudos
- 4247 Views
- 4 replies
- 4 kudos
Resolved! Differences among python libraries
I am confused as to the differences between various python libraries for databricks: especially with regard to differences among [databricks-connect](https://pypi.org/project/databricks-connect/), [databricks-api](https://pypi.org/project/databricks-...
- 4247 Views
- 4 replies
- 4 kudos
- 4 kudos
@szymon_dybczak,Thank you for typing all that up. It is very clear and helpful.Two follow ups if I may:1. If one's primary goal is to execute SQL queries why prefer databricks sql connector over a generic jdbc or odbc package?2. Did I miss any other ...
- 4 kudos
- 2106 Views
- 0 replies
- 0 kudos
Delta Live Table (Real Time Usage & Application)
Delta Live Tables are the Hot Topic in Data Field, innovation by Databricks. Delta Live Table is a Declarative ETL framework. In ETL two types of ETL frame works are there -1) procedure ETL 2)Declarative ETL1)procedure ETL- it involves writing code t...
- 2106 Views
- 0 replies
- 0 kudos
- 3452 Views
- 5 replies
- 0 kudos
Filestore endpoint not visible in Databricks community edition
In community edition of Databricks after multiple attempts of enable, refreshes, unable to navigate to File store endpoint.Under catalog it is not visible
- 3452 Views
- 5 replies
- 0 kudos
- 0 kudos
Follow these alternate solutions. https://community.databricks.com/t5/data-engineering/databricks-community-edition-dbfs-alternative-solutions/td-p/94933
- 0 kudos
- 1506 Views
- 1 replies
- 0 kudos
Migrating ML Model Experiments Using Python REST APIs
Hi everyone,I’m looking to migrate ML model experiments from a source Databricks workspace to a target workspace. Specifically, I want to use Python and the available REST APIs for this process.Can anyone help me on this!Thanks in advance!
- 1506 Views
- 1 replies
- 0 kudos
- 0 kudos
You can use https://github.com/mlflow/mlflow-export-import utility. The example given below doesn't use Python but uses CLI and CICD pipeline to do the same. https://medium.com/@gchandra/databricks-copy-ml-models-across-unity-catalog-metastores-188...
- 0 kudos
- 4748 Views
- 2 replies
- 3 kudos
Resolved! Access Databricks Table with Simple Python3 Script
Hi, I'm super new to Databricks. I'm trying to do a little API scripting against my company's DB instance.I have this supersimple python (ver 3) which is meant to run a remote host. The script tries to a simple SQL query against my Databricks instan...
- 4748 Views
- 2 replies
- 3 kudos
- 3 kudos
@gchandra Yes! This is the documentation I was seeking! Thank you so much
- 3 kudos
