Engage in discussions on data warehousing, analytics, and BI solutions within the Databricks Community. Share insights, tips, and best practices for leveraging data for informed decision-making.
Here's your Data + AI Summit 2024 - Warehousing & Analytics recap as you use intelligent data warehousing to improve performance and increase your organization’s productivity with analytics, dashboards and insights.
Keynote: Data Warehouse presente...
https://community.databricks.com/s/question/0D58Y00009fClizSAC/ssh-connection-with-paramiko i read in this post that you can help me with that problem, please can you give me more advice what i have to do to connect to an sftp through ssh
Hi!Could you please let me know what your current blocker is? Are you looking for a code snippet that can help you get file through sftp? Or if you are looking for the spark config that whitelist the port? Or if you are blocked by some other error?
Availability of SQL Warehouse to Data Science and Engineering persona
Hi All,
Now we can use SQL Warehouse in our notebook execution.
It's in preview now and soon will be GA.
Hi team,
I am looking for a way to find DBU cost for DLT clusters, does it get stored anywhere I have been looking into event_logs but did not find information related to cost. it does have cluster resource utilization details.
here is what I found...
Hi @Chhaya Vishwakarma Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best an...
Hi @Dhruv Dalsania Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answer...
Explore the major offerings of the MetaMask WalletIf you participating in the crypto economy, you might have come across the term MetaMask Wallet once in a while. In this read, we will explore why we should go for MetaMask by acknowledging the major ...
Hi @Dhruv Dalsania Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answer...
I've triend this code in Databricks SQL
create table people_db.GLAccount
USING PARQUET
LOCATION "abfss://datamesh@dlseu2dtaedwetldtlak9.dfs.core.windows.net/PricingAnalysis/rdv_60_134.vGLAccount.parquet"
But I'm getting a "Invalid configuration...
you can define 'data access configuration' in the admin panel.go to SQL warehouse settings -> Data Access configurationhttps://learn.microsoft.com/en-us/azure/databricks/sql/admin/data-access-configuration
I've been trying to check, via databricks SQL, which groups a user belongs to. When I run SHOW GROUPS or SHOW USERS, everything is returned correctly.However, when a try to run: SHOW GROUPS WITH USER `user@domain.com`Nothing is returned, but the u...
Hi @Marcelo Castro Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
It was working fine initially.
Message: [Simba][SparkJDBCDriver](500618) Error occured while deserializing arrow data: sun.misc.Unsafe or java.nio.DirectByteBuffer.<init>(long, int) not available [SQL State=HY000, DB Errorcode=500618]
@Ehsan Ullah :The error message you received indicates that there is an issue with deserializing arrow data in the Spark JDBC driver. This error is caused by the fact that the sun.misc.Unsafe or java.nio.DirectByteBufferclasses are not available.To ...
Refreshing SQL DashboardYou can schedule the dashboard to automatically refresh at an interval.At the top of the page, click Schedule.If the dashboard already has a schedule, you see Scheduled instead of Schedule.Select an interval, such as Every 1 h...
I can see on Databricks SQL warehouse Data tab that clusters, catalogs and schemas have a unique ID. User created tables, views and functions must have and unique ID too, but it is not exposed to the user as far as I can tell.
I need to retrieve the ...