Databricks Community

TakuyaOmi

I encountered an issue where I couldn’t successfully connect to Kinesis Data Streams using instance profile authentication while working with Delta Live Tables (DLT) in a Unity Catalog (UC)-enabled environment.According to the documentation, instance...

TakuyaOmi

DABsの学習時に参考になったサイト(blog、動画、 Github等)を貼っていきます。入門(日本語)https://zenn.dev/akuwano/articles/6b0bbf54890c07https://zenn.dev/yohei/articles/2024-11-30-databricks-asbhttps://qiita.com/taka_yayoi/items/dc7645611551177a72c6入門(英語)https://github.com/databricks/da...

TakuyaOmi

Hello,There are several ways to grant Workspace Admin permissions in Databricks. While this may seem straightforward, I found it a bit confusing when I started using Databricks, so I’d like to share my experience. This guide is aimed at beginners.How...

TakuyaOmi

I want to grant Workspace Admin permissions to a group instead of individual users, but I haven’t found a way to do this. I considered assigning permissions by adding the group to the Databricks-managed 'admins' group (establishing a parent-child rel...

TakuyaOmi · 12-10-2024

Hello,While reviewing the Azure Databricks pricing page to check the cost for Job Compute, I came across a term I hadn’t seen before: "Jobs Light Compute."I suspect this refers to the now end-of-support Databricks Runtime known as Databricks Light:Da...

TakuyaOmi

@Kuke Have you checked whether the partitioning is configured correctly?If disabling partitioning (creating a single partition) allows you to retrieve 100,000 rows, but enabling partitioning results in only 99,000 rows, it is likely that the partitio...

TakuyaOmi

@Alberto_Umana Thank you for sharing. However, I have already followed the steps mentioned in the article, and I’m still unable to establish a connection.When using AWS access keys, the connection is successful, which confirms that there are no issue...

TakuyaOmi

@iptkrisna Unfortunately, as far as I know, there is no way to restore a deleted job cluster. I recommend reaching out to support for assistance.The job run history is retained for 60 days, so I suggest exporting the results before they expire if nee...

TakuyaOmi

Any short guidance on how to implement data quality framework in databricks ?With dbdemos, you can learn a practical architecture for data quality testing using the expectations feature of DLT. I hope this helps! (Please note that some DLT syntax mig...

TakuyaOmi

@Thekenal You can start from here. https://www.databricks.com/learn/training/certification#certifications

Databricks Community

User Stats

User Activity

Limitations When Using Instance Profiles to Connect to Kinesis

Databricks Asset Bundlesの学習時に参考にしたサイト集

How to Grant Workspace Admin Permissions to an ID Using Parent Groups

How Can a Workspace Admin Grant Workspace Admin Permissions to a Group?

About "Jobs Light Compute" Listed in the Azure Databricks Pricing Table

Re: Missing Rows When Reading Data from Impala Kudu to Databricks Using JDBC

Re: Limitations When Using Instance Profiles to Connect to Kinesis

Re: Restore deleted databricks jobs and job runs

Re: What are powerfull data quality tools/libraries to build data quality framework in Databricks ?

Re: Certified or Curious? Let’s Talk About Databricks Certifications!