Databricks Community

Brianben

Hi community,I am studying the documentation about different kind of SQL warehouse (https://docs.databricks.com/aws/en/compute/sql-warehouse/warehouse-types#:~:text=A%20classic%20SQL%20warehouse%20supports,than%20in%20your%20Databricks%20account.)I s...

Brianben

Hi all,We have a daily Databricks job that downloads excel files from SharePoint and read them, the job works fine until today (3March). We are getting the following error message when running the code to read the excel file:org.apache.spark.SparkExc...

Brianben · 01-29-2025

Hi all,Recently we recognized that the maximun retention period of personal access token has changed to 730days from never. From official document, I didn't find the effective date of this changes, do someone know about it?Besides, we have some Power...

Brianben · 01-05-2025

Hi all,I am currently researching on the archive support features in Databricks. https://docs.databricks.com/en/optimizations/archive-delta.htmlLet say I have enabled archive support and configured the data to be archived after 5 years and I also con...

Brianben · 01-02-2025

Hi all,I am new to Databricks and delta table. Recently I am researching on data archiving as we have data retention policy within the company.I have studied the documentation (Archival support in Databricks | Databricks on AWS) and I am exploring th...

Brianben · 01-29-2025

@Alberto_Umana Thank you for the reply, we need to generate new token recently, that's why I recongize the changes. Do you have any ideas on my another question with PowerBI connection in the same post? Thanks.

Brianben · 01-10-2025

@VZLA Got it, thank you for the detail explanation.

Brianben · 01-09-2025

@VZLA I just come up with a different thought. If every time we do a operation on existing data like update, delete or optimize, new parquet files will be created and the file creation date would be the latest time. Even we may have different write o...

Brianben · 01-08-2025

@Walter_C Thank you for the reply. However it is a bit confusing. In the beginning of your reply, you said I do not need to change the delta.timeUntilArchived setting but in step 3 you said I have to update the setting. Do you mean I should not chang...

Brianben · 01-06-2025

@Walter_C Thank you for your reply. However, there are some part that might need your further clarification.Assume I already set the delta.timeUntilArchived to 1825days (5years) and I have configured the lifecycle policy align with databricks setting...

Databricks Community

User Stats

User Activity

Choice of SQL Warehouse

Getting Errors when reading data from Excel InternalError: pip is not installed for /local_disk

Personal access token retention period change

Procedure of retrieving archived data from delta table

Data archive with delta tables in UC enable environment

Re: Personal access token retention period change

Re: Data archive with delta tables in UC enable environment

Re: Data archive with delta tables in UC enable environment

Re: Procedure of retrieving archived data from delta table

Re: Procedure of retrieving archived data from delta table