cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
FabriceDeseyn
Contributor
since ‎05-10-2022
‎09-07-2023

User Stats

  • 12 Posts
  • 1 Solutions
  • 1 Kudos given
  • 8 Kudos received

User Activity

merge breaking persistance of dataframe

09-06-2023
Hi allIn the minimal example below you can see that executing a merge statement trigger recomputation of a persisted dataframe. How does this happen?   from delta.tables import DeltaTable table_name = "hive_metastore.default.test_table" # initializ...

Bug - data profile internal code

07-28-2023
Hi I am not sure how to post a potential bug but I stumble upon the following issue on DBR 13.2.The same code 'sometimes' works on DBR 12.2 LTS. But if I do it on a real table, this issue always occurs. 

Databricks-connect VSCode debugging pandas_api not working

07-20-2023
HiI am using the databricks extension on VSCode and am running against an issue since two days, prior it worked fine. I receive an error when I want to use Pandas-on-Spark during debugging.from databricks.connect import DatabricksSession spark = Data...

Autoloader directory listing not listing all files

03-29-2023
Hi communityI have an Autoloader pipeline running with following configuration. Unfortunately, it does not detect all files. (see below query definition). The folder that needs to be read has 38.246 files that all have the same schema and structure.:...

What does autoloader's cloudfiles.backfillInterval do?

03-15-2023
I'm using autoloader directory listing mode (without incremental file listing) and sometimes, new files are not picked up and found in the cloud_files-listing.I have found that using the 'cloudfiles.backfillInterval'-option can resolve the detection ...
Kudos given to
View all