cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
harvey-c
New Contributor III
since ‎11-29-2023
‎03-10-2024

User Stats

  • 12 Posts
  • 0 Solutions
  • 0 Kudos given
  • 0 Kudos received

User Activity

Wrong FS: abfss://....., expected: dbfs:/ Error in DLT pipeline

12-18-2023
Dear Databricks community members:SymptomReceived the error for a delta load, after a successful initial load with a  Unity Catalog Volume as a data source.org.apache.spark.sql.streaming.StreamingQueryException: [STREAM_FAILED] Query [id = xxx, runId...

DLT pipeline access external location with abfss protocol was failed

12-18-2023
Dear Databricks Community Members:The symptom: The DLT pipeline was failed with the error message:  Failure to initialize configuration for storage account storageaccount.dfs.core.windows.net: Invalid configuration value detected for fs.azure.account...

DLT Performance question with Unity Catalog

12-03-2023
Dear Community MembersThis question is about debugging performance issue of DLT pipeline with unity catalog.I had a DLT pipeline in Azure Databricks running on local store i.g. hive_metastore. And the processes took about 2 hour with the auto scalain...

Any way to move the unity catalog to a new external storage location?

12-02-2023
Dear Databricks CommunityThe question is about changing an existing unity catalog to a new storage location. For example: With an existing unity catalog (i.e. catalog1)  includeing schemas and volumes. The catalog is based on an external location (i....

How to manage data reload in DLT

11-29-2023
Hi, Community membersI had an situation to reload some data via DLT pipeline.  All data are stored in landing storage account and they have been loaded in daily base. For example, from 1/Nov to 30/Nov.For some reason, I need to reload the data of 25/...