Databricks

carlosancassani · 01-05-2024

Hi all,I need to perform an Update on a Delta Table adding elements to a column of ArrayType(StringType()) which is initialized empty.Before UpdateCol_1 StringType()Col_2 StringType()Col_3 ArrayType()ValVal[ ]After UpdateCol_1 StringType()Col_2 Strin...

carlosancassani · 10-13-2022

I get this error when trying to execute parallel slave notebook from a Pyspark "master notebook".note 1: I use same class, functions, cluster, credential for another use case of parallel notebook in the same databricks instance and it works fine.note...

carlosancassani · 10-18-2022

Hi, I add a note: there are no UDF's in the "master notebook" nor the "slave notebooks"; the command works fine if the "master notebook" is launched from a Job, while it returns the error above when the notebook is launched manually.

Databricks

User Stats

User Activity

Update DeltaTable on column type ArrayType(): add element to array

Error: Credential size is more than configured size limit. As a result credential passthrough won't work for this notebook run.

Re: Error: Credential size is more than configured size limit. As a result credential passthrough won't work for this notebook run.