Databricks Community

MDV

I'm getting a error when I want to select the first() or collect() from a dataframe when using a collation different than UTF8_BINARYExample that reproduces the issue :This works :df_result = spark.sql(f""" SELECT 'en-us' AS ET...

MDV

I'm getting a error when I want to select the first() from a dataframe when using a collation different than UTF8_BINARYThis works :df_result = spark.sql(f""" SELECT 'en-us' AS ETLLanguageCode""")display(df_result)print(df_resu...

MDV · 02-18-2025

Hello,I recently noticed that the ALTER TABLE ALTER COLUMN SYNC IDENTITY command is no longer functioning as expected.I have an IDENTITY column on my table:D_Category_SID BIGINT GENERATED BY DEFAULT AS IDENTITY (START WITH 1 INCREMENT BY 1)Previously...

MDV · 11-07-2024

Is it possible to have the service principal (ID) of an Azure data factory as the Single user access on an databricks cluster ?Reason I'm asking is because we are starting to use unity catalog , but would still have the need to execute stored procedu...

MDV

That is what I'm doing now, but I can't image that it is the meaning to behave like this. I think this is a bug that needs to be fixed. This is just a mear example, it does this with dataframes coming from unity catalog where the collation is set on ...

MDV

other example :

MDV · 11-14-2024

It worked, but we had to create the cluster using an API call, we couldn't select the service principle as user

MDV · 11-07-2024

Hello, did you find a solution to this or a workaround ?

MDV · 03-25-2024

@rchauhan did you find a solution to the problem or know what settings caused the problem ?

Databricks Community

User Stats

User Activity

Problem with df.first() or collect() when collation different from UTF8_BINARY

Collation problem with df.first() when different from UTF8_BINARY

ALTER TABLE ... ALTER COLUMN .... SYNC IDENTITY not working anymore ?

Compute configuration : single user with service principal of azure data datafactory ?

Re: Problem with df.first() or collect() when collation different from UTF8_BINARY

Re: Collation problem with df.first() when different from UTF8_BINARY

Re: Compute configuration : single user with service principal of azure data datafactory ?

Re: Running Stored Procedures on a Multi-node/ Shared Cluster

Re: org.apache.spark.SparkException: Job aborted due to stage failure: Task 1 in stage 188.0 failed