Databricks Community

RoelofvS · 10-25-2024

I am working through the current version of the standard AutoLoader demo, i.e. dbdemos.install('auto-loader')I.e. data gets read into a dataframe, but never written to a target table.Notebook is "01-Auto-loader-schema-evolution-Ingestion"Compute i...

RoelofvS

They should at minimum provide a reason for suspending the exam.I am planning to write soon and worry about this case.I have written 3 exams before without problems, and will write again in the same environment.

RoelofvS · 11-04-2024

Hello @Brahmareddy,> enable detailed logging to trace schema evolution stepsPlease can you still advise on the above?Kind regards - Roelof

RoelofvS · 11-01-2024

Hello @Brahmareddy,I have tried the above, without success.> enable detailed logging to trace schema evolution stepsPlease can you giude me with the steps or a URL? We are on AWS.Kind regards - Roelof

RoelofvS · 10-29-2024

Hello Brahma,Thank you for your response. To answer your suggestions:1) cloudFiles.schemaEvolutionMode: It is default behaviour, but I have also added it explicitly.option("cloudFiles.schemaEvolutionMode", "addNewColumns")2) "try pointing to a new sc...

Databricks Community

User Stats

User Activity

Schema evolution in Autoloader not evolving beyond version 0

Re: Suspended exam

Re: Schema evolution in Autoloader not evolving beyond version 0

Re: Schema evolution in Autoloader not evolving beyond version 0

Re: Schema evolution in Autoloader not evolving beyond version 0