AnalysisException: [COLUMN_ALREADY_EXISTS] The column `` already exists. Consider to choose an

Raghav2 — Mon, 10 Jul 2023 19:13:33 GMT

Hey Guys,

I'm facing this exception while trying to read public s3 bucket "Analysis Exception: [COLUMN_ALREADY_EXISTS] The column `<column name>` already exists. Consider to choose another name or rename the existing column.",

also thing is I don't have direct access to s3 to see the schema so can't able to enter schema manually. We can change column name if we read the file right?, but 'm getting this while reading itself. Any Ideas please suggest

Re: AnalysisException: [COLUMN_ALREADY_EXISTS] The column `` already exists. Consider to

Lakshay — Thu, 13 Jul 2023 17:28:27 GMT

You can use dbutils to read the file.
%fs
head <s3 path>

topic Re: AnalysisException: [COLUMN_ALREADY_EXISTS] The column `<col>` already exists. Consider to in Data Engineering

AnalysisException: [COLUMN_ALREADY_EXISTS] The column `` already exists. Consider to choose an

Re: AnalysisException: [COLUMN_ALREADY_EXISTS] The column `` already exists. Consider to