cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

AnalysisException: [COLUMN_ALREADY_EXISTS] The column `<col>` already exists. Consider to choose an

Raghav2
New Contributor

Hey Guys,     

     I'm facing this exception while trying to read public s3 bucket "Analysis Exception: [COLUMN_ALREADY_EXISTS] The column `<column name>` already exists. Consider to choose another name or rename the existing column.",

also thing is I don't have direct access to s3 to see the schema so can't able to enter schema manually. We can change column name if we read the file right?, but 'm getting this while reading itself. Any Ideas please suggest

 

1 REPLY 1

Lakshay
Databricks Employee
Databricks Employee

You can use dbutils to read the file.
%fs
head <s3 path>

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group