Databricks Community

saninanda · 09-23-2019

I have file a.csv or a.parquet while creating data frame reading we can explictly define schema with struct type. instead of write the schema in the notebook want to create schema lets say for all my csv i have one schema like csv_schema and stored ...

saninanda · 09-24-2019

@shyamspr,Thanks for looking but as said both scenarios like we need to add the column data type explicitly with in notebook, consider 30 to 40+ columns .Its not reusable each notebook need to add the schema . As you updated say like the custom schem...

saninanda · 09-24-2019

Hi @shyamspr Thanks for sharing the answer. Actually i have tried with the approach like taking the header from raw filename and then adding those again.But the issue is want to explicitly change the data type as required without reading for inferr...

Databricks Community

User Stats

User Activity

how to read schema from text file stored in cloud storage

Re: how to read schema from text file stored in cloud storage

Re: how to read schema from text file stored in cloud storage