Hi @Arjun Kaimaparambil Rajan​ ,

Thank you for your answer. Yes, I think this is indeed the case.

I can see a mismatch between the content of the DBFS when:

1. Using my machine and the CLI (the NewDataset folder is listed when using the command "databricks fs ls dbfs:/FileStore/tables/") .
2. Using the GUI of Databricks (the NewDataset folder is not listed when using Databricks => Data => Create New Table => DBFS => /FileStore/tables).

In other words, the command "databricks fs cp -r <MyLocalDataset> dbfs:/FileStore/tables/NewDataset/" is uploading the dataset "somewhere", but not to the DBFS I can see with the GUI via Databricks => Data => Create New Table => DBFS => /FileStore/tables.

My question is:

• What command should I type in order to upload the dataset there?

Thank you very much in advance!

Kind regards,

Nacho