Databricks Community

Dlt · 02-08-2024

Hello I have an executable file which i want to host and run from databricks. is this possible in databricks using DBFS ?If NOT what are the other ways to it in databricks ?

Dlt · 12-27-2023

Background. I have created a DLT pipeline in which i am creating a Temorary table. There are 5 temporary tables as such. When i executed these in an independent notebook they all worked fine with DLT. Now i have merged this notebook ( keeping same ...

Dlt · 02-09-2024

Thanks a lot for reply. I have a buildable code which i can build and create file which can run on linux platform.If that is the case then can you suggest how can i run it in databricks ? Can we keep it in dbfs and call it in notebook ?

Dlt · 01-02-2024

Issue is fixed now . I tried using live qualifier for all the tables I used and then it started workingThanks for all your helpThanks

Dlt · 12-28-2023

Hello , If i refer to above code you created then error is like below pyspark.errors.exceptions.AnalysisException: Failed to read dataset 'Temp_Table'. Dataset is not defined in the pipeline. for each of 5 Temp tables Below is flow at high level for...

Dlt · 12-28-2023

Hello I dropped all existing objects, deleted old DLT pipeline and creating a new one with same name but same problem is seen. Not sure why it complains about Temporary tables those would be created at runtime , even i tried to remove temporay flag b...

Dlt · 12-27-2023

Please note code had worked earlier when I was running it via seperate notebook , these errors are just typoConsidering code has no syntax issues what would went wrong with same code when its called below bronze layer notebook to have just one notebo...

Databricks Community

User Stats

User Activity

Running an exe file in databricks

DLT Pipeline issue - Failed to read dataset .Dataset is not defined in the pipeline.

Re: Running an exe file in databricks

Re: DLT Pipeline issue - Failed to read dataset .Dataset is not defined in the pipeline.

Re: DLT Pipeline issue - Failed to read dataset .Dataset is not defined in the pipeline.

Re: DLT Pipeline issue - Failed to read dataset .Dataset is not defined in the pipeline.

Re: DLT Pipeline issue - Failed to read dataset .Dataset is not defined in the pipeline.