Databricks

Gopal269673 · 05-02-2023

Hi All.. I had created 2 job flows and one for transaction layer and another for datamart layer. I need to specify the job dependency between job1 vs Job2 and need to trigger the job2 after completing job1 without using any other orchestration tool o...

Gopal269673 · 03-31-2023

Hi All.. Need your help in this issue what i am facing. Currently we are using data bricks as a platform to build pipeline and execute our talend ETL sqls converted into the spark sql framework as we were facing issues in loading the history data int...

Gopal269673 · 05-02-2023

Hi Priyag can you point the correct link as i am not seeing any specific feature other than API

Gopal269673 · 05-02-2023

Can you provide the link for this so that even i need this details

Gopal269673 · 04-06-2023

@All Users Group Metrics stats also attached here.Thanks.

Gopal269673 · 04-06-2023

@All Users Group Hi All.. we had tried several options of tuning the query by selecting required variables in the select and subsequent clauses. I see other queries are little ok to run. But the attached query seems not able to run from past 6 hour...

Gopal269673 · 04-03-2023

@Vigneshraja Palaniraj Sure Vignesh . Thanks a for your review and inputs. let me try this. Currently shared cluster is used by users and need to plan in sometime where jobs are not planned to align it to single node memory one. Any suggestable mem...

Databricks

User Stats

User Activity

Calling jobs inside another job

Facing issues in running the converted code in spark sql framework with 5 to 10 percent volume of prod data. Need help in solving this and suggestions required.

Re: Calling jobs inside another job

Re: CICD for Jobs @ WorkFlows

Re: Facing issues in running the converted code in spark sql framework with 5 to 10 percent volume of prod data. Need help in solving this and suggestions required.

Re: Facing issues in running the converted code in spark sql framework with 5 to 10 percent volume of prod data. Need help in solving this and suggestions required.

Re: Facing issues in running the converted code in spark sql framework with 5 to 10 percent volume of prod data. Need help in solving this and suggestions required.