- 2125 Views
- 1 replies
- 2 kudos
Execute code on Application End
Hello,I want to execute a custom code onApplicationEnd. Outisde Databricks, I have used the Spark Listener onApplicationEnd without problems. But it is not working on Databricks (I tried listener onJobEnd and this one worked).I have also tried Spark ...
- 2125 Views
- 1 replies
- 2 kudos
- 2 kudos
Did you find any solution?
- 2 kudos
- 4598 Views
- 3 replies
- 1 kudos
Need help to insert huge data into cosmos db from azure data lake storage using databricks
I am trying to insert 6GB of data into cosmos db using OLTP ConnectorContainer RU's:40000Cluster Config:cfg = { "spark.cosmos.accountEndpoint" : cosmosdbendpoint, "spark.cosmos.accountKey" : cosmosdbmasterkey, "spark.cosmos.database" : cosmosd...
- 4598 Views
- 3 replies
- 1 kudos
- 1 kudos
Did anyone find solution for this, I’m also using similar clutter and RAU and data ingestion taking lot of time….?
- 1 kudos
- 2094 Views
- 0 replies
- 0 kudos
Dataframe functions not ending
Hi everyone,For a few days now, my notebook containing some Databricks functions stopped working.Last day my notebook correctly ran was the 6th of April.Since then, jobs won't stop and keep running because some functions don't end.I figured those fun...
- 2094 Views
- 0 replies
- 0 kudos