Databricks Community

Hey @minhhung0507 - quick question - what is the cluster type you're using to run your workflow?I'm using a shared, interactive cluster, so I'm passing the parameter {'existing_cluster_id' : task['existing_cluster_id']}in the payload. This parameter ...

Agreed, I am exploring the TPT and other options which are agreeable to customer.Meanwhile ,My question is do we have a Bladebridge component that facilitates Data movement between Teradata and databricks.If its available which component of Bladebrid...

Hi @yashojha1995 EOL while scanning string literal hints that there might be a syntax error in the update query.could you share your update query here, and any other info such as how are you creating a Linked service to your delta lake? Does it mean ...

Hello!The issue where a full table query in Azure Databricks via VB Script and Simba Spark ODBC returns no data, but TOP works, likely stems from the ODBC driver's inability to handle the large result set at once. Investigate and increase the driver'...

Looks like the Spark UI simulator is no longer available, more over the Apache Spark optimization course also vanished from the Databricks academy. I've seen that there's a new cohort named Databricks optimization but it lacks the depth and experienc...

Based on the provided context, it appears that there isn't a direct way within Databricks to dynamically set job tags at runtime based on a parameter passed to the job. However, there are alternative approaches you can consider to work around this li...

Hey @HoussemBL You're correct about DLT not support Auto LC. You can assign any columns in the cluster_by but if you set it to auto, it will throw an error complaining about auto not being present in the list of columns.Maybe, altering thee table to ...

Hi @manish_tanwar  how can we work with streamlit apps in databricks , i have a use case where i want to ingest data from different csv files and ingest it into delta tables 

So, it appears that the there is conflicting documentation on this topic.  I checked with our internal documention and what I found was that you CANNOT install JDBC or ODBC drivers on Serverless.  See limitations here: https://docs.databricks.com/aws...

Hello @Vasu_Kumar_T - We've used Bladebridge to convert from Redshift to Databricks. Bladebridge can definetly convert to Spark SQL, not sure about Scala Spark though.