Databricks Community

Hi @shahebaj, We're thrilled to hear about your positive experience at DAIS 2023 and your eagerness to give back to the community! Your participation and engagement are what make events like DAIS so valuable. We appreciate your support and look forwa...

Hi @Hyperparam42,  Thank you for sharing your experience and insights from the Data + AI Summit 2023! We're thrilled to hear that you found the talk on multicloud data streaming to be enlightening. We wanted to let you know that the Databricks Commun...

Hi @dy, Great to hear you had a valuable experience at DAIS 2023! We appreciate your attendance and participation. We wanted to share that the Databricks Community Team will be returning to San Francisco to host the Databricks Community booth at DAIS...

Hi @DatabricksBofA, That's fantastic to hear! It's always rewarding to see attendees like yourself finding value in the training and looking forward to implementing what you've learned. Your enthusiasm is truly appreciated! I wanted to share some exc...

Hi @ValMir, That's a wonderful sentiment! It's fantastic to hear that you found the DAIS event so enriching. Your enthusiasm for the community and its impact on the future of AI is truly inspiring. We greatly appreciate your attendance and participat...

Hi @mohaimen_syed, It sounds like you’re trying to use Databricks Connect to run a Python notebook on a remote Azure Databricks cluster from your local machine. Let’s break down the steps to achieve this: Configure Azure Databricks Authentication...

Hi @rahuja, The error you’re encountering might be related to the interaction between PySpark and XGBoost. Let’s explore some potential solutions: PySpark Version Compatibility: Ensure that your PySpark version is compatible with the XGBoost vers...

Hi, @Surajv, The warning you’re encountering is related to using Databricks Connect with PySpark.  Databricks Connect: Databricks Connect is a Python library that allows you to connect your local development environment to a Databricks cluster. I...

Hi @rafal_walisko, Handling large volumes of data using the Databricks API can indeed be challenging, especially when dealing with numerous chunks.   Let’s explore some strategies that might help you optimize your approach: Rate Limits and Paral...

Hi @ymt, It seems you’ve encountered an issue while connecting to Snowflake from your Databricks Notebook. The error message you received is: ImportError: cannot import name 'NamedTuple' from 'typing_extensions' (/databricks/python/lib/python3.9/s...

Then please change the code to:```iso_datetime = dbutils.widgets.get("LoadID")```

Got it. As a side note, I tried above methods, but the error persisted, hence upon reading docs again, there was this statement: You must install Python 3 on your development machine, and the minor version of your client Python installation must be t...

Hi @sharpbetty , Any suggestions how I can keep the parameter sharing and dependency from Task 1 to Task 2, yet also allow Task 2 to fire even on failure of Task 1?Setup:Task 2 dependent on Task1 Challenge: To Fire Task 2 even on Task 1 FailureSoluti...

Thank you Kaniz, let me try some of the options as my Databricks is integrated with AAD. Let me try Option 1 as thats my primary requirement.