I would like to catch and handle an exception in a structured streaming job.The databricks notebook still displays the exception, regardless of added exception handling (see attached screenshot)I guess that the exception is displayed by the cell outp...
great to be here
Hi All, I recently have a use case where i need to run something on the databricks cluster and the bare requirement is that python version shoulde be 3.8 and DBR version should be 11+. I am confused on how to handle this. Is there anyway in which we ...
Hi @deficiant_codge Hope everything is going great. Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us...
Databricks Data+AI Summit has been very interesting. New(ish) user here with a background on healthcare. I see huge efficiency gains for healthcare providers in using specialized LLMs to get a synopsis of patient history. Would a provider need to tra...
Hey everyone! As a healthcare enthusiast, I completely agree with Dave-Griffith's point about the potential efficiency gains in using specialized LLMs for patient history. It's amazing how advanced technology like Dolly can revolutionize healthcare.T...
@Anonymous , @Retired_mod , Could you please help me?Several days ago I was able to log into Databricks Partner portal but now I can't and even resetting password is not helping.Thanks in advance.
Hi @asgalantsevepam Thank you for posting your question in our community! We are happy to assist you. To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answ...
I had an issue when I was answering an exam for a certification. The exam was interrupted due to an issue on secure browser software, the screen became black and I could not finish the exame because I could not see the rest of the questions in the qu...
Hi @ari_reyes Thank you for posting your question in our community! We are happy to assist you. To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers yo...
Hi I have signed up and looking to sign in the Course Generative AI in community, but when I log in using my correct password and username, it does not accept the information, so can't complete the course, can you please offer help for this.I have re...
Hi @Hydra We haven't heard from you since the last response from @yogu , and I was checking back to see if her suggestions helped you. Or else, If you have any solution, please share it with the community, as it can be helpful to others. Also, Plea...
SQL Merge not adding new columns to delta table error is: cannot resolve Target AuditUpdateDate in UPDATE clause given columns in Sourcethis config is set: spark.conf.set("spark.databricks.delta.schema.autoMerge.enabled",True)We're using DBR 12.2 LTS...
Hi I completed Databricks Lakehouse Fundamentals exam but didn't got my badge
@saqib_rasool plz submit tikcit to support team https://help.databricks.com/s/contact-us?ReqType=training
I am trying to setup a recon activity between GCP Pub-Sub and databricks, Is there any way to fetch the last 24hrs record count from Pub-Sub?I tried but not got any direct solution for it, It will be great if any one can suggest me the way t#pubsub, ...
Hi @Ajay-Pandey Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too. Cheers!
I am attempting to apply Mosaic's `grid_pointascellid` method on a spark dataframe with `lat`, `lon` columns.```import pyspark.sql.functions as F# Create a Spark DataFrame with a lat and lon columndf = spark.createDataFrame([("point1", 10.0, 20.0),("...
@kll This error appears because the function grid_pointascellid expects a Double type column and a Decimal column type was provided as input.To overcome this, before you apply the grid_pointascellid, I would recommend casting the columns lat and lon....
I created a workspace and a metastore(following the long tedious instructions). I assigned the workspace to the metastore. workspace -> Data, I can see the metastore link on the top left of the page. Through it I configured the permissions (giving me...
Answering my own question - all that is needed is to refresh the Data web page!
Hi all,I hope you could help me to figure out what I am missing.I'm trying to do a simple thing. To read the data from the data ingestion zone (csv files saved to Azure Storage Account) using the Delta Live Tables pipeline and share the resulting tab...
Sorry, I think I've created the post in the wrong thread. Created the same post in the Community Cove.
Hi,I attended Databricks certified associate developer for apache spark 3.0- scala on 09 July 2023(today). At 7.35pm suddenly got a notice stating that due to eye movement away from exam your exam got suspended.I had completed the exam and was at the...
Hi @nikhil018 Thank you for reaching out! Please submit a ticket to our Training Team here: https://help.databricks.com/s/contact-us?ReqType=training and our team will get back to you shortly.
Brand new Databricks account, Workspace (Premium tier)New SQL Warehouse (Small, Pro)Brand new FiveTran trialI can't seem to use Partner Connect to connect to FiveTran in my trial. It appeared to work at first, and after attempting to sync with Stripe...
Hi @Anonymous ,So far, I haven't been able to get it to work. However, I really appreciate @Prabakar's answer and your follow-up. I'm still interpreting @Prabakar's wise advice; however, I think it mostly doesn't apply to this situation, as I'm using...
