@M_Bharath: I too have faced this issue and I think it is filtered/blocked by my employer's email service. I downloaded the certificate from https://www.accredible.com/ Databricks badges and certifications are automatically published there. You may r...
I would like to add my experience with 3. Databricks API 10k Character LimitWe had a similar issue, and this limit cannot be changed. Instead review concepts of sharing the input/output between Databricks and caller using cloud storage like ADLS. Pro...
My PoV please, We use Databricks REST API; and we have faced 401 or Azure Front door related auth issues. Like you said, we use retry mechanism. Runtime errors are recorded and retry attempts are made if the tasks are idempotent; otherwise user inter...
Hello,IMHO, having a HTTP related task in a Spark cluster is an anti-pattern. This kind of code executes at the Driver, it will be synchronous and adds overhead. This is one of the reasons, DLT (or SDP - Spark Declarative Pipeline) does not have REST...
