cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

129876
by New Contributor III
  • 3233 Views
  • 8 replies
  • 2 kudos

bamboolib not working correctly

I'm trying to use bamboolib on the 11.0 recommended DBR. I am using the option "Databricks: Load database table" The databases and tables that are on the unity catalog do not populate the dropdown boxes. How can I fix this?

  • 3233 Views
  • 8 replies
  • 2 kudos
Latest Reply
Vidula
Honored Contributor
  • 2 kudos

Hello @k.b.​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!

  • 2 kudos
7 More Replies
rammy
by Contributor III
  • 3761 Views
  • 5 replies
  • 18 kudos

How would i upload file stream object to S3 bucket using pyspark?

I could able to save data using pyspark into S3 but not sure on how to save a file stream object into S3 bucket using pyspark. I could achieve this with help of python but when Unity catalog was enabled on Databrciks it always ends up with an access ...

  • 3761 Views
  • 5 replies
  • 18 kudos
Latest Reply
rammy
Contributor III
  • 18 kudos

I got to know that there is a change required at Unity-catalog to make it work with Python and got a recommendation to use pyspark to store file into S3.I do not see much information about storing a file stream object in an S3 bucket anywhere. Can an...

  • 18 kudos
4 More Replies
parthsalvi
by Contributor
  • 3934 Views
  • 4 replies
  • 3 kudos

Resolved! Python Code not working in DBR 10.4 LTS - Shared Mode

Hello,We're trying to use DBR 10.4 LTS in Shared Mode. But our python code is not working in that cluster.We're running into following messageYour administrator has only allowed sql commands on this cluster. This execution contained at least one disa...

image
  • 3934 Views
  • 4 replies
  • 3 kudos
Latest Reply
Cedric
Valued Contributor
  • 3 kudos

Hi Parthsalvi,Could you please try using 11.1+ and see if that works?

  • 3 kudos
3 More Replies
data_boy_2022
by New Contributor III
  • 4230 Views
  • 2 replies
  • 3 kudos

Are Python UDFs supported in Unity Catalog?

I am trying to execute a UDF written in Python and receive the following error message:Error message: [UC_COMMAND_NOT_SUPPORTED] UDF/UDAF functions are not supported in Unity Catalog.;The limitation is not mentioned in the docs( https://docs.databric...

  • 4230 Views
  • 2 replies
  • 3 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 3 kudos

Indeed it is not mentioned in the limitations.This blog mentions python UDFs in UC, but in databricks SQL, not the classic DE workspace.So it seems that it is not (yet) supported, as the docs only mention SQL functions.

  • 3 kudos
1 More Replies
129876
by New Contributor III
  • 1307 Views
  • 2 replies
  • 2 kudos

Unable to run spark sql commands from ipywidget button click event

I'm unable to run any command that queries data from the unity catalog within a function that executes in the event of an ipywidget button click. Code block below. I cannot do queries such as spark.sql(f"SHOW SCHEMAS;") or spark.sql(f"select * from d...

  • 1307 Views
  • 2 replies
  • 2 kudos
Latest Reply
Atanu
Esteemed Contributor
  • 2 kudos

can you try to println out? val databricksApiTokenKey = CredentialContext.INHERITED_PROPERTY_DATABRICKS_API_TOKEN val databricksApiCredentialOpt = CredentialContext.getCredential(databricksApiTokenKey) val rawUrlProp = spark.sparkContext.get...

  • 2 kudos
1 More Replies
Labels