- 5482 Views
- 4 replies
- 1 kudos
sparkR.session
Why might this be erroring out? My understanding is that SparkR is built into Databricks.Code:library(SparkR, include.only=c('read.parquet', 'collect'))sparkR.session() Error:Error in sparkR.session(): could not find function "sparkR.session"
- 5482 Views
- 4 replies
- 1 kudos
- 3813 Views
- 1 replies
- 0 kudos
How to add delay between databricks workflow job tasks.?
I want to add an explicit time delay between databricks workflow job tasks, any help would be greatly appreciated. Thanks
- 3813 Views
- 1 replies
- 0 kudos
- 0 kudos
@Milliman - you could add min_retry_interval_millis to add delay between start of the failed run and the subsequent retry run. Reference is here
- 0 kudos
- 1882 Views
- 0 replies
- 0 kudos
workspace level sso gives authentication failed error
We have enabled workspace level sso , and have V2.0 version of databricks using azure EntraID groups and azure applications.Values in both databricks and azure application matchStill we get sso auth failed error.How can this be resolved , SAML tracer...
- 1882 Views
- 0 replies
- 0 kudos
- 4069 Views
- 0 replies
- 0 kudos
🌟 Welcome Newcomers! 🌟
Hello and welcome to our wonderful Community!Whether you are here by chance or intention, we're thrilled to have you join us. Before you dive into the plethora of discussions and activities happening here, we'd love to get to know you better! ...
- 4069 Views
- 0 replies
- 0 kudos
- 1276 Views
- 0 replies
- 0 kudos
This job uses a format which has been deprecated since 2016
After creating a Databricks job using CLI v0.214.0 from a JSON input.I see the following message in the UI: "This job uses a format which has been deprecated since 2016, update it to dependent libraries automatically or learn more"When I update it, I...
- 1276 Views
- 0 replies
- 0 kudos
- 5780 Views
- 0 replies
- 0 kudos
TIMEZONE
Can I get some help from Databricks to help me understand how those timestamps being interpreted? Some are really confusing me. I have timestamp coming into AWS Databricks as String type. And the string timestamp is represented in UTC. I ran below qu...
- 5780 Views
- 0 replies
- 0 kudos
- 11548 Views
- 1 replies
- 0 kudos
Syntax of UPDATE Command in DataBricks
Hi All,I am testing the sql generated by our ETL software to see if it can run on data bricks SQL which I believe is Delta Tables underneath. This is the statement we are testing. As far as I can tell from the manual the from clause is not supported ...
- 11548 Views
- 1 replies
- 0 kudos
- 1734 Views
- 1 replies
- 0 kudos
Workspace level changes in databricks
Hi Team,Is there any way in data bricks to track the changes that happen at notebook level. I know using system tables we can track the changes that happen at table/view/function/ other objects. However, is there any way to track all those changes in...
- 1734 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @ManiTejaG , Hope you are doing well! You can use the Audit logs to capture the notebook events that are logged at the workspace level. Please refer to this for more details : https://docs.databricks.com/en/administration-guide/account-settings/a...
- 0 kudos
- 7974 Views
- 4 replies
- 1 kudos
Resolved! Unable to use the bamboolib in a databricks notebook
I am getting the same below error message while trying to use Bamboolib in a databricks notebook.Error: Could not display the widget. Please re-run the cell.I have installed the pypi libraries for bamboolib on the cluster and the databricks runtime v...
- 7974 Views
- 4 replies
- 1 kudos
- 3743 Views
- 1 replies
- 0 kudos
Bamboolib Error: Could not display the widget. Please re-run the cell.
Trying to run bamboolib via command bamI get: Error: Could not display the widget. Please re-run the cell.I get this sometimes. Not others.Other times bam UI works. Help
- 3743 Views
- 1 replies
- 0 kudos
- 0 kudos
I am getting the same below error message while trying to use Bamboolib in a databricks notebook.Error: Could not display the widget. Please re-run the cell.I have installed the pypi libraries for bamboolib on the cluster and the databricks runtime v...
- 0 kudos
- 3116 Views
- 0 replies
- 0 kudos
Pandas_Udod max batch size not working in notebook
Hello I am trying to set max batch size for pandas-udf in Databricks notebook, but in my tests it doesn’t have any effect on size. spark.conf.set("spark.sql.execution.arrow.enabled", "true")spark.conf.set('spark.sql.execution.arrow.maxRecordsPerBatch...
- 3116 Views
- 0 replies
- 0 kudos
- 11442 Views
- 13 replies
- 1 kudos
Databricks Connect Scala -
Hi,I'm using Databricks Connect to run Scala code from IntelliJ on a Databricks single node cluster.Even with the simplest code, I'm experiencing this error:org.apache.spark.SparkException: grpc_shaded.io.grpc.StatusRuntimeException: INTERNAL: org.ap...
- 11442 Views
- 13 replies
- 1 kudos
- 3382 Views
- 3 replies
- 6 kudos
Avatars in Community
Could it be nice to enable the use of one own photo instead of a ready avatar?
- 3382 Views
- 3 replies
- 6 kudos
- 6 kudos
I think you can tag the Admins or the Community managers where they can help you with some relevant answers , tagging a few I know.@Kaizen@Sujitha @s_park @
- 6 kudos
- 2122 Views
- 1 replies
- 0 kudos
community.databricks.com doesn't open in Poland?
I and 3 of my friends can't open https://community.databricks.com/ from Poland. The page returns 403. Different LTE and internet providers
- 2122 Views
- 1 replies
- 0 kudos
- 0 kudos
I'm having the same issue while connecting from my ISP from Poland. @Retired_mod can you please help us with this?
- 0 kudos
- 8028 Views
- 4 replies
- 2 kudos
Resolved! Action Required: Init Scripts on DBFS will stop working
Hello,I am seeing this message on all databricks environments.Action Required: Init Scripts on DBFS will stop working on March 31, 2024You must migrate init scripts of DBFS or opt-in to a september 1, 2024 extension by March 31Not sure what this is f...
- 8028 Views
- 4 replies
- 2 kudos
- 2 kudos
How are yall managing your init script versions? I have mine in a repo i connected into databricks workspace and im using it within there. With multiple users they can push it to the repo and we can merge it in.
- 2 kudos
