- 5053 Views
- 2 replies
- 0 kudos
Resolved! Is DBFS going to be deprecated?
Is DBFS going to be deprecated? As I am using /dbfs/FileStore/tables/ location where a jar file is stored, and I am copying this jar file to /databricks/jars locations.My concerns is as DBFS root and mounts are deprecated, is that mean in coming days...
- 5053 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi Raphael,I am trying below init script to achieve this task, PFAAnd getting error as below,Cluster scoped init script abfss://container@storage.dfs.core.windows.net/init_script.sh failed: Failure to initialize configuration for storage account stor...
- 0 kudos
- 3466 Views
- 1 replies
- 2 kudos
How to update python's runtime on AWS lambda function
I heard that version 3.8 of Python on AWS Lambda will be EOL within the year. I would like to update this runtime, but where can I find the CloundFormation stack template.
- 3466 Views
- 1 replies
- 2 kudos
- 2 kudos
Thanks. I went to AWS Cloudformation stack and edited the template from python 3.8 to 3.12 and updated. I did this for both the workspace stack and the s3 ingestion stack. Will it break anything? Do I need to make any changes in the python code in th...
- 2 kudos
- 1008 Views
- 0 replies
- 0 kudos
Init_script in workspace
How can use init script stored in workspace which copies jar from storage account and put it inside /databricks/jars location. As said in init_script migration document, where your init scripts are “self-contained,” i.e., DO NOT reference other files...
- 1008 Views
- 0 replies
- 0 kudos
- 1251 Views
- 0 replies
- 0 kudos
com.databricks.backend.common.rpc.SparkDriverExceptions$SQLExecutionException: java.io.IOException:
I have been getting this error for the past few days while trying to create a table using parquet or csv options. The error is :IOException: s3a://AKIAJBRYNXGHORDHZB4A:a0BzE1bSegfydr3%2FGE3LSPM6uIV5A4hOUfpH8aFF@databricks-corp-training/common/online_...
- 1251 Views
- 0 replies
- 0 kudos
- 1075 Views
- 1 replies
- 2 kudos
Havent receive databricks associate certification
HiI passed my Databricks data engineer associate exam on 28 jun 2024. I haven't recieved my Certification even after 62 hours.Is any body facing the same issue?Tried to contacted databricks bt no response yet.Kindly help
- 1075 Views
- 1 replies
- 2 kudos
- 2 kudos
Same for me as well, I took exam on 29th Jun and still didn't receive the Certificate.
- 2 kudos
- 1929 Views
- 3 replies
- 2 kudos
Error while writing dataframe to csv file.
Hi Folks, Need help to resolve an error. I'm getting a below error while writing a dataframe into a csv file and exporting that file.Error:py4j.protocol.Py4JJavaError: An error occurred while calling o53.save.: java.lang.UnsatisfiedLinkError: 'boolea...
- 1929 Views
- 3 replies
- 2 kudos
- 2 kudos
Do I see it correctly that you're actually not using Databricks, but Spark, locally installed, instead? Your issue can have many different causes, like an incompatible Java version. In this case, I can only refer to the official docs.
- 2 kudos
- 1163 Views
- 1 replies
- 0 kudos
Error while running Job sparkSession is null while trying to executeCollectResult
Hi,I have started getting following error while running jobs in databrick. It started failing since last few days. Recently I have migrated to unity catalogue, no other change was made recently. I am running on DBR 13.3 LTS. com.google.common.util.co...
- 1163 Views
- 1 replies
- 0 kudos
- 0 kudos
Although it won't be the root cause of your issue, one thing worth mentioning is that `.trigger(once=True)` is obsolete by now and was replaced by `availableNow=True`
- 0 kudos
- 2426 Views
- 3 replies
- 1 kudos
ADF - Fails to run job in workspace in another subscription
We are trying to run a Databricks job from ADF, but we keep getting the following error:Operation on target Run dbt job failed: {"error_code":"PERMISSION_DENIED","message":"User <adf-mi-prod-id> does not have Manage Run or Owner or Admin permissions...
- 2426 Views
- 3 replies
- 1 kudos
- 1 kudos
I am seeing the error message above whenever job 123 is triggered by ADF, but I can't find any instances of this job running in Databricks.
- 1 kudos
- 1829 Views
- 0 replies
- 0 kudos
DBCE login works, but shows two workspace with the same email
Hi:I'm able to login in DBCE but it shows two workspace(s) with the same email. Please see the attached screenshot.That's strange. What gives ?
- 1829 Views
- 0 replies
- 0 kudos
- 1549 Views
- 1 replies
- 2 kudos
Unable to login to databricks community edition
Hi Team, I was not able to login to Databricks community edition It’s working fine for me yesterday when I used but today while logging in it’s directing to same login page after entering user name and password . Can someone please look into this iss...
- 1549 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi I have the same problem. I used CE for logging MLFlow experiments and now can't login into my account. Can you please look into it @Sujitha @Retired_mod?
- 2 kudos
- 813 Views
- 1 replies
- 0 kudos
Hi I am trying to change datatype of DOB column from stringtype to DateType but getting issue
Hi I am trying to change datatype of DOB column from String type to DateType but getting issue"SparkUpgradeException: [] You may get a different result due to the upgrading to Spark >= 3.0: Caused by: DateTimeParseException: Text '7/8/1972' could not...
- 813 Views
- 1 replies
- 0 kudos
- 0 kudos
It's because the format you're using it wrong. Use `'M/d/yyyy'` instead.
- 0 kudos
- 1160 Views
- 1 replies
- 1 kudos
Error in notebook while execution
Error in callback <bound method UserNamespaceCommandHook.post_run_cell of <dbruntime.DatasetInfo.UserNamespaceCommandHook object at 0x7f5790c07070>> (for post_run_cell)
- 1160 Views
- 1 replies
- 1 kudos
- 1 kudos
https://community.databricks.com/t5/data-engineering/error-in-notebook-execution/m-p/76226#M35165
- 1 kudos
- 2101 Views
- 2 replies
- 1 kudos
Resolved! Cluster Termination Issue
Hi, I am new to ADB and started recently using this community edition. I created a cluster and it is terminating immediately when i use to connect.What I am missing or what i need do? kindly help me.
- 2101 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi Walter_C, thanks for your response. Your assumption is correct. Now I tried to create new Cluster whenever I start practice. Then no issues.
- 1 kudos
- 1027 Views
- 1 replies
- 1 kudos
Winston-Salem/Greensboro, NC User Group
Hi All! I'm looking to start at Databricks Usergroup in the Greensboro/Winston-Salem, NC area. Wanted to gauge interest to find others who would like to join.
- 1027 Views
- 1 replies
- 1 kudos
- 1 kudos
Thank you for setting this up, Brandon!
- 1 kudos
- 4733 Views
- 4 replies
- 0 kudos
Where the "Driver logs" are stored by default, and How much default space to store it.
Recently, when I was using databricks for deep learning I ran into an issue, i.e., after a certain amount of time of execution the cluster would break and restart. The logs are as below:The Event logs displayed "Metastore is down; Driver is up but is...
- 4733 Views
- 4 replies
- 0 kudos
- 0 kudos
Hello Jaron, is it not possible for you to redirect the login to an ABFSS or S3 bucket?
- 0 kudos
