- 1455 Views
- 1 replies
- 0 kudos
SAP Data in Databricks
Any one using SAP data to brining in to Databricks, do you directly hit SAP ODP or use any third party tool to get the data to datalake . Thanks,
- 1455 Views
- 1 replies
- 0 kudos
- 0 kudos
With the recent news form SAP, looks like SAP DataSphere will be the only way forward for, SAP
- 0 kudos
- 1279 Views
- 1 replies
- 0 kudos
Query for user persona for DB products
What is the typical user persona for DB products?
- 1279 Views
- 1 replies
- 0 kudos
- 0 kudos
Databricks supports many personas, the primary ones are Data Engineer, Data Scientisits, Data Analysts. but also, secondary ones are Analytics Engineers, Machine Learning Engineers, Data Stewareds, Data Administrators and Data Architect.
- 0 kudos
- 1925 Views
- 1 replies
- 2 kudos
Resolved! Is there any way to get notified for any new private preview and public preview features
As a databricks customer Is there any way to subscribe to get notified to email for any private preview and public preview features?
- 1925 Views
- 1 replies
- 2 kudos
- 2 kudos
Subscribe to the Databricks Newsletter and join the Quarterly Product Roadmap Webinars where they announce all the new private previews.
- 2 kudos
- 1132 Views
- 1 replies
- 0 kudos
Error in DLT Streaming table
HelloI am trying to create DLT streaming table in Azure Data bricks but getting following error. I checked online article regarding this error but none of the article shown complete resolution.[STREAM_FAILED] Query [id = 9989a41e-741d-48d7-9a87-fc143...
- 1132 Views
- 1 replies
- 0 kudos
- 0 kudos
HI @Retired_modCan you pls share the library or package name which contain "com.databricks.cdc.spark.DebeziumJDBCMicroBatchProvider" class. I tried to add databricks-cdc and Debezium library using maven but unable to install them because they are not...
- 0 kudos
- 2339 Views
- 0 replies
- 0 kudos
File Not Found Error while reading pickle file
Hello, thereI have a pickle file uploaded in a mounted location in databricks ( /dbfs/mnt/blob/test.pkl). I am trying to read this pickle file using the below python snippetwith open(path + "test.pkl", "rb") as f: bands = pickle.load(f)But it t...
- 2339 Views
- 0 replies
- 0 kudos
- 9764 Views
- 2 replies
- 0 kudos
Resolved! Using private package, getting ERROR: No matching distribution found for myprivatepackage
My project's setup.py filefrom setuptools import find_packages, setup PACKAGE_REQUIREMENTS = ["pyyaml","confluent-kafka", "fastavro", "python-dotenv","boto3", "pyxlsb", "aiohttp", "myprivatepackage"] LOCAL_REQUIREMENTS = ["delta-spark", "scikit-lea...
- 9764 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi, Does this look like a dependency error? All the dependencies are packed in the whl? Also, could you please confirm if all the limitations are satified? Refer: https://docs.databricks.com/en/compute/access-mode-limitations.html
- 0 kudos
- 5801 Views
- 2 replies
- 0 kudos
Resolved! Is DBFS going to be deprecated?
Is DBFS going to be deprecated? As I am using /dbfs/FileStore/tables/ location where a jar file is stored, and I am copying this jar file to /databricks/jars locations.My concerns is as DBFS root and mounts are deprecated, is that mean in coming days...
- 5801 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi Raphael,I am trying below init script to achieve this task, PFAAnd getting error as below,Cluster scoped init script abfss://container@storage.dfs.core.windows.net/init_script.sh failed: Failure to initialize configuration for storage account stor...
- 0 kudos
- 3824 Views
- 1 replies
- 2 kudos
How to update python's runtime on AWS lambda function
I heard that version 3.8 of Python on AWS Lambda will be EOL within the year. I would like to update this runtime, but where can I find the CloundFormation stack template.
- 3824 Views
- 1 replies
- 2 kudos
- 2 kudos
Thanks. I went to AWS Cloudformation stack and edited the template from python 3.8 to 3.12 and updated. I did this for both the workspace stack and the s3 ingestion stack. Will it break anything? Do I need to make any changes in the python code in th...
- 2 kudos
- 1125 Views
- 0 replies
- 0 kudos
Init_script in workspace
How can use init script stored in workspace which copies jar from storage account and put it inside /databricks/jars location. As said in init_script migration document, where your init scripts are “self-contained,” i.e., DO NOT reference other files...
- 1125 Views
- 0 replies
- 0 kudos
- 1350 Views
- 0 replies
- 0 kudos
com.databricks.backend.common.rpc.SparkDriverExceptions$SQLExecutionException: java.io.IOException:
I have been getting this error for the past few days while trying to create a table using parquet or csv options. The error is :IOException: s3a://AKIAJBRYNXGHORDHZB4A:a0BzE1bSegfydr3%2FGE3LSPM6uIV5A4hOUfpH8aFF@databricks-corp-training/common/online_...
- 1350 Views
- 0 replies
- 0 kudos
- 1241 Views
- 1 replies
- 2 kudos
Havent receive databricks associate certification
HiI passed my Databricks data engineer associate exam on 28 jun 2024. I haven't recieved my Certification even after 62 hours.Is any body facing the same issue?Tried to contacted databricks bt no response yet.Kindly help
- 1241 Views
- 1 replies
- 2 kudos
- 2 kudos
Same for me as well, I took exam on 29th Jun and still didn't receive the Certificate.
- 2 kudos
- 2296 Views
- 3 replies
- 2 kudos
Error while writing dataframe to csv file.
Hi Folks, Need help to resolve an error. I'm getting a below error while writing a dataframe into a csv file and exporting that file.Error:py4j.protocol.Py4JJavaError: An error occurred while calling o53.save.: java.lang.UnsatisfiedLinkError: 'boolea...
- 2296 Views
- 3 replies
- 2 kudos
- 2 kudos
Do I see it correctly that you're actually not using Databricks, but Spark, locally installed, instead? Your issue can have many different causes, like an incompatible Java version. In this case, I can only refer to the official docs.
- 2 kudos
- 1342 Views
- 1 replies
- 0 kudos
Error while running Job sparkSession is null while trying to executeCollectResult
Hi,I have started getting following error while running jobs in databrick. It started failing since last few days. Recently I have migrated to unity catalogue, no other change was made recently. I am running on DBR 13.3 LTS. com.google.common.util.co...
- 1342 Views
- 1 replies
- 0 kudos
- 0 kudos
Although it won't be the root cause of your issue, one thing worth mentioning is that `.trigger(once=True)` is obsolete by now and was replaced by `availableNow=True`
- 0 kudos
- 3488 Views
- 3 replies
- 1 kudos
ADF - Fails to run job in workspace in another subscription
We are trying to run a Databricks job from ADF, but we keep getting the following error:Operation on target Run dbt job failed: {"error_code":"PERMISSION_DENIED","message":"User <adf-mi-prod-id> does not have Manage Run or Owner or Admin permissions...
- 3488 Views
- 3 replies
- 1 kudos
- 1 kudos
I am seeing the error message above whenever job 123 is triggered by ADF, but I can't find any instances of this job running in Databricks.
- 1 kudos
- 2951 Views
- 0 replies
- 0 kudos
DBCE login works, but shows two workspace with the same email
Hi:I'm able to login in DBCE but it shows two workspace(s) with the same email. Please see the attached screenshot.That's strange. What gives ?
- 2951 Views
- 0 replies
- 0 kudos
