I've been trying to register for Databricks Community Edition for 3 days, to study the platform, but I'm experiencing an error when registering ("An error has occurred. Please try again later."). Could anyone help me, how do I register for the commun...
Hi!I was always able to export pandas datasets to my workspace on databricks, just like in a local machine using df.to_excel('filename', index=False).but since i got some permissions updates to some new catalogs, when i try to export a dataset using ...
Just to update the situation, and to help anyone with the same problem in the future:What hapened was thas my cluster was updated to use Unity Catalogs, and with that i had to specify the full path to my workspace.df_pandas.to_excel('/Workspace/Users...
When I was tring ti run the dbdemos for llm-rag-fine-tuning I'm stuck on one of the first lines of code. When trying to execute the function: databricks.model.foundation_model.create(...) with the Mistral_7B_instruct_v2.0 it is failing with the follo...
Currently using my account and the command dbutils.notebook.entry_point.getDbutils().notebook().getContext().apiUrl().get().apiToken().get() to get my current databricks token to access this function. And my user just doesn't have admin permissions ...
Any one using SAP data to brining in to Databricks, do you directly hit SAP ODP or use any third party tool to get the data to datalake . Thanks,
With the recent news form SAP, looks like SAP DataSphere will be the only way forward for, SAP
What is the typical user persona for DB products?
Databricks supports many personas, the primary ones are Data Engineer, Data Scientisits, Data Analysts. but also, secondary ones are Analytics Engineers, Machine Learning Engineers, Data Stewareds, Data Administrators and Data Architect.
As a databricks customer Is there any way to subscribe to get notified to email for any private preview and public preview features?
Subscribe to the Databricks Newsletter and join the Quarterly Product Roadmap Webinars where they announce all the new private previews.
HelloI am trying to create DLT streaming table in Azure Data bricks but getting following error. I checked online article regarding this error but none of the article shown complete resolution.[STREAM_FAILED] Query [id = 9989a41e-741d-48d7-9a87-fc143...
HI @Retired_modCan you pls share the library or package name which contain "com.databricks.cdc.spark.DebeziumJDBCMicroBatchProvider" class. I tried to add databricks-cdc and Debezium library using maven but unable to install them because they are not...
Hello, thereI have a pickle file uploaded in a mounted location in databricks ( /dbfs/mnt/blob/test.pkl). I am trying to read this pickle file using the below python snippetwith open(path + "test.pkl", "rb") as f: bands = pickle.load(f)But it t...
My project's setup.py filefrom setuptools import find_packages, setup PACKAGE_REQUIREMENTS = ["pyyaml","confluent-kafka", "fastavro", "python-dotenv","boto3", "pyxlsb", "aiohttp", "myprivatepackage"] LOCAL_REQUIREMENTS = ["delta-spark", "scikit-lea...
Hi, Does this look like a dependency error? All the dependencies are packed in the whl? Also, could you please confirm if all the limitations are satified? Refer: https://docs.databricks.com/en/compute/access-mode-limitations.html
Is DBFS going to be deprecated? As I am using /dbfs/FileStore/tables/ location where a jar file is stored, and I am copying this jar file to /databricks/jars locations.My concerns is as DBFS root and mounts are deprecated, is that mean in coming days...
Hi Raphael,I am trying below init script to achieve this task, PFAAnd getting error as below,Cluster scoped init script abfss://container@storage.dfs.core.windows.net/init_script.sh failed: Failure to initialize configuration for storage account stor...
I heard that version 3.8 of Python on AWS Lambda will be EOL within the year. I would like to update this runtime, but where can I find the CloundFormation stack template.
Thanks. I went to AWS Cloudformation stack and edited the template from python 3.8 to 3.12 and updated. I did this for both the workspace stack and the s3 ingestion stack. Will it break anything? Do I need to make any changes in the python code in th...
How can use init script stored in workspace which copies jar from storage account and put it inside /databricks/jars location. As said in init_script migration document, where your init scripts are “self-contained,” i.e., DO NOT reference other files...
I have been getting this error for the past few days while trying to create a table using parquet or csv options. The error is :IOException: s3a://AKIAJBRYNXGHORDHZB4A:a0BzE1bSegfydr3%2FGE3LSPM6uIV5A4hOUfpH8aFF@databricks-corp-training/common/online_...
HiI passed my Databricks data engineer associate exam on 28 jun 2024. I haven't recieved my Certification even after 62 hours.Is any body facing the same issue?Tried to contacted databricks bt no response yet.Kindly help
Same for me as well, I took exam on 29th Jun and still didn't receive the Certificate.
Hi Folks, Need help to resolve an error. I'm getting a below error while writing a dataframe into a csv file and exporting that file.Error:py4j.protocol.Py4JJavaError: An error occurred while calling o53.save.: java.lang.UnsatisfiedLinkError: 'boolea...
Do I see it correctly that you're actually not using Databricks, but Spark, locally installed, instead? Your issue can have many different causes, like an incompatible Java version. In this case, I can only refer to the official docs.
