- 4288 Views
- 3 replies
- 1 kudos
Resolved! Spark UI simulator is not available online
About 2 weeks ago I started course on "Optimizing Apache Spark on Databricks" from official Databricks academy. It is heavily based on Spark UI simulator experiments that were available here: https://www.databricks.training/spark-ui-simulator and for...
- 4288 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @LandanG The link is still not working. Any idea when it will be live again?http://www.databricks.training/spark-ui-simulator/GitHub - databricks-academy/spark-ui-simulator: Apache Spark UI simulator with 30+ educational experiments, pre-recorded ...
- 1 kudos
- 4763 Views
- 5 replies
- 0 kudos
Resolved! Not received my certificate after passing Databricks Certified Associate Developer for Apache Spark 3.0 - Python.
I've successfully passed Databricks Certified Associate Developer for Apache Spark 3.0 - Python but still have not received the certificate. E-mail : anwarpatel91@gmail.com
- 4763 Views
- 5 replies
- 0 kudos
- 0 kudos
Even i am facing the same issue. I have successfully passed Databricks Certified Associate Developer for Apache Spark - Python but still have not received the certificate. E-mail : simha6.reddy@gmail.com
- 0 kudos
- 16929 Views
- 8 replies
- 8 kudos
Resolved! connect databricks to teradata
hey i want to know can we connect databricks to the teradata database and if yes what will be the procedure ??? help would be appreciated
- 16929 Views
- 8 replies
- 8 kudos
- 8 kudos
There are two main ways to connect to Teradata from Databricks using Python.Way 1: Using Python Libraries (e.g., sqlalchemy, pyjdbc, pyodbc, jaydebeapi, and so on)Pros: Provides a comprehensive solution, allowing us to: Query data, Trigger stored pro...
- 8 kudos
- 7380 Views
- 5 replies
- 2 kudos
Graphframes not importing on Databricks 9.1 LTS ML
Is Graphframes for python meant to be installed by default on Databricks 9.1 LTS ML? Previously I was running the attached python command on 7.3 LTS ML with no issue, however now I am getting "no module named graphframes" when trying to import the pa...
- 7380 Views
- 5 replies
- 2 kudos
- 2 kudos
Hi @MuthuLakshmi , As per the documentation it was mentioned that graphframes comes preinstalled in databricks runtime for machine learning. but when trying to import the python module of graphframes, getting no module found error.from graphframes i...
- 2 kudos
- 57146 Views
- 8 replies
- 1 kudos
How to open Streamlit URL that is hosted by Databricks in local web browser?
I have run this webapp code on Databricks notebook. It works properly without any errors. With databricks acting as server, I am unable open this link on my browser for this webapp.But when I run the code on my local IDE, I am able to just open the U...
- 57146 Views
- 8 replies
- 1 kudos
- 3862 Views
- 2 replies
- 1 kudos
Can't import local files under repo
I have a yaml file inside one of the sub dir in Databricks, I have appended the repo path to sys. Still I can't access this file. https://docs.databricks.com/_static/notebooks/files-in-repos.html
- 3862 Views
- 2 replies
- 1 kudos
- 1 kudos
Hello @chandan_a_v ,were you able to solve this issue?I am also experiencing the same thing where i cannot move file with extension .yml from repo folder to shared workspace folder.As per documentation, this is the limitation or functionality of data...
- 1 kudos
- 3932 Views
- 3 replies
- 0 kudos
Where to move cluster-init scripts after latest message (Storing initialization scripts on DBFS is being deprecated. We recommend using a different storage location)?
Recently Databricks has started showing "Storing initialization scripts on DBFS is being deprecated. We recommend using a different storage location" . Is there an alternative of still keep using DBFS or do we need to move to ABSFS ? I could not find...
- 3932 Views
- 3 replies
- 0 kudos
- 0 kudos
It is suggested that we can use Workspace but databricks CLI not supporting importing shell scripts, but we can import shell script using web page?
- 0 kudos
- 8730 Views
- 5 replies
- 1 kudos
Resolved! My jobs and cluster were deleted in a suspicious way
I want to know what happen with my cluster and if I can recover it.I entered to my Databricks account and I didn't found my jobs and my cluster. I couldn't find any log of the deleted cluster because the log is into the cluster interface. I entered t...
- 8730 Views
- 5 replies
- 1 kudos
- 1 kudos
Dear folks,When the tables has been deleted, then why I am unable to create the table with same name.It continiously giving me error"DeltaAnalysisException: Cannot create table ('`spark_catalog`.`default`.`Customer_Data`'). The associated location ('...
- 1 kudos
- 2881 Views
- 2 replies
- 3 kudos
Databricks Libaries
Hello Team,I am trying to use the below libraries in data bricks .But they are not supporting.import com.microsoft.spark.sqlanalyticsfrom com.microsoft.spark.sqlanalytics.Constants import ConstantsPlease advise the correct Libraries nameRegardsRohit
- 2881 Views
- 2 replies
- 3 kudos
- 3 kudos
Hi @Rohit Kulkarni​ Yes, This module is not supported in databricks. May I know the use case behind using this library in databricks?FYI: To access Azure Synapse from Databricks using the Azure Synapse connector.Check the below doc: https://docs.data...
- 3 kudos
- 5528 Views
- 4 replies
- 1 kudos
Resolved! Question on Transaction logs and versioning in data bricks ?
Hi Experts ,No doubt data bricks supports ACID properties. What when it comes to versioning how much such versions will data bricks captures ? For Example : If i do any DML operations on top of Delta tables every time when i do it captures the tran...
- 5528 Views
- 4 replies
- 1 kudos
- 1 kudos
Hey,As a data enthusiast myself, I find this topic quite intriguing. Data Bricks indeed does a fantastic job in supporting ACID properties, ensuring data integrity, and allowing for versioning.To address BasavarajAngadi's question, Data Bricks effici...
- 1 kudos
- 11530 Views
- 8 replies
- 11 kudos
As the Databricks account manager; I cannot login: "Your user already belongs to a Databricks account"
On GCP I subscribed to Databricks in one project within the organization.Then I canceled this subscription and subscribed to Databricks in another project.When I try to login onto the newly subscribed databricks with google SSO:> There was an error s...
- 11530 Views
- 8 replies
- 11 kudos
- 11 kudos
I can see the issue might be related to organizations or billing accounts. The new Databricks project I tried creating was on a different organization/billing-account than the test Databricks subscription I created a month back.I went back to the ori...
- 11 kudos
- 26263 Views
- 3 replies
- 11 kudos
How do I access the account console of Databricks in Azure?
To create a Unity metastore the docs refer me to the account console in Databricks, see:https://docs.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/create-metastoreHowever when I go to manage account, I get redirected to select wo...
- 26263 Views
- 3 replies
- 11 kudos
- 11 kudos
Please refer here - https://community.databricks.com/s/question/0D58Y000098lIqgSAE/unity-catalog-azure-account-console-how-to-accessYou must be an Azure Databricks account admin.The first Azure Databricks account admin must be an Azure Active Directo...
- 11 kudos
- 13991 Views
- 3 replies
- 25 kudos
Bamboolib with databricks, low-code programming is now available on #databricks Now you can prepare your databricks code without ... coding. Low code ...
Bamboolib with databricks, low-code programming is now available on #databricksNow you can prepare your databricks code without ... coding. Low code solution is now available on Databricks. Install and import bamboolib to start (require a version of ...
- 13991 Views
- 3 replies
- 25 kudos
- 25 kudos
I have tried to load parquet file using bamboolib menu, and getting below error that path does not existI can load the same file without no problem using spark or pandas using following pathciti_pdf = pd.read_parquet(f'/dbfs/mnt/orbify-sales-raw/Wide...
- 25 kudos
- 11261 Views
- 2 replies
- 1 kudos
Resolved! Snowflake query with time travel not working from Databricks while reading into Dataframe.
I am trying to read the changes data from snowflake query into the dataframe using Databricks.Same query is working in snowflake but not in Databricks. Both sides timezones and format are same for the timestamp. I am trying to implement changetrackin...
- 11261 Views
- 2 replies
- 1 kudos
- 1 kudos
you are format is wrong that's why you got an errortry thisSELECT * FROM TestTable CHANGES(INFORMATION => DEFAULT) AT(TIMESTAMP => TO_TIMESTAMP_TZ('2023-05-03 00:43:34.885','YYYY-MM-DD HH24:MI:SS.FF'))
- 1 kudos
- 1427 Views
- 1 replies
- 0 kudos
Databricks Cross cloud (Databricks on AWS and Storage is on Azure)
We have a Databricks account on AWS and storage is on Azure Cloud (ADLS), because of cross-platform do we face any security and performance-related issues also is this feasible and supported? could you please provide your suggestions on this?
- 1427 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Janga Reddy​ Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 0 kudos