- 7048 Views
- 4 replies
- 5 kudos
Resolved! Why does spark.read.csv come back with an error: com.databricks.sql.io.FileReadException: Error while reading file dbfs:/mnt/cntnr/demo/circuits.csv ?
I need help understanding why I can't open a file.In a databricks notebook, I use this code:%fs ls /mnt/cntnr/demoI get back dbfs:/mnt/cntnr/demo/circuits.csv as one of the path values.When I use this code, I get an error:circuits_df = spark.read....
- 7048 Views
- 4 replies
- 5 kudos
- 5 kudos
It turns out my spark config was wrong #Set Spark configuration configs = {"fs.azure.account.auth.type": "OAuth", "fs.azure.account.oauth.provider.type": "org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider", "fs.azu...
- 5 kudos
- 8605 Views
- 2 replies
- 0 kudos
Resolved! Model Serving error - Java gateway process exited before sending its port number
Hello, I am trying to serve a model endpoint (using Databricks GUI) for a model that was successfully logged to the Model Registry. However, the endpoint creation failed with the following errors: Endpoint logs with error messagesEndpoint events with...
- 8605 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Nikhil Gajghate We haven't heard from you since the last response from @Kaniz Fatma , and I was checking back to see if her suggestions helped you.Or else, If you have any solution, please share it with the community, as it can be helpful to o...
- 0 kudos
- 8560 Views
- 1 replies
- 2 kudos
getting error while runction show function
I was using String indexer, while fitting, transforming I didn't get any erro. but While runnign show function I am getting error, I mention the error beloworg.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 45.0 failed...
- 8560 Views
- 1 replies
- 2 kudos
- 2 kudos
Hi @Bojja Giri Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 2 kudos
- 892 Views
- 1 replies
- 1 kudos
- 892 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Lili Levin Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 1 kudos
- 1347 Views
- 2 replies
- 2 kudos
Query with distinct sort and alias produces error column not found
I’m trying to use sql query on azure-databricks with distinct sort and aliasesSELECT DISTINCT album.ArtistId AS my_alias FROM album ORDER BY album.ArtistIdThe problem is that if I add an alias then I can not use not aliased name in the order by cla...
- 1347 Views
- 2 replies
- 2 kudos
- 2 kudos
SELECT album.ArtistId ,DISTINCT album.ArtistId AS my_alias FROM album ORDER BY album.ArtistIdCan you try this
- 2 kudos
- 1685 Views
- 4 replies
- 2 kudos
error: at least one column must be specified for the table.
error: at least one column must be specified for the table.
- 1685 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi @anand R Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we ca...
- 2 kudos
- 7594 Views
- 11 replies
- 7 kudos
Resolved! Insert into query showing error
Im trying to insert data from table with 7 columns to table with 37 columns
- 7594 Views
- 11 replies
- 7 kudos
- 1665 Views
- 2 replies
- 4 kudos
Error while rendering UI editor
Hi, does anyone facing an issue related to error while rendering editor on databricks notebook? it seems like this
- 1665 Views
- 2 replies
- 4 kudos
- 4 kudos
Hi, This looks like a browser issue. Could you please try it with some other browser? Or clear the cookies and caches of the same browser and confirm? Please tag @Debayan with your next comment so that I will get notified. Thank you!
- 4 kudos
- 8661 Views
- 2 replies
- 3 kudos
Missing Credential Scope - Unable to call databrick(Scala) notebook from ADF
Hi Team ,I am using job cluster while setting Linked Service in ADF to call Data bricks Notebook activity .Cluster Detail - Policy - UnrestrictedAccess Mode - Single userUnity Catalog Enabled.databrick run time - 12.2 LTS (includes Apache Spark 3.3.2...
- 8661 Views
- 2 replies
- 3 kudos
- 3 kudos
Hi @Akshay Patni We haven't heard from you since the last response from @Debayan Mukherjee . Kindly share the information with us, and in return, we will provide you with the necessary solution. Thanks and Regards
- 3 kudos
- 1183 Views
- 1 replies
- 0 kudos
Unable to create bloom filter index
I am unable to create bloom filter index on my tableCREATE BLOOMFILTER INDEX ON TABLE my_namespace.foo FOR COLUMNS (id OPTIONS (fpp = 0.1, numItems = 6000000))Gives the errorAnalysisException: Table `spark_catalog`.`my_namespace`.`foo` did not specif...
- 1183 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, You can refer to https://issues.apache.org/jira/browse/SPARK-27617 for the above error. Please let us know if this helps, also please tag @Debayan with your next response which will notify me, Thank you!
- 0 kudos
- 3557 Views
- 5 replies
- 1 kudos
Resolved! Getting error : Analysis Exception : olumn Is There a PO#17748 are ambiguous. It's probably because you joined several Datasets together, and some of these Datasets are the same. This column points to one of the Datasets but Spark.
AnalysisException: Column Is There a PO#17748 are ambiguous. It's probably because you joined several Datasets together, and some of these Datasets are the same. This column points to one of the Datasets but Spark is unable to figure out which one. ...
- 3557 Views
- 5 replies
- 1 kudos
- 1 kudos
Hi All,the solution for this problem is very strange.this has caused due to the version of the Databricks runtime.We are using Runtime version 7.0 with Apache Spark 3.0.0 version.In PRD we are using Runtime version 11.3LTS with Apache Spark 3.3.0 ver...
- 1 kudos
- 1545 Views
- 0 replies
- 0 kudos
java.lang.SecurityException: Could not verify permissions for DeleteFromTable ERROR IN EXTERNAL SYNAPSE TABLE
Hi guys, I am trying to delete an external table in Databricks that is connected to a Synapse table (via the com.databricks.spark.sqldw connector) but got the error shown below:Apart from that, when I try to execute an DELETE and INSERT actions (like...
- 1545 Views
- 0 replies
- 0 kudos
- 726 Views
- 0 replies
- 0 kudos
I'm getting a strange error whenever I try to execute some unittest tests of a class I have written in python. The error is 'DummyMod' object has no attribute...I don't understand this error and need some assistance to sort it out.
The class is written using Python 3.10 and relies on unittest framework for the tests. I'm running it on DB version 13.0 ML.
- 726 Views
- 0 replies
- 0 kudos
- 2099 Views
- 2 replies
- 0 kudos
UnsupportedOperationException: Cannot perform Merge as multiple source rows matched and attempted to modify the same
My Code:-- CREATE OR REPLACE TEMPORARY VIEW preprocessed_source ASSELECT Key_ID, Distributor_ID, Customer_ID, Customer_Name, ChannelFROM integr_masterdata.Customer_Master;-- Step 2: Perform the merge operation using the preprocessed source table...
- 2099 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Prashant Joshi Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us s...
- 0 kudos
- 2382 Views
- 2 replies
- 1 kudos
Resolved! How to enable spark.shuffle.compress in spark 3.3.0 or above versions?
when I try to set that I got a following error, appreciate your comments, thanks you in advance.
- 2382 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Ankith Patlolla Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answe...
- 1 kudos