- 2966 Views
- 2 replies
- 1 kudos
Databricks federation query why not support Oracle Database?
Hi,Based on the documents(https://docs.databricks.com/en/query-federation/index.html), Databricks federation query is not support Oracle for source. 1. Did you guys know the reason? (Is it depends on Oracle's speciality?)2. Is there another way to ru...
- 2966 Views
- 2 replies
- 1 kudos
- 1 kudos
@829023 There's limited support with respect to the pushdown and data types mapping as documented in our website: https://docs.databricks.com/en/query-federation/oracle.htmlThis was published recently, I believe in October, given your question was ra...
- 1 kudos
- 1386 Views
- 2 replies
- 0 kudos
Table Properties different for liquid clustering with Databricks version.
Dear all,Today, I tried the liquid clustering in Databricks, but after running it with two Databricks engine version, it showed different properties in the catalog explorer.1. Run with DBR version 14.3 LTS (includes Apache Spark 3.5.0, Scala 2.12) it...
- 1386 Views
- 2 replies
- 0 kudos
- 0 kudos
Correct, like @holly rightly said this is just an updated way of representing the columns in a more structured or updated manner, it may also be matching a new value type. In both cases the table property is reflecting that LC was enabled. Our sugges...
- 0 kudos
- 3124 Views
- 3 replies
- 0 kudos
Passing Parameters in a Workflow pipeline
Hello Mates,I’m currently working on four workflows, all of which are connected to my own notebook.The four workflows should be started automatically one after the other and the only point that should be passed is the output of Workflow 1.The workflo...
- 3124 Views
- 3 replies
- 0 kudos
- 0 kudos
Yes the problem is that the .set and .get function works within the same job run, it does not pass to another job
- 0 kudos
- 3411 Views
- 6 replies
- 1 kudos
Logging to an external location via UC volume
The way I understand it, mount points are deprecated in UC. db.fs.mount() doesn't even seem to work in newer DB runtimes.But what is the solution when Databricks features don't allow using UC volumes? E.g. specifying a compute's logging path won't wo...
- 3411 Views
- 6 replies
- 1 kudos
- 1 kudos
As you cannot use volumes it seems that indeed this will be your only option
- 1 kudos
- 7946 Views
- 1 replies
- 0 kudos
Unable to login to Databricks Community Edition
Hello All,I have successfully created a databricks account and went to login to the community edition with the exact same login credentials as my account, but it tells me that the email/password are invalid. I can login with these same exact credenti...
- 7946 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello Arihant!You can find helpful resources for Databricks Community Edition here. If the available resource doesn’t resolve your concern, feel free to submit a ticket with Databricks Support team for further assistance. Thank you.
- 0 kudos
- 2370 Views
- 2 replies
- 1 kudos
HOW TO SKIP A STEP FROM AN EXISTING WORKFLOW
Hi, can any one guide me in below scenario:Suppose we have created a workflow with 10 steps and our batches are running properly but due to some business requirement/testing purpose we have to skip step 4 and run the rest of job from step 5 onwords t...
- 2370 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @17abhishek ,You can try if/else conditions between the tasks with a Job parameter of "IsActiveTask" with a True or False.But it would be great if databricks team just add ability to simply disable some task from UI.
- 1 kudos
- 1640 Views
- 3 replies
- 0 kudos
DBR 16.0 spark read Azure Blob file Failed.
ala:570) at com.databricks.backend.daemon.driver.DriverWrapper.run(DriverWrapper.scala:354) at java.base/java.lang.Thread.run(Thread.java:840) Caused by: java.lang.NullPointerException at java.base/java.lang.Class.forName0(Native Method) at java.b...
- 1640 Views
- 3 replies
- 0 kudos
- 18164 Views
- 7 replies
- 1 kudos
FileNotFoundError: [Errno 2] No such file or directory: when I try to unzip .tar or .zip files it gives me this error
Hello, how are you? I have a small problem. I need to unzip some .zip, tar files. and gz inside these may have multiple files trying to unzip the .zip files i got this errorFileNotFoundError: [Errno 2] No such file or directory: but the files are in ...
- 18164 Views
- 7 replies
- 1 kudos
- 1 kudos
Hi @Alfredo Vallejos​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feed...
- 1 kudos
- 16117 Views
- 7 replies
- 15 kudos
Resolved! Failed to launch pipeline cluster
Hi, there. I encountered an issue when I was trying to create my delta live table pipeline. The error is "DataPlaneException: Failed to launch pipeline cluster 1202-031220-urn0toj0: Could not launch cluster due to cloud provider failures. azure_error...
- 16117 Views
- 7 replies
- 15 kudos
- 15 kudos
you can create the pool instance in the databricks under compute/pool and assign the value in the json of the DLT pipeline. With this, we will control on pool min workers and max workers and the reuse of the pools available by other pipelines. "node_...
- 15 kudos
- 10699 Views
- 4 replies
- 0 kudos
Exploring the Use of Databricks as a Transactional Database
Hey everyone, I’m currently working on a project where my team is thinking about using Databricks as a transactional database for our backend application. We're familiar with Databricks for analytics and big data processing, but we're not sure if it’...
- 10699 Views
- 4 replies
- 0 kudos
- 0 kudos
I have a similar situation in my data quality check process. During this stage, I frequently find errors or potential issues that can stop the pipeline. Each of these errors requires manual intervention, which might involve making edits or supplying ...
- 0 kudos
- 5396 Views
- 1 replies
- 0 kudos
Databricks:null error message: Cannot resolve hostname: Caused by: UnknownHostException
Hello,We are suddenly getting following error message while running any code from Databricks which is accessing Blob storage.We checked our App registration key and it's not expired.If we run to "dbutils.fs.mount" and we are able to get some info and...
- 5396 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @pora , just checking if this is still an issue, otherwise where is help still required? Could you also please elaborate on the setup and requirement.
- 0 kudos
- 5756 Views
- 1 replies
- 0 kudos
Understanding and loading SQL Server Temp Tables from Databricks
Hi everyone...Came across this question in Stackoverflow and wanted to try my hand in trying it. Unfortunately I have not been able to fix it...https://stackoverflow.com/questions/78953930/create-and-load-sql-server-temp-table-table-or-table-from-dat...
- 5756 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @ranged_coop , thanks for your question!Just checking if you were able to make progress, how far you were able to get and if still needing assistance ?
- 0 kudos
- 4366 Views
- 2 replies
- 0 kudos
Failure to locate configuration file when using spark-submit task
Hello,We are trying to run a job with a spark-sumit task on cluster mode, this spark submit task requires a configuration file application.conf that we provide using --files flag option in the spark-submit parameters and put an alias on it using \#ap...
- 4366 Views
- 2 replies
- 0 kudos
- 0 kudos
@Tham99 would it be possible to share the java.io.FileNotFoundException stacktrace? And refernece from the Driver log about the file localization process.
- 0 kudos
- 6650 Views
- 3 replies
- 0 kudos
Databricks Autoloader Schema Evolution throws StateSchemaNotCompatible exception
I am trying to use Databricks Autoloader for a very simple use case:Reading JSONs from S3 and loading them into a delta table, with schema inference and evolution.This is my code:self.spark \ .readStream \ .format("cloudFiles") \ .o...
- 6650 Views
- 3 replies
- 0 kudos
- 0 kudos
@robertkoss I have the exact same problem... have you found a solution ?
- 0 kudos
- 17141 Views
- 3 replies
- 4 kudos
Resolved! Unable to read data from ADLS using databricks serverless sql pool
I have a data bricks workspace and an Azure data lake storage account.Both are present in the same Vnet.Unity catalog is enabled in the worksapce.I have created some tables in unity catalog.I am able to query the data from the tables when I use the a...
- 17141 Views
- 3 replies
- 4 kudos
- 4 kudos
I'm having the same issue and tried to follow the document shared above, but quite not sure what I'm missing, as I can't make it work. Can someone please help me here? TIA.
- 4 kudos
| User | Count |
|---|---|
| 1644 | |
| 793 | |
| 570 | |
| 349 | |
| 287 |
