- 1736 Views
- 1 replies
- 0 kudos
Update metastore bucket
Hello,Our Databricks workspace is currently hosted on AWS account1, while the meta store bucket is configured within a separate AWS account2. We want to transfer this bucket to account1 to eliminate our reliance on account2. How to configure this buc...
- 1736 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, You can use: https://github.com/databrickslabs/migrate/blob/master/METASTORE.md# for the metastore data migration. Please tag @Debayan with your next comment which will get me notified.
- 0 kudos
- 12243 Views
- 8 replies
- 4 kudos
InternalError, error message: The output of the notebook is too large.
Hello guys. I am having the following annoying issue with DataBricks job executed from ADF. I have stopped all the logs, deleted all the print statements and display. And I am still getting this error. I don't understand what might cause it. I am att...
- 12243 Views
- 8 replies
- 4 kudos
- 4 kudos
Apologies for the late reply. I will try to upload the logs,cause it's been some time.Interesting is how I solve it. I put all the code in a single cell and It is running since then without issues. Although it was just few cells with python code. I e...
- 4 kudos
- 11226 Views
- 1 replies
- 1 kudos
S3 Permission errors
Hello Background -I have an S3 datalake set up prior to signing up with Databricks. I'm still in my evaluation period. I'm trying to read the contents of an S3 bucket but am getting all kinds of permission problems. Here is the command in the noteb...
- 11226 Views
- 1 replies
- 1 kudos
- 1 kudos
UPDATE:The permission problems only exist when the Cluster's (compute's) Access mode is "Shared No Isolation". When the Access Mode is either "Shared" or "Single User" then the IAM configuration seems to apply as expected. When set to "Shared No Is...
- 1 kudos
- 2563 Views
- 0 replies
- 0 kudos
move databricks workspace to another resource group
Hello Databricks Community,I have to issue related to Azure databricks workspace:- First: I have one azure databrick workspace in resource group A. But I want to move this to resource group B, but as I know Azure hasn't supported yet. So which is the...
- 2563 Views
- 0 replies
- 0 kudos
- 986 Views
- 0 replies
- 0 kudos
Job REST API CORS error
Hello guys,I want to integrate Databricks Job API to the share point site. But I have a CORS policy error that blocks all of the calls from the share point site. How can I white list my share point site ? Or is there any other way ? Thank you
- 986 Views
- 0 replies
- 0 kudos
- 5402 Views
- 3 replies
- 0 kudos
Cannot %run notebook using relative path
In the root of my workspace, I have the following folder structure set up:/foo / ETL / setup / utilitiesFrom a notebook in /foo/ETL or /foo/setup, if I try to %run a notebook in /foo/utilities by giving the relative path ../utilities/<x>, I get...
- 5402 Views
- 3 replies
- 0 kudos
- 0 kudos
Hello @DManowitz-BAH ,Hope you are doing great, I tried to replicate this behavior on 12.2 LTS runtime and didn't get any errors for the same folder/workspace structure..Can you share the cluster configuration details so I can mimic exactly the same ...
- 0 kudos
- 3257 Views
- 2 replies
- 1 kudos
Apache spark proficient
What is the best way to be proficient in Apache spark?
- 3257 Views
- 2 replies
- 1 kudos
- 2119 Views
- 1 replies
- 1 kudos
Delta Live Tables: BAD_REQUEST: Pipeline cluster is not reachable.
Hello community: I don´t know why my Delta Live table workflow fails into this step. This is the configuration I have for the pipeline:{"id": "**","pipeline_type": "WORKSPACE","clusters": [{"label": "default","spark_conf": {***},"num_workers": 3},{"l...
- 2119 Views
- 1 replies
- 1 kudos
- 4198 Views
- 4 replies
- 3 kudos
Databricks repos adds white spaces to notebook.
Hi,Databricks repos is making white spaces in the notebooks, without us opening the notebook. So seems to be automatically. Does someone has a solution how we can turn this off?An example:Can someone helps us with this?
- 4198 Views
- 4 replies
- 3 kudos
- 3 kudos
This bug is causing problems in our CI/CD pipeline too. I've had to manually clear things to keep it running as we get merge conflicts when no changes are made.
- 3 kudos
- 5994 Views
- 0 replies
- 0 kudos
- 5994 Views
- 0 replies
- 0 kudos
- 6173 Views
- 0 replies
- 0 kudos
Connecting to hive metastore as well as glue catalog at the sametime
Hi,Is there any way we can connect glue catalog as well as to hive metastore in the same warehouse?I can create a single instance profile and provide all the required access for buckets or for glue catalog.I tried with the below configuration,spark.s...
- 6173 Views
- 0 replies
- 0 kudos
- 1648 Views
- 0 replies
- 0 kudos
Optuna results change when rerun on Databricks
The best trial results seem to change every time the same study is rerun. On Microsoft Azure this can be fixed by setting the sampler seed. However this solution doesn't seem to work on Databricks. Does anyone know why that is the case and how to mak...
- 1648 Views
- 0 replies
- 0 kudos
- 1195 Views
- 0 replies
- 0 kudos
Using SQL to create delta live tables but column headers from csv have spaces
I know this has probably been asked many times, although I have struggled to find the answer using sql CREATE STREAMING LIVE TABLE bronze_site_usage COMMENT "ingest latest snapshot from api"TBLPROPERTIES ("layer" = "bronze") AS SELECT * FROM cloud_fi...
- 1195 Views
- 0 replies
- 0 kudos
- 975 Views
- 0 replies
- 0 kudos
Structured Streaming from TimescaleDB
I realize that the best practice would be to integrate our service with Kafka as a streaming source for Databricks, but given that the service already stores data into TimescaleDB, how can I stream data from TimescaleDB into DBX? Debezium doesn't wor...
- 975 Views
- 0 replies
- 0 kudos
- 3610 Views
- 1 replies
- 0 kudos
No results were found: the query results may no longer be available or you may not have permissions
When anyone (admins included) click on an alert task in a job run we see the error `No results were found: the query results may no longer be available or you may not have permissions`.Should we be seeing something else or is this a matter of a poor ...
- 3610 Views
- 1 replies
- 0 kudos
- 0 kudos
The error message "No results were found: the query results may no longer be available or you may not have permissions" is designed to address a range of potential situations. This includes instances where data might not be accessible due to reasons ...
- 0 kudos
