cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

jorgemarmol
by New Contributor II
  • 1574 Views
  • 1 replies
  • 1 kudos

Delta Live Tables: BAD_REQUEST: Pipeline cluster is not reachable.

Hello community: I don´t know why my Delta Live table workflow fails into this step. This is the configuration I have for the pipeline:{"id": "**","pipeline_type": "WORKSPACE","clusters": [{"label": "default","spark_conf": {***},"num_workers": 3},{"l...

jorgemarmol_0-1692258030914.png
  • 1574 Views
  • 1 replies
  • 1 kudos
Siebert_Looije
by Contributor
  • 2605 Views
  • 4 replies
  • 3 kudos

Databricks repos adds white spaces to notebook.

Hi,Databricks repos is making white spaces in the notebooks, without us opening the notebook. So seems to be automatically. Does someone has a solution how we can turn this off?An example:Can someone helps us with this?

Siebert_Looije_0-1691401285378.png
  • 2605 Views
  • 4 replies
  • 3 kudos
Latest Reply
cprosser
New Contributor II
  • 3 kudos

This bug is causing problems in our CI/CD pipeline too. I've had to manually clear things to keep it running as we get merge conflicts when no changes are made.

  • 3 kudos
3 More Replies
RC
by Contributor
  • 5191 Views
  • 0 replies
  • 0 kudos

Connecting to hive metastore as well as glue catalog at the sametime

Hi,Is there any way we can connect glue catalog as well as to hive metastore in the same warehouse?I can create a single instance profile and provide all the required access for buckets or for glue catalog.I tried with the below configuration,spark.s...

Community Platform Discussions
Databricks
glue catalog
hive metastore
  • 5191 Views
  • 0 replies
  • 0 kudos
Shwang
by New Contributor
  • 1255 Views
  • 0 replies
  • 0 kudos

Optuna results change when rerun on Databricks

The best trial results seem to change every time the same study is rerun. On Microsoft Azure this can be fixed by setting the sampler seed. However this solution doesn't seem to work on Databricks. Does anyone know why that is the case and how to mak...

  • 1255 Views
  • 0 replies
  • 0 kudos
Erik_L
by Contributor II
  • 622 Views
  • 0 replies
  • 0 kudos

Structured Streaming from TimescaleDB

I realize that the best practice would be to integrate our service with Kafka as a streaming source for Databricks, but given that the service already stores data into TimescaleDB, how can I stream data from TimescaleDB into DBX? Debezium doesn't wor...

  • 622 Views
  • 0 replies
  • 0 kudos
ncouture
by Contributor
  • 2100 Views
  • 1 replies
  • 0 kudos

No results were found: the query results may no longer be available or you may not have permissions

When anyone (admins included) click on an alert task in a job run we see the error `No results were found: the query results may no longer be available or you may not have permissions`.Should we be seeing something else or is this a matter of a poor ...

  • 2100 Views
  • 1 replies
  • 0 kudos
Latest Reply
SparkJun
Databricks Employee
  • 0 kudos

The error message "No results were found: the query results may no longer be available or you may not have permissions" is designed to address a range of potential situations. This includes instances where data might not be accessible due to reasons ...

  • 0 kudos
Murat_Aykit
by New Contributor
  • 948 Views
  • 1 replies
  • 0 kudos

Cannot create an account to try Community Edition

Hi,Whenever I try to signup for an account, I keep getting the following message in the first step - "an error has occurred. please try again later" Could you please let me know why this could be? I tried multiple emails and seems to be having same i...

  • 948 Views
  • 1 replies
  • 0 kudos
Latest Reply
Debayan
Databricks Employee
  • 0 kudos

Is it the same in all the browsers? 

  • 0 kudos
jomt
by New Contributor III
  • 5980 Views
  • 1 replies
  • 0 kudos

Resolved! How do you properly read database-files (.db) with Spark in Python after the JDBC update?

I have a set of database-files (.db) which I need to read into my Python Notebook in Databricks. I managed to do this fairly simple up until July when a update in SQLite JDBC library was introduced. Up until now I have read the files in question with...

  • 5980 Views
  • 1 replies
  • 0 kudos
Latest Reply
jomt
New Contributor III
  • 0 kudos

When the numbers in the table are really big (millions and billions) or really low (e.g. 1e-15), SQLite JDBC may struggle to import the correct values. To combat this, a good idea could be to use customSchema in options to define the schema using Dec...

  • 0 kudos
saberw
by New Contributor
  • 4571 Views
  • 0 replies
  • 0 kudos

Cron Schedule like 0 58/30 6,7,8,9,10,11,12,13,14,15,16,17 ? * MON,TUE,WED,THU,FRI * does not work

when we use this cron schedule: 0 58/30 6,7,8,9,10,11,12,13,14,15,16,17 ? * MON,TUE,WED,THU,FRI *so far only the 58th minute will run, but not the 28th minute (30minutes after 58th minute). Is there some kind of bug in the cron scheduler?Reference: h...

  • 4571 Views
  • 0 replies
  • 0 kudos
hukel
by Contributor
  • 2992 Views
  • 5 replies
  • 1 kudos

Resolved! Databricks Add-on for Splunk v1.2 - Error in 'databricksquery' command

Is anyone else using the new v1.2 of the Databricks Add-on for Splunk ?   We upgraded to 1.2 and now get this error for all queries.Running process: /opt/splunk/bin/nsjail-wrapper /opt/splunk/bin/python3.7 /opt/splunk/etc/apps/TA-Databricks/bin/datab...

  • 2992 Views
  • 5 replies
  • 1 kudos
Latest Reply
hukel
Contributor
  • 1 kudos

There is a new mandatory parameter for databricksquery called account_name.    This breaking change is not documented in Splunkbase release notes but it does appear in the docs within the Splunk app. databricksquery cluster="<cluster_name>" query="<S...

  • 1 kudos
4 More Replies
GeKo
by New Contributor III
  • 1009 Views
  • 0 replies
  • 0 kudos

global init script from workspace file ?

Hi Community,based on the announced change on Sep 1st, disabling cluster scoped init scripts in DBFS, I have questions re *global* init scripts.I am creating global init scripts via terraform "databricks_global_init_script" resources. Where do those ...

Community Platform Discussions
databricks_global_init_script
init script
workspace file
  • 1009 Views
  • 0 replies
  • 0 kudos
shanmukh_b
by New Contributor
  • 19829 Views
  • 1 replies
  • 0 kudos

Convert string date to date after changing format

Hi,I am using Data bricks SQL and came across a scenario. I have a date field whose dates are in format of 'YYYY-MM-DD'. I changed their format into 'MM/DD/YYYY' using DATE_FORMAT() function.EFF_DT = 2000-01-14   EFF_DT _2 = DATE_FORMAT(EFF_DT, 'MM/d...

Community Platform Discussions
Databricks SQL
date
sql
string
  • 19829 Views
  • 1 replies
  • 0 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 0 kudos

if you use to_date, you will get a date column as mentioned above.If you want to use the format MM/dd/yyyy you can use date_format but this will return a string column.In order to use Spark date functions, Date string should comply with Spark DateTyp...

  • 0 kudos

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Top Kudoed Authors