- 13618 Views
- 6 replies
- 4 kudos
Databricks Rewards Portal and the points credited in it
@Sujitha Hi Sujitha, Could you please let us know when we can see the Databricks rewards portal and we hope that the points credited over there will remain the same. Please update on these 2.
- 13618 Views
- 6 replies
- 4 kudos
- 4 kudos
@Sujitha Could you please let us know when we can see the Databricks rewards portal. i see its still under construction
- 4 kudos
- 7878 Views
- 1 replies
- 0 kudos
Resolved! How do you properly read database-files (.db) with Spark in Python after the JDBC update?
I have a set of database-files (.db) which I need to read into my Python Notebook in Databricks. I managed to do this fairly simple up until July when a update in SQLite JDBC library was introduced. Up until now I have read the files in question with...
- 7878 Views
- 1 replies
- 0 kudos
- 0 kudos
When the numbers in the table are really big (millions and billions) or really low (e.g. 1e-15), SQLite JDBC may struggle to import the correct values. To combat this, a good idea could be to use customSchema in options to define the schema using Dec...
- 0 kudos
- 5887 Views
- 0 replies
- 0 kudos
Cron Schedule like 0 58/30 6,7,8,9,10,11,12,13,14,15,16,17 ? * MON,TUE,WED,THU,FRI * does not work
when we use this cron schedule: 0 58/30 6,7,8,9,10,11,12,13,14,15,16,17 ? * MON,TUE,WED,THU,FRI *so far only the 58th minute will run, but not the 28th minute (30minutes after 58th minute). Is there some kind of bug in the cron scheduler?Reference: h...
- 5887 Views
- 0 replies
- 0 kudos
- 3992 Views
- 5 replies
- 1 kudos
Resolved! Databricks Add-on for Splunk v1.2 - Error in 'databricksquery' command
Is anyone else using the new v1.2 of the Databricks Add-on for Splunk ? We upgraded to 1.2 and now get this error for all queries.Running process: /opt/splunk/bin/nsjail-wrapper /opt/splunk/bin/python3.7 /opt/splunk/etc/apps/TA-Databricks/bin/datab...
- 3992 Views
- 5 replies
- 1 kudos
- 1 kudos
There is a new mandatory parameter for databricksquery called account_name. This breaking change is not documented in Splunkbase release notes but it does appear in the docs within the Splunk app. databricksquery cluster="<cluster_name>" query="<S...
- 1 kudos
- 1541 Views
- 0 replies
- 0 kudos
global init script from workspace file ?
Hi Community,based on the announced change on Sep 1st, disabling cluster scoped init scripts in DBFS, I have questions re *global* init scripts.I am creating global init scripts via terraform "databricks_global_init_script" resources. Where do those ...
- 1541 Views
- 0 replies
- 0 kudos
- 3260 Views
- 2 replies
- 0 kudos
Azure Databricks notebook can't be renamed
Hi all,I'm new to Databricks and just started using it for my work project. I've been trying creating test notebooks for practice purposes, but when I tried to rename it, either just through clicking the title or clicking edit from file, it showed "R...
- 3260 Views
- 2 replies
- 0 kudos
- 0 kudos
The issue you are encountering with renaming or moving notebooks could be due to a permissions issue in Databricks. Here are a few things you can check:Check your workspace permissions:Ensure that you have the appropriate permission to edit and move ...
- 0 kudos
- 24876 Views
- 1 replies
- 0 kudos
Convert string date to date after changing format
Hi,I am using Data bricks SQL and came across a scenario. I have a date field whose dates are in format of 'YYYY-MM-DD'. I changed their format into 'MM/DD/YYYY' using DATE_FORMAT() function.EFF_DT = 2000-01-14 EFF_DT _2 = DATE_FORMAT(EFF_DT, 'MM/d...
- 24876 Views
- 1 replies
- 0 kudos
- 0 kudos
if you use to_date, you will get a date column as mentioned above.If you want to use the format MM/dd/yyyy you can use date_format but this will return a string column.In order to use Spark date functions, Date string should comply with Spark DateTyp...
- 0 kudos
- 7442 Views
- 0 replies
- 0 kudos
Workspace region
ERROR- Your workspace region is not yet supported for model serving, please see https://docs.databricks.com/machine-learning/model-serving/index.html#region-availability for a list of supported regions.The account is in ap-south-1. I can see there is...
- 7442 Views
- 0 replies
- 0 kudos
- 2088 Views
- 1 replies
- 0 kudos
How to install AWS .pem file in databricks cluster to make a db connection to MySql RDS
I am trying to make a connection between AWS Mysql RDS and Databricks. I am using the below code to establish the connection. But its failed due to certificate is not installed. I have the .pem file with me. Could anyone help on how install this in D...
- 2088 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, Could you please provide the error code or the full error stack? Please tag @Debayan with your next comment which will notify me. Thank you!
- 0 kudos
- 6651 Views
- 2 replies
- 1 kudos
Resolved! Download Dolly model on local machine
Hi~ I am new to LLM engineering, and am trying to download the Dolly-v2-7b model on local machine, so I don't need to connect to internet each time I am going to run the Dolly-v2-7b. Is it possible to do that? Thanks a lot!
- 6651 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi Kaniz and Sean, thanks for your responses and time.I was trying Kaniz's method, but got a reply from Sean, so I tried that too. I downloaded the file from the link Sean provided and saved it on my local machine, then used the code for Dollyv2 (htt...
- 1 kudos
- 13026 Views
- 5 replies
- 0 kudos
Python notebook crashes with "The Python kernel is unresponsive"
While using a Python notebook that works on my machine it crashes on the same point with the errors "The Python kernel is unresponsive" and "The Python process exited with exit code 134 (SIGABRT: Aborted).", but with no stacktrace for debugging the ...
- 13026 Views
- 5 replies
- 0 kudos
- 0 kudos
I am using the following DBR 12.2 LTS (includes Apache Spark 3.3.2, Scala 2.12).Fatal error: The Python kernel is unresponsive.--------------------------------------------------------------------------- The Python process exited with exit code 134 (S...
- 0 kudos
- 4213 Views
- 2 replies
- 2 kudos
Resolved! Databrickscommunity reward store is not working
Hi Guys, Does anybody know when the Databricks community reward store portal will open?I see it's still under construction@Retired_mod @Sujitha
- 4213 Views
- 2 replies
- 2 kudos
- 2769 Views
- 2 replies
- 1 kudos
Databricks notebook issue
Hi,I'm trying to run ADF pipeline.However, it is getting fail at Notebook activity with below error.Error :NoSuchMethodError: com.microsoft.sqlserver.jdbc.SQLServerBulkCopy.writeToServer(Lcom/microsoft/sqlserver/jdbc/ISQLServerBulkRecord;)V I think i...
- 2769 Views
- 2 replies
- 1 kudos
- 1 kudos
@shan_chandra Thanks for your reply as per your suggetion changed Databricks version from 9.1LTS to 12.2LTSBut after change this when i check library which you provided(i.e com.microsoft.azure:spark-mssql-connector_2.12:1.3.0) under Maven it is not...
- 1 kudos
- 3815 Views
- 6 replies
- 0 kudos
How to close gke databricks cluster
I have on gke databricks cluster with multiple nodes running. I want to close nodes when not in use. To reduce cost usage. And Is there any way to pause gke cluster on-demand.
- 3815 Views
- 6 replies
- 0 kudos
- 0 kudos
Hi @DeveshKaushik ,If this is the case then create a support ticket with databricks
- 0 kudos
- 4039 Views
- 3 replies
- 0 kudos
unable to install pymqi in azure databricks
Hi,I am trying to install pymqi via below command:pip install pymqi However, I am getting below error message:Python interpreter will be restarted. Collecting pymqi Using cached pymqi-1.12.10.tar.gz (91 kB) Installing build dependencies: started Inst...
- 4039 Views
- 3 replies
- 0 kudos
- 0 kudos
I don't think so, because it won't be specific to Databricks - this is all a property of the third party packages. And, there are billions of possible library conflicts. But this is not an example of a package conflict. It's an example of not complet...
- 0 kudos
