- 1099 Views
- 1 replies
- 0 kudos
Acceptable pythons to use with databricks-sql-cli (dbsqlcli)?
I have recently had to rebuild my laptop. Before it crashed I was able to use the dbsqlcli and have a set of scripts which I was using to do simple extracts into text files.The rebuild shows Python 3.11.0 (main, Oct 24 2022, 18:26:48) [MSC v.1933 64 ...
- 1099 Views
- 1 replies
- 0 kudos
- 0 kudos
@John Zajic​ you need -Python 3.7 or higher. To check whether you have Python installed, run the command Install Python, if you do not have it already installed.I believe one version should be sufficient.
- 0 kudos
- 783 Views
- 1 replies
- 8 kudos
Databricks will release a new navigation experience to enhance user efficiency and convenience. The update includes a single, unified homepage with a ...
Databricks will release a new navigation experience to enhance user efficiency and convenience. The update includes a single, unified homepage with a list of recently viewed objects, a single search box, and common Lakehouse categories at the top of ...
- 783 Views
- 1 replies
- 8 kudos
- 8 kudos
Thank you for sharing @Hubert Dudek​
- 8 kudos
- 1401 Views
- 2 replies
- 4 kudos
Specifying cluster on running a job
Hi,Let's say that I am starting jobs with different parameters at a certain time each day in the following manner:response = requests.post( "https://%s/api/2.0/jobs/run-now" % (DOMAIN), headers={"Authorization": "Bearer %s" % TOKEN}, json={ ...
- 1401 Views
- 2 replies
- 4 kudos
- 4 kudos
@Tjadi Peeters​ You can select option Autoscaling/Enhanced Scaling in workflows which will scale based on workload
- 4 kudos
- 1613 Views
- 3 replies
- 1 kudos
In azure databricks custom alert i am able to preview but when it goes to mail data gets missing
In azure databricks custom alert i am able to preview but when it goes to mail data gets missing
- 1613 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi, what is the custom alert about? Also, could you please raise an Azure support case on the same to triage this further? Please tag @Debayan​ with your next response which will notify me. Thank you!
- 1 kudos
- 1991 Views
- 1 replies
- 2 kudos
Execute code on Application End
Hello,I want to execute a custom code onApplicationEnd. Outisde Databricks, I have used the Spark Listener onApplicationEnd without problems. But it is not working on Databricks (I tried listener onJobEnd and this one worked).I have also tried Spark ...
- 1991 Views
- 1 replies
- 2 kudos
- 2 kudos
Did you find any solution?
- 2 kudos
- 3846 Views
- 7 replies
- 4 kudos
On-Behalf of tokens disabled for Azure Environments?
While trying to setup a Power BI connection to the Azure Delta Lake we ran into several issues around Service Principals. ​1) The API listed on the learn.microsoft site (link 1 below) indicates that there is an API you can use to create SP tokens. Wh...
- 3846 Views
- 7 replies
- 4 kudos
- 4 kudos
hello,i am new here from india, here to share some thoughts with you all
- 4 kudos
- 2084 Views
- 3 replies
- 1 kudos
Databricks Repos are pushing all changes to GitHub
When I make any changes within a repo, when I go to commit and push to GitHub if I uncheck any changes that I don't want pushed, still get pushed to Github. Any help would be appreciated
- 2084 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @Vidula Khanna​ Problem is now resolved thanks, didn't have to do anything different, the functionality just started working as expected.
- 1 kudos
- 5004 Views
- 5 replies
- 0 kudos
IP Access list Databricks
Hello, good morning everyone, I have a problem, I have IP access List activated in my Databricks workspace and I have connections to powerBI and Azure DevOps, in Power BI I have already added all the public IP ranges that Azure gives me, which are ab...
- 5004 Views
- 5 replies
- 0 kudos
- 0 kudos
Hi @David Cantos​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thank...
- 0 kudos
- 4992 Views
- 3 replies
- 2 kudos
Parquet to csv delta file
Hi Team, I have a parquet file in s3 bucket which is a delta file I am able to read it but I am unable to write it as a csv file.​getting the following error when i am trying to write:​A transaction log for Databricks Delta was found at `s3://path/a...
- 4992 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi @yuvesh kotiala​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
- 2 kudos
- 14506 Views
- 3 replies
- 1 kudos
Job is fails with java.lang.NoClassDefFoundError: Could not initialize class error
hi,It is scala code where we are connecting Redis to store (sparkcontext.toRedisKV) and i am also using scala udf . ihave excuted the same code in notebook without scala object and it works fine but everytime it fails when i am using same code in jar...
- 14506 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @Satish Kumbhar​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
- 1 kudos
- 1441 Views
- 2 replies
- 0 kudos
ILT session
when is the next ILT session
- 1441 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Edrian Kyle​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback ...
- 0 kudos
- 1390 Views
- 2 replies
- 0 kudos
Adding partition location to external table throwing exception
I have created external table like below.# create table spark.sql(f""" CREATE EXTERNAL TABLE IF NOT EXISTS {database_schema}.{tableName} USING PARQUET OPTIONS ( 'path' '{raw_storage}/{folder_path}', 'forward_spark_azur...
- 1390 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @sri bet​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback will...
- 0 kudos
- 2795 Views
- 2 replies
- 1 kudos
Skip Task Without Spinning Up Cluster
I have a Job Workflow with multiple sequential tasks executing R or Python scripts. Currently, we can skip one of these tasks (if it has already been run) by passing a parameter and skipping via the script. This requires a full spin up of a compute r...
- 2795 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Dave Wilson​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks...
- 1 kudos
- 6095 Views
- 2 replies
- 0 kudos
Why is the Import button greyed out when attempting to import a .ipynb file into Databricks?
The file import seems to work. The file name and size appear in the dialog box along with a green check mark. BUT only the cancel button is active. The import button is greyed out.Is there another step, action, or setting required to activate the i...
- 6095 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Paul Auclair​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thank...
- 0 kudos
- 1948 Views
- 2 replies
- 0 kudos
Informatica Cloud mapping with Databricks connection failing with java.util.NoSuchElementException
Hi Team,When we tried to configure our source with Databricks table with Databricks connection on Informatica Cloud, we received below error.We already tried the suggestions mentioned in the below community post which seems to be similar error as our...
- 1948 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Mahesh D​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
- 0 kudos