- 2216 Views
- 2 replies
- 0 kudos
geojson file doesn't plot points on mapbox in jupyter notebook
I am running jupyter notebook on a Databricks cluster and attempting to render a map. I tried the example from the documentation to test and it doesn't plot the points. # Load data from sample csv data_url = 'https://raw.githubusercontent.com/mapb...
- 2216 Views
- 2 replies
- 0 kudos
- 0 kudos
@Kaniz Fatma​ Do you have any updates? were you able to reproduce the error? i am not able to plot within jupyter notebook.
- 0 kudos
- 4396 Views
- 5 replies
- 2 kudos
Resolved! Databricks Lakehouse Fundamentals Training -- Voucher
I just attended the Databricks Lakehouse Fundamentals Training (28 March 2023) and I am still wondering if I should expect any email with infos regarding a survey I should do and the voucher I should get. The Webcast finished without giving any infos...
- 4396 Views
- 5 replies
- 2 kudos
- 2 kudos
Hi @Alexander Mora Araya​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from y...
- 2 kudos
- 1199 Views
- 1 replies
- 0 kudos
Acceptable pythons to use with databricks-sql-cli (dbsqlcli)?
I have recently had to rebuild my laptop. Before it crashed I was able to use the dbsqlcli and have a set of scripts which I was using to do simple extracts into text files.The rebuild shows Python 3.11.0 (main, Oct 24 2022, 18:26:48) [MSC v.1933 64 ...
- 1199 Views
- 1 replies
- 0 kudos
- 0 kudos
@John Zajic​ you need -Python 3.7 or higher. To check whether you have Python installed, run the command Install Python, if you do not have it already installed.I believe one version should be sufficient.
- 0 kudos
- 863 Views
- 1 replies
- 8 kudos
Databricks will release a new navigation experience to enhance user efficiency and convenience. The update includes a single, unified homepage with a ...
Databricks will release a new navigation experience to enhance user efficiency and convenience. The update includes a single, unified homepage with a list of recently viewed objects, a single search box, and common Lakehouse categories at the top of ...
- 863 Views
- 1 replies
- 8 kudos
- 8 kudos
Thank you for sharing @Hubert Dudek​
- 8 kudos
- 1538 Views
- 2 replies
- 4 kudos
Specifying cluster on running a job
Hi,Let's say that I am starting jobs with different parameters at a certain time each day in the following manner:response = requests.post( "https://%s/api/2.0/jobs/run-now" % (DOMAIN), headers={"Authorization": "Bearer %s" % TOKEN}, json={ ...
- 1538 Views
- 2 replies
- 4 kudos
- 4 kudos
@Tjadi Peeters​ You can select option Autoscaling/Enhanced Scaling in workflows which will scale based on workload
- 4 kudos
- 1772 Views
- 3 replies
- 1 kudos
In azure databricks custom alert i am able to preview but when it goes to mail data gets missing
In azure databricks custom alert i am able to preview but when it goes to mail data gets missing
- 1772 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi, what is the custom alert about? Also, could you please raise an Azure support case on the same to triage this further? Please tag @Debayan​ with your next response which will notify me. Thank you!
- 1 kudos
- 2099 Views
- 1 replies
- 2 kudos
Execute code on Application End
Hello,I want to execute a custom code onApplicationEnd. Outisde Databricks, I have used the Spark Listener onApplicationEnd without problems. But it is not working on Databricks (I tried listener onJobEnd and this one worked).I have also tried Spark ...
- 2099 Views
- 1 replies
- 2 kudos
- 2 kudos
Did you find any solution?
- 2 kudos
- 4164 Views
- 7 replies
- 4 kudos
On-Behalf of tokens disabled for Azure Environments?
While trying to setup a Power BI connection to the Azure Delta Lake we ran into several issues around Service Principals. ​1) The API listed on the learn.microsoft site (link 1 below) indicates that there is an API you can use to create SP tokens. Wh...
- 4164 Views
- 7 replies
- 4 kudos
- 4 kudos
hello,i am new here from india, here to share some thoughts with you all
- 4 kudos
- 2299 Views
- 3 replies
- 1 kudos
Databricks Repos are pushing all changes to GitHub
When I make any changes within a repo, when I go to commit and push to GitHub if I uncheck any changes that I don't want pushed, still get pushed to Github. Any help would be appreciated
- 2299 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @Vidula Khanna​ Problem is now resolved thanks, didn't have to do anything different, the functionality just started working as expected.
- 1 kudos
- 5517 Views
- 5 replies
- 0 kudos
IP Access list Databricks
Hello, good morning everyone, I have a problem, I have IP access List activated in my Databricks workspace and I have connections to powerBI and Azure DevOps, in Power BI I have already added all the public IP ranges that Azure gives me, which are ab...
- 5517 Views
- 5 replies
- 0 kudos
- 0 kudos
Hi @David Cantos​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thank...
- 0 kudos
- 5770 Views
- 3 replies
- 2 kudos
Parquet to csv delta file
Hi Team, I have a parquet file in s3 bucket which is a delta file I am able to read it but I am unable to write it as a csv file.​getting the following error when i am trying to write:​A transaction log for Databricks Delta was found at `s3://path/a...
- 5770 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi @yuvesh kotiala​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
- 2 kudos
- 15171 Views
- 3 replies
- 1 kudos
Job is fails with java.lang.NoClassDefFoundError: Could not initialize class error
hi,It is scala code where we are connecting Redis to store (sparkcontext.toRedisKV) and i am also using scala udf . ihave excuted the same code in notebook without scala object and it works fine but everytime it fails when i am using same code in jar...
- 15171 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @Satish Kumbhar​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
- 1 kudos
- 1519 Views
- 2 replies
- 0 kudos
ILT session
when is the next ILT session
- 1519 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Edrian Kyle​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback ...
- 0 kudos
- 1480 Views
- 2 replies
- 0 kudos
Adding partition location to external table throwing exception
I have created external table like below.# create table spark.sql(f""" CREATE EXTERNAL TABLE IF NOT EXISTS {database_schema}.{tableName} USING PARQUET OPTIONS ( 'path' '{raw_storage}/{folder_path}', 'forward_spark_azur...
- 1480 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @sri bet​ Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.Please help us select the best solution by clicking on "Select As Best" if it does.Your feedback will...
- 0 kudos
- 3009 Views
- 2 replies
- 1 kudos
Skip Task Without Spinning Up Cluster
I have a Job Workflow with multiple sequential tasks executing R or Python scripts. Currently, we can skip one of these tasks (if it has already been run) by passing a parameter and skipping via the script. This requires a full spin up of a compute r...
- 3009 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Dave Wilson​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks...
- 1 kudos