- 9729 Views
- 4 replies
- 0 kudos
Resolved! SSLCertVerificationError how to disable SSL Certification
Hi, How is that possible to disable SSL Certification.With databricks API I got this error :SSLCertVerificationError SSLCertVerificationError: ("hostname 'https' doesn't match either of '*.numericable.fr', 'numericable.fr'",) MaxRetryError: HTTPS...
- 9729 Views
- 4 replies
- 0 kudos
- 0 kudos
@Bertrand BURCKER​ - Thanks for letting us know your issue is resolved. If @Prabakar Ammeappin​'s answer solved the problem, would you be happy to mark his answer as best so others can more easily find an answer for this?
- 0 kudos
- 20397 Views
- 1 replies
- 1 kudos
How to handle <IPython.core.display.HTML object>
Some libraries have intermediate IPython HTML-objects returned to the notebook cell output.Since this happens during training a machine learning model the statements are typically buried within in the library so I cannot easily interfere. (e.g. in or...
- 20397 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Kaniz Fatma​ ,thanks for showing me the link. This helps if you are in control of the generated html-object. If the html-content comes from a library, that is where the problems start, because I cannot wrap displayHTML().(I can of course look for...
- 1 kudos
- 5147 Views
- 3 replies
- 1 kudos
Train deep learning model with numpy arrays.
Hey guys,I'm trying to train deep learning model at ML databricks with numpy arrays as input.For now i organized all the data inside DF- df contains 4 columns : col1,col2,col3,col4col1 and col2 have arrays with shape (1,3,3,3,3), col 3 have array wit...
- 5147 Views
- 3 replies
- 1 kudos
- 1 kudos
Maybe you could save some your code. It will be easier to answer and also we could learn deep learning in databricks from your code.
- 1 kudos
- 791 Views
- 0 replies
- 0 kudos
Sell Handbags from Home. Free up your wardrobe space by selling a few preloved handbags at the best prices. Visit Sell Your Bag now!
Sell Handbags from Home. Free up your wardrobe space by selling a few preloved handbags at the best prices. Visit Sell Your Bag now!
- 791 Views
- 0 replies
- 0 kudos
- 22504 Views
- 6 replies
- 8 kudos
Resolved! Exporting csv files from Databricks
I'm trying to export a csv file from my Databricks workspace to my laptop.I have followed the below steps. 1.Installed databricks CLI2. Generated Token in Azure Databricks3. databricks configure --token5. Token:xxxxxxxxxxxxxxxxxxxxxxxxxx6. databrick...
- 22504 Views
- 6 replies
- 8 kudos
- 8 kudos
Hi @Sarvagna Mahakali​ There is an easier hack: a) You can save results locally on the disk and create a hyper link for downloading CSV . You can copy the file to this location: dbfs:/FileStore/table1_good_2020_12_18_07_07_19.csvb) Then download with...
- 8 kudos
- 10881 Views
- 8 replies
- 4 kudos
Resolved! Databricks SQL not displaying all the databases that i have on my cluster.
I have a cluster running on 7.3 LTS and it has about 35+ databases. When i tried to setup an endpoint on Databricks SQL, i do not see any database listed.
- 10881 Views
- 8 replies
- 4 kudos
- 4 kudos
hi @Arif Ali​ You may have to check the data access config to add the params for external metastore: spark.hadoop.javax.jdo.option.ConnectionDriverName org.mariadb.jdbc.Driverspark.hadoop.javax.jdo.option.ConnectionUserName <mysql-username>spark.had...
- 4 kudos
- 5002 Views
- 5 replies
- 8 kudos
Catch rejected Data ( Rows ) while reading with Apache-Spark.
I work with Spark-Scala and I receive Data in different formats ( .csv/.xlxs/.txt etc ), when I try to read/write this data from different sources to a any database, many records got rejected due to various issues like (special characters, data type ...
- 5002 Views
- 5 replies
- 8 kudos
- 8 kudos
or maybe schema evolution on delta lake is enough, in combination with Hubert's answer
- 8 kudos
- 9253 Views
- 5 replies
- 2 kudos
Resolved! Formatting on Databricks Alerts
Hi Guys. I have looked at the formatting options and I'm still struggling to work out how to best format the email body of a databricks alert. I want to be able to selectively choose columns from the query and dispaly them in a table. Or even if i ca...
- 9253 Views
- 5 replies
- 2 kudos
- 2 kudos
Hi @Nick Hughes​ , unfortunately, this is not available for now. We have a feature request for the same. DB-I-4105 - SQL Alerts: Formatting message body when creating Custom TemplateThis feature has been considered by our product team and it will be...
- 2 kudos
- 3084 Views
- 2 replies
- 1 kudos
Resolved! Why EC2 or EBS volumes are not getting tagged for the instances pool
Why EC2 or EBS volumes are not getting tagged for the instances pool when the tags are present for the Clusters
- 3084 Views
- 2 replies
- 1 kudos
- 1 kudos
"If a cluster is created from a pool, its EC2 instances inherit only the custom and default pool tags, not the cluster tags. Therefore if you want to create clusters from a pool, make sure to assign all of the custom cluster tags you need to the pool...
- 1 kudos
- 5908 Views
- 5 replies
- 4 kudos
Resolved! Databricks fails writing after writing ~30 files
Good day, Copy of https://stackoverflow.com/questions/69974301/looping-through-files-in-databricks-failsI got 100 files of csv data on adls-gen1 store. I want to do some processing to them and save results to same drive, different directory. def look...
- 5908 Views
- 5 replies
- 4 kudos
- 4 kudos
was actually anything created by script in directory <my_output_dir>?The best would be to permanently mount ADSL storage and use azure app for that.In Azure please go to App registrations - register app with name for example "databricks_mount" . Ad...
- 4 kudos
- 3609 Views
- 1 replies
- 1 kudos
Resolved! Best practices for working with Redshift
I have a customer with the following question - I'm posting on their behalf to introduce them to the community. For doing modeling in a python environment what is our best practice for getting the data from redshift? A "load" option seems to leave me...
- 3609 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Nicole Wong​ ,Have you check the docs from here? As far as I know, this might be the only way to read/write data to/from redshift.
- 1 kudos
- 12975 Views
- 4 replies
- 4 kudos
Resolved! How does Spark do lazy evaluation?
For context, I am running Spark on databricks platform and using Delta Tables (s3). Let's assume we a table called table_one. I create a view called view_one using the table and then call view_one. Next, I create another view, called view_two based o...
- 12975 Views
- 4 replies
- 4 kudos
- 4 kudos
Hi @John Constantine​ ,The following notebook url will help you to undertand better the difference between lazy transformations and action in Spark. You will be able to compare the physical query plans and undertand better what is going on when you e...
- 4 kudos
- 3229 Views
- 2 replies
- 4 kudos
Resolved! Import a notebook in a Release Pipeline with a Python script
Hi, I would like to import a python file to Databricks with a Azure DevOps Release Pipeline.Within the pipeline I execute a python script which contains this code :import sys import os import base64 import requests dbw_url = sys.argv[1] # https://a...
- 3229 Views
- 2 replies
- 4 kudos
- 4 kudos
Recently I wrote about alternative way to export/import notebooks in pthon https://community.databricks.com/s/question/0D53f00001TgT52CAF/import-notebook-with-python-script-using-api This way you will get more readable error/message (often it is rela...
- 4 kudos
- 3218 Views
- 2 replies
- 13 kudos
Resolved! something like AWS Macie to perform scans on Azure Data Lake
Does anyone know alternative for AWS Macie in Azure?AWS Macie scan S3 buckets for files with sensitive data (personal address, credit card etc...).I would like to use the same style ready scanner for Azure Data Lake.
- 3218 Views
- 2 replies
- 13 kudos
- 20638 Views
- 11 replies
- 2 kudos
- 20638 Views
- 11 replies
- 2 kudos
- 2 kudos
Hi @ahana ahana​ ,Did any of the replies helped you solve this issue? would you be happy to mark their answer as best so that others can quickly find the solution?Thank you
- 2 kudos
| User | Count |
|---|---|
| 1619 | |
| 790 | |
| 485 | |
| 349 | |
| 287 |
