by
Mado
• Valued Contributor II
- 2286 Views
- 1 replies
- 4 kudos
Hi,I want to read an Excel "xlsx" file. The excel file has several sheets and multi-row header. The original file format was "xlsm" and I changed the extension to "xlsx". I try the following code:filepath_xlsx = "dbfs:/FileStore/Sample_Excel/data.xl...
- 2286 Views
- 1 replies
- 4 kudos
Latest Reply
Hi @Mohammad Saber​, The error says, Don't save your spreadsheet in "strict OOXML" format.For example, in Excel use.Save As --> "Excel Workbook (.xlsx)" instead ofSave As --> "Strict Open XML Spreadsheet (.xlsx)"
- 748 Views
- 3 replies
- 1 kudos
say, I want to download 2 files from this directory (dbfs:/databricks-datasets/abc-quality/") to my local filesystem, how do I do it?I understand that if those files are inside FileStore directory, it is much straightforward, which someone posts some...
- 748 Views
- 3 replies
- 1 kudos
Latest Reply
Pat
Honored Contributor III
Hi @THIAM HUAT TAN​ ,isn't this dbfs://databricks-datasets Databricks owned s3:// mounted to the workspace? You got an error - 403 access denied to PUT files into the s3 bucket: https://databricks-datasets-oregon.s3.us-west-2.amazonaws.com you shoul...
2 More Replies
by
614849
• New Contributor II
- 532 Views
- 0 replies
- 2 kudos
Hello,I have used AutoML to create a model. When using that model I want to have the probability of the predictions returned. I was able to do this in a notebook with:loaded_model = mlflow.pyfunc.load_model(logged_model)# Predict on a Pandas DataFram...
- 532 Views
- 0 replies
- 2 kudos
- 1225 Views
- 2 replies
- 4 kudos
Hello ,I am working with lookupEngine functions. However, we have some feature tables with granularity level most detailled of dataframe input.Please find an example :table A with unique keys on two features : numero_p, numero_s So while performing F...
- 1225 Views
- 2 replies
- 4 kudos
Latest Reply
Hi @SERET Nathalie​ , I can check internally on the ask here. In the meantime please let us know if this helps: https://docs.databricks.com/machine-learning/feature-store/feature-tables.htmlhttps://docs.databricks.com/machine-learning/feature-store/i...
1 More Replies
- 10733 Views
- 2 replies
- 2 kudos
I have been getting this error sporadically. I'm loading a dataset and training a model using the dataset in notebook. Sometimes it works and sometimes it doesn't. I have seen similar posts and tried all solutions mentioned, log output size limit, sp...
- 10733 Views
- 2 replies
- 2 kudos
Latest Reply
@Leo Bao​ Are you seeing this issue whenever you are getting different sizes of data sets, or your data set size is same. if issue you are seeing is due to larger dataset, please check below link and try to increase partition size Databricks Spark Py...
1 More Replies
- 1423 Views
- 1 replies
- 1 kudos
Hello, I have an autoloader code and it is pretty standard, we have this variable file path that points to an S3 bucket. example #2 executed successfully and example 1 throws an exception.it seems like source 1 always throws an exception whereas sour...
- 1423 Views
- 1 replies
- 1 kudos
Latest Reply
The error was more related to a lot of stuff on the AWS side, so we deleted and cleared the SQS and SNS. we also used the CloudFilesAWSResourceManagerval manager = CloudFilesAWSResourceManager
.newManager
.option("path", filePath)
.create...
by
elgeo
• Valued Contributor II
- 973 Views
- 0 replies
- 2 kudos
Hello experts,We would like to create a UDF function with input parameter a table_name. Please check the below simple example:CREATE OR REPLACE FUNCTION F_NAME(v_table_name STRING, v_w...
- 973 Views
- 0 replies
- 2 kudos
by
elgeo
• Valued Contributor II
- 3149 Views
- 2 replies
- 3 kudos
Hello. Could anyone please confirm the maximum number of characters for sql string data type? Thank you in advance
- 3149 Views
- 2 replies
- 3 kudos
Latest Reply
Hi @ELENI GEORGOUSI​, The size parameter specifies the column length in characters - can be from 0 to 255. Default is 1. Hope this answer helps you.
1 More Replies
by
bs_77
• New Contributor II
- 599 Views
- 1 replies
- 3 kudos
We are using MLFlow to manage the usage of some self service notebooks. This involves logging parameters, tables and figures. Figures are logged using:mlflow.log_figure(
figure=fig,
artifact_file="visual/fig.html"
)Usually the fig object is gener...
- 599 Views
- 1 replies
- 3 kudos
Latest Reply
There is no way to access the html used. You can download the images. The editor uses redash, so you can try looking at that library for more information.
- 922 Views
- 2 replies
- 2 kudos
More concretely, should we fix the dependency version at MAJOR, MINOR or PATCH?For example, MLFlow 1.30.0 is available and latest DBR 11.3 LTS is compatible with 1.29.0 My question comes from the fact that installing our own libraries that use MLFlow...
- 922 Views
- 2 replies
- 2 kudos
Latest Reply
Hi! thanks for the reply, although maybe you didn't notice that I linked to the same url, so we're aware of the matrix. The question is, is it compatible solely with 1.29.0? We want to know which dependency should we use in all our projects that migh...
1 More Replies
by
TomasP
• New Contributor III
- 806 Views
- 3 replies
- 0 kudos
Hi, have you already dealt with the situation that you would like to have two different ml models in one cluster? i.e: I have a project which contains two or more different models with more different pursposes. The goals is to have three differ...
- 806 Views
- 3 replies
- 0 kudos
Latest Reply
Hi @Tomas Peterek​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Than...
2 More Replies
- 1294 Views
- 5 replies
- 3 kudos
I have completed the Databricks certified Data Engineer Associate exam on 29th October, received a mail with score and it is mentioned in mail that I would receive badge within 24 hours. It has been 4 days since I completed the exam still certificate...
- 1294 Views
- 5 replies
- 3 kudos
Latest Reply
Hi @Manasa Tanguturu​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue.If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please visit th...
4 More Replies
- 1937 Views
- 3 replies
- 4 kudos
I run into this error while using MLFlow: AttributeError: 'NoneType' object has no attribute 'enum_types_by_name'Here is the relevant stack trace:/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.9/site-packages/mlflow/tracking/fluent....
- 1937 Views
- 3 replies
- 4 kudos
Latest Reply
Hi @Eshaan Pathak​ , We haven’t heard from you on the last response from @Debayan Mukherjee​​, and I was checking back to see if their suggestions helped you. Or else, If you have any solution, please do share that with the community as it can be hel...
2 More Replies
- 349 Views
- 0 replies
- 1 kudos
https://docs.azure.cn/en-us/databricks/_static/notebooks/mlflow/mlflow-end-to-end-example-azure.htmlI imported the above notebook and try in Databricks community, but those subplots for Box plots are giving me errors as below:AttributeError ...
- 349 Views
- 0 replies
- 1 kudos
- 1514 Views
- 4 replies
- 4 kudos
I am working through a basic example to get familiar with databricks automl. When I run classify, I hit an mlflow error. How can I avoid this error? My code:summary = databricks.automl.classify(train_df, target_col='new_cases', data_dir='dbfs:/automl...
- 1514 Views
- 4 replies
- 4 kudos
Latest Reply
Hi @Brendan McKenna​ , We haven’t heard from you since the last response from @Debayan Mukherjee​. Or else, If you have any solution, please share it with the community, as it can be helpful to others. Also, Please don't forget to click on the "Selec...
3 More Replies
