- 1501 Views
- 1 replies
- 1 kudos
Resolved! DATABRICKS FESTVAL VOUCHER
what should be the timezone which we have to consider for earning the voucher
- 1501 Views
- 1 replies
- 1 kudos
- 1 kudos
@Aman_Dahiya Guessing you are referring to this event! There is no categorization for time zones, it is open to all. You can earn the voucher regardless of your timezone.
- 1 kudos
- 3324 Views
- 3 replies
- 2 kudos
Resolved! When does the cost of JOB COMPUTE start to be calculated?
I'm trying to run a workflow with job compute.Job compute needs to be pending for about 5 to 7 minutes before executing the workflow. I think it takes time to find a suitable instance in the cloud, configure the environment, install libraries, etc.An...
- 3324 Views
- 3 replies
- 2 kudos
- 2 kudos
There is a big discrepancy to take note of here. It is the difference between Databricks job costs (DBUs) and billing for the cloud provider (the actual VM doing the the work). Billing for the Databricks job starts when the Spark context is being ini...
- 2 kudos
- 1627 Views
- 0 replies
- 0 kudos
Asset Bundle template: ignore file based on variable value
Hello,I am creating an asset-bundle-template which should be able to include/exclude certain files, depending on the value of a parameter, e.g. if parameter "include_file" is set to true, then the bundle init command should include the template file(...
- 1627 Views
- 0 replies
- 0 kudos
- 1683 Views
- 1 replies
- 1 kudos
Error with: %run ../Includes/Classroom-Setup-SQL
Hi Guys,Just started the ASP 2.1L Spare SQL Lab and I get this error, when I run the first setup SQL command:%run ../Includes/Classroom-Setup-SQLThe execution of this command did not finish successfullyPython interpreter will be restarted.Python inte...
- 1683 Views
- 1 replies
- 1 kudos
- 1 kudos
You can create a cluster compatible with the notebooks. So It will work.
- 1 kudos
- 2667 Views
- 1 replies
- 1 kudos
Databricks CLI bundle run multiple jobs
Hi!I am using bundles to deploy various workflows, and as part of a CI pipeline, I want to run integration tests. They are in notebooks that I deploy and run with databricks CLI bundle with Azure DevOps.This allows me to run only one job at a time as...
- 2667 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Retired_mod and thanks for your reply.I see, so all tests will need to be defined in one config file under one job.
- 1 kudos
- 68152 Views
- 3 replies
- 3 kudos
Resolved! How to import excel on databricks
To import an Excel file into Databricks, you can follow these general steps:1. **Upload the Excel File**:- Go to the Databricks workspace or cluster where you want to work.- Navigate to the location where you want to upload the Excel file.- Click on ...
- 68152 Views
- 3 replies
- 3 kudos
- 3 kudos
The question here is how to read the multi-excel files based on path.The mentioned solution interacts with one file only, do we have the ability to read all the Excel files in the folder?
- 3 kudos
- 1009 Views
- 0 replies
- 0 kudos
Retry Trigger for Specific Errors and Custom Error States in Workflow UI
Hello everyone,In a workflow, is it possible to trigger a retry only for a specific error on a single task? I want the workflow UI to show a run as failed for both managed and unmanaged errors, but I don't want to trigger the retry for managed error...
- 1009 Views
- 0 replies
- 0 kudos
- 7599 Views
- 6 replies
- 0 kudos
Streaming xls files Using Auto Loader
Hello,Is there a way to read .xls files using auto loader or is there any workaround since excel files are not supported by the auto loader per the following document?https://docs.databricks.com/en/ingestion/auto-loader/options.htmlThanks.
- 7599 Views
- 6 replies
- 0 kudos
- 0 kudos
I am facing the same issue--I have a stream that I'd like to use autoloader on with an .xlsx. Is there any update to any workarounds on this issue?
- 0 kudos
- 2815 Views
- 2 replies
- 0 kudos
Feature Store UI lagging
The feature store UI is lagging (Azure Databricks). It is extremely slow to update - takes several days from creating a feature table before it appears in the UI. Anyone share the same experience?
- 2815 Views
- 2 replies
- 0 kudos
- 0 kudos
Anyone having the same experience here? The UI is still extremely slow to update - it takes days before the already registered feature tables appear in the UI. It makes the UI useless for browsing features! I really hope that Databricks is looking in...
- 0 kudos
- 3734 Views
- 1 replies
- 0 kudos
How do Databricks handle the utilization of Azure Reserved Instances?
We are trying to use Azure Reserved Instances for Databricks clusters as we have some consistent workload.Does Databricks automatically select the reserved instances when they are available (assuming we keep the on-demand instance type in the cluster...
- 3734 Views
- 1 replies
- 0 kudos
- 10147 Views
- 2 replies
- 1 kudos
Maintaining Order Consistency: Table Creation in Databricks SQL vs. DLT Pipeline
I have a CTE table with the below names as values. My objective is to create another table by concatenating all the rows from the CTE table in ascending order, resulting in the final output sequence: "Abi, Rahul, ram, Siva". When executing the query ...
- 10147 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Archana_Mathan, did you solve this problem by any chance? I am having a similar problem maintaining the order of the dlt.Thank you,
- 1 kudos
- 1251 Views
- 0 replies
- 1 kudos
register for Databricks Community Edition
I've been trying to register for Databricks Community Edition for 3 days, to study the platform, but I'm experiencing an error when registering ("An error has occurred. Please try again later."). Could anyone help me, how do I register for the commun...
- 1251 Views
- 0 replies
- 1 kudos
- 3279 Views
- 1 replies
- 1 kudos
Resolved! Pandas .to_excel not saving to workspace
Hi!I was always able to export pandas datasets to my workspace on databricks, just like in a local machine using df.to_excel('filename', index=False).but since i got some permissions updates to some new catalogs, when i try to export a dataset using ...
- 3279 Views
- 1 replies
- 1 kudos
- 1 kudos
Just to update the situation, and to help anyone with the same problem in the future:What hapened was thas my cluster was updated to use Unity Catalogs, and with that i had to specify the full path to my workspace.df_pandas.to_excel('/Workspace/Users...
- 1 kudos
- 1955 Views
- 1 replies
- 1 kudos
Training/Fine-Tunning Foundation model
When I was tring ti run the dbdemos for llm-rag-fine-tuning I'm stuck on one of the first lines of code. When trying to execute the function: databricks.model.foundation_model.create(...) with the Mistral_7B_instruct_v2.0 it is failing with the follo...
- 1955 Views
- 1 replies
- 1 kudos
- 1 kudos
Currently using my account and the command dbutils.notebook.entry_point.getDbutils().notebook().getContext().apiUrl().get().apiToken().get() to get my current databricks token to access this function. And my user just doesn't have admin permissions ...
- 1 kudos
- 1647 Views
- 1 replies
- 0 kudos
SAP Data in Databricks
Any one using SAP data to brining in to Databricks, do you directly hit SAP ODP or use any third party tool to get the data to datalake . Thanks,
- 1647 Views
- 1 replies
- 0 kudos
- 0 kudos
With the recent news form SAP, looks like SAP DataSphere will be the only way forward for, SAP
- 0 kudos
