- 1534 Views
- 11 replies
- 3 kudos
Unable to Login - Account Verification Loop
I'm having trouble logging in to my Databricks account at databricks.com. Here's what happens:I enter my email address and password.I receive an account verification code via email.I enter the verification code on the login page.Instead of logging me...
- 1534 Views
- 11 replies
- 3 kudos
- 3 kudos
Hi Pranav,Hope so you're doing good, this issue might be caused by a browser compatibility problem or account-specific settings. Try logging in using an incognito window or a different browser. If the problem persists, contact Databricks support dire...
- 3 kudos
- 54 Views
- 2 replies
- 0 kudos
Choosing between Azure Data Factory (ADF) and Databricks PySpark notebooks
I’m working on a project where I need to pull large datasets from Cosmos DB into Databricks for further processing, and I’m trying to decide whether to use Azure Data Factory (ADF) or Databricks PySpark notebooks for the extraction and processing tas...
- 54 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @DebIT2011,Hope so you're doing good, for incremental upserts and deletes from Cosmos DB, Databricks PySpark offers simplicity with unified management, especially for complex transformations and dependency handling. ADF may excel in GUI-based orch...
- 0 kudos
- 25 Views
- 0 replies
- 0 kudos
%run working different in different taks of same job
I am using %run "/Workspace/Shared/SCPO_POC/Tredence-Dev-Phase3/Publix Weekly Sales POC - Main Folder/Weekly_Workflow_Parametrized/Get_Widgets_Values" before all my notebooks of a single job which has bunch of child jobs and child tasks... The % run ...
- 25 Views
- 0 replies
- 0 kudos
- 63 Views
- 2 replies
- 1 kudos
Resolved! Delta Live Table Pipeline
I have the error message when try to create a delta live table pipeline.My error is: com.databricks.pipelines.common.errors.deployment.DeploymentException: Failed to launch pipeline cluster 1207-112912-8e84v9h5: Encountered Quota Exhaustion issue in ...
- 63 Views
- 2 replies
- 1 kudos
- 40 Views
- 1 replies
- 0 kudos
How do I set up Databricks observability using AWS cloudwatch
How do I set up Databricks observability, including metrics and logging? I am using AWS-based Databricks and want to monitor it. I plan to use CloudWatch as the observability tool but couldn't find proper documentation to configure it.
- 40 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @chethankumar, Setting up CloudWatch might required customer setup, by setting clusters using init script. You might want to consider contacting your account team to guide you through the process. Additional please find the post which could be use...
- 0 kudos
- 44 Views
- 1 replies
- 0 kudos
Where can I quickly test custom metric queries?
I'm working on adapting some custom metrics to add to the tables' dashboard. Right now when I throw in a test query, I need to refresh metrics and it takes 5-10 minutes to let me know I've probably forgotten a parenthesis somewhere.Where can I test t...
- 44 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @HeckGunderson, Have you tried running the code using notebook with your Databricks workspace? https://docs.databricks.com/en/notebooks/index.html Also you can do it via CLI using SQL connector. https://docs.databricks.com/ja/dev-tools/python-sql-...
- 0 kudos
- 103 Views
- 2 replies
- 2 kudos
Databricks Materialized View - DLT Serverless Incremental
I'm currently working with Delta Live Tables, utilizing materialized views and serverless computing. While testing the incremental updates of materialized views, I've observed that deleting a record from the source table triggers a complete refresh o...
- 103 Views
- 2 replies
- 2 kudos
- 2 kudos
EDIT: My Delta Lake table contains 136 columns. I initially tested with fewer columns, and both the updates and deletes were applied incrementally without issues. Specifically, I tested with 34 columns, and everything worked fine. However, when I inc...
- 2 kudos
- 139 Views
- 2 replies
- 0 kudos
Can't download resources from Databricks Academy courses
I seem to be unable to download hands-on lab resources from the Databricks Academy courses. No link for such files (like .dbc, zip, slides, etc.) exist. It seems the problem is with the new UI. It was fine before. Please help.
- 139 Views
- 2 replies
- 0 kudos
- 0 kudos
There was a recent change, students are no longer able to download dbc files. The slides are still available in Academy but you can only view them from within Academy, you cannot download them. Hope this helps, Louis.
- 0 kudos
- 78 Views
- 3 replies
- 0 kudos
Parameters in dashboards data section passing via asset bundles
A new functionality allows deploy dashboards with a asset bundles. Here is an example :# This is the contents of the resulting baby_gender_by_county.dashboard.yml file. resources: dashboards: baby_gender_by_county: display_name: "Baby gen...
- 78 Views
- 3 replies
- 0 kudos
- 0 kudos
variables: catalog: description: "Catalog name for the dataset" default: "dev" parameters: catalog: ${var.catalog}doesn't replace parameter values prod -> dev in json when it is being deployed"datasets": [ { "displayName": "my_t...
- 0 kudos
- 1617 Views
- 4 replies
- 3 kudos
Unable to install a wheel file which is in my volume to a serverless cluster
I am trying to install a wheel file which is in my volume to a serverless cluster, getting the below error@ken@Retired_mod Note: you may need to restart the kernel using %restart_python or dbutils.library.restartPython() to use updated packages. WARN...
- 1617 Views
- 4 replies
- 3 kudos
- 1375 Views
- 3 replies
- 2 kudos
In databricks deployment .py files getting converted to notebooks
A critical issue has arisen that is impacting our deployment planning for our client. We have encountered a challenge with our Azure CI/CD pipeline integration, specifically concerning the deployment of Python files (.py). Despite our best efforts, w...
- 1375 Views
- 3 replies
- 2 kudos
- 2 kudos
Did you manage to find the solution? If so, could you share it? I have the same problem, and if I find the solution, I'll share it here.
- 2 kudos
- 223 Views
- 1 replies
- 0 kudos
how to enable unity catalog on azure databricks?
Hi guys We have an azure databricks workspace upgrade from standard to premium and we want to enable unity catalog such that we can federate with snowflake. the workspace is more than two years old. How to enable unity catalog? I am an admin but unde...
- 223 Views
- 1 replies
- 0 kudos
- 0 kudos
Unity Catalog is configured at the account level, and then you add workspaces into it. In your workspace selector, you should see "Manage account" at the bottom of the list (or go to https://accounts.azuredatabricks.net/). If you can sign in to tha...
- 0 kudos
- 110 Views
- 2 replies
- 0 kudos
Getting scale to zero status of endpoint
Hello, I need to get the current scale to zero status of endpoint. How can I do that via python code?
- 110 Views
- 2 replies
- 0 kudos
- 71 Views
- 1 replies
- 0 kudos
Not able to create or reset the password for Community edition.
I am trying to connect Databricks Community Edition with Power BI Desktop. When Power BI prompts for a username and password, I cannot provide the password because Databricks Community Edition uses a login system based on verification codes rather th...
- 71 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @VishalB!You can find helpful resources for Databricks Community Edition here. If the available resource doesn’t resolve your concern, feel free to submit a ticket with Databricks Support team for further assistance.Thank you.
- 0 kudos
- 198 Views
- 3 replies
- 1 kudos
Limited Results When trying to Access Delta Shared Tables from C#
This C# code only seems to return about 8 rows when it should return 100:// Per Databricks AI, you must run the following command if you don't // want to get an error about delta.enableDeltionVectors from C#: // ALTER TABLE [myCatalog].setest.billboa...
- 198 Views
- 3 replies
- 1 kudos
- 1 kudos
Can you try with the ODBC driver? https://docs.databricks.com/en/integrations/odbc/index.html
- 1 kudos
