- 615 Views
- 2 replies
- 0 kudos
Sample streaming table is failed
Running the following databricks sample code in the pipeline: CREATE OR REFRESH STREAMING TABLE customersAS SELECT * FROM cloud_files("/databricks-datasets/retail-org/customers/", "csv") I got error:org.apache.spark.sql.catalyst.ExtendedAnalysisExcep...
- 615 Views
- 2 replies
- 0 kudos
- 0 kudos
There is no table with that name.Also, in that folder just the following file exists:dbfs:/databricks-datasets/retail-org/customers/customers.csv
- 0 kudos
- 657 Views
- 2 replies
- 1 kudos
Resolved! Materialize view creation is failed
I have 'ALL_PRIVILEGES' and 'USE_SCHEMA' on lhdev.gld_sbx schema but the following command has been failed with the error:DriverException: Unable to process statement for Table 'customermvx' create materialized view customermvxasselect *from lhdev.gl...
- 657 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @shsalami ,According to below documentation snippet, you also need USE CATALOG privilege on the parent catalog. "The user who creates a materialized view (MV) is the MV owner and needs to have the following permissions:SELECT privilege over the ba...
- 1 kudos
- 2975 Views
- 4 replies
- 2 kudos
Resolved! Generating Personal Access Token to service principle databricks cli
Hi I am having issues generating personal access token to my service principle.I followed the steps from here my `~/.databrickscfg` has the following```[my-profile-name]host = <account-console-url>account_id = <account-id>azure_tenant_id = <azure-ser...
- 2975 Views
- 4 replies
- 2 kudos
- 2 kudos
I want something similar, to use a service principal token instead of a PAT, have you ever done this?https://community.databricks.com/t5/administration-architecture/use-a-service-principal-token-instead-of-personal-access-token/m-p/91629
- 2 kudos
- 3763 Views
- 14 replies
- 3 kudos
Session expired, cannot log back in to Community Edition
Whenever I am logged into my Community Edition account and leave it idle for a bit, it says that my session has expired, which is understandable. However, when I try logging back in with the exact same credentials, I receive an error saying that a Co...
- 3763 Views
- 14 replies
- 3 kudos
- 3 kudos
same issue i also facing from 2 weeks , session expired please login again this message will be shown after every 2-3 minute.
- 3 kudos
- 674 Views
- 2 replies
- 0 kudos
Embedding external content and videos via IFrame
Hello there,I'm currently creating a notebook which contains a training course for data engineering.For certain topics it would be nice to embed external resources like Youtube videos so participants do not have to leave the notebook to watch the vid...
- 674 Views
- 2 replies
- 0 kudos
- 0 kudos
Did you try using displayHTML() ? https://docs.databricks.com/en/visualizations/html-d3-and-svg.html
- 0 kudos
- 1214 Views
- 5 replies
- 0 kudos
Resolved! SQL UDF vs. Python UDF, SQL UDF vs. Pandas UDF
I would like to understand how(1) SQL UDFs compare to Python UDFs(2) SQL UDFs compare to Pandas UDFsEspecially in terms of performance.I cannot find any documentation on the topics, also not in the official Databricks documentation (which unfortunate...
- 1214 Views
- 5 replies
- 0 kudos
- 0 kudos
The first sublink has SQL UDFs where you can write your SQL UDF using SQL or Python. This Python implementation is different from the one mentioned above. https://docs.databricks.com/en/udf/unity-catalog.html
- 0 kudos
- 334 Views
- 1 replies
- 0 kudos
Delta Live tables vs Azure SQL DB for a read intensive application
Hi,I am looking for some advice to compare cost and performace between Delta Live tables vs Azure SQL DB files in Azure Blob for building the backend for a web application.There would be very frequent read operation(Multiple searches every second) an...
- 334 Views
- 1 replies
- 0 kudos
- 0 kudos
As far as I know, Azure SQL DB is RDBMS, whereas DLT is to build a data pipeline.
- 0 kudos
- 278 Views
- 1 replies
- 0 kudos
Regarding Personal access token
Dear Team,In my account Personal access token or Link Git Account there is an error fetching credential. Please give me solution.Thanks & Regards
- 278 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @mahesh_lature ,Could you provide more information? Some screenshots, which cloud privder do you use etc.?
- 0 kudos
- 995 Views
- 3 replies
- 1 kudos
Resolved! Databricks Workflow if else task type
Need help on databricks workflow if else task. Task-A : Notebook : executing set of the pyspark commands and loading the data into delta table.I need to setup a custom status so that i can use status in the next if/else task.Task-b: if/else: once i g...
- 995 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @suryateja405555 ,You can use task values in Task A to setup a custom status and then use that status in the if/else task to decide if you need to execute the of notebook on True condition or stop the workflow.https://docs.databricks.com/en/jobs/s...
- 1 kudos
- 2771 Views
- 2 replies
- 1 kudos
Databricks Job Trigger via webhook
Hi There,I have a scenarion where I plan to load a databricks table via fivetran Following which I need to trigger a set of dbt jobs running databricks sql waeehouseOnce fivetran loads the databricks delta tableCan databricks workflow be triggered vi...
- 2771 Views
- 2 replies
- 1 kudos
- 1 kudos
@data guy​ Try if you can implement python API in wehbook then sure you can use databricks workflow API to trigger the job from webhook#DAIS2023​
- 1 kudos
- 588 Views
- 2 replies
- 0 kudos
Databricks SQL Alerts
Hi All, Need one help. Is there any possibility to trigger a Databricks SQL Alert as a email notification to group of users/individual users without schedule option.We can add the Email id in the destinations but it will trigger an alert only if we s...
- 588 Views
- 2 replies
- 0 kudos
- 0 kudos
HI there, can you provide a bit more detail - why do you need email addresses if you don't send an alert? Are you trying to email when the job finishes? Or do you want to send the results?
- 0 kudos
- 2410 Views
- 6 replies
- 0 kudos
Error in migration with UCX tool
Hey folks!I am facing an issue while migration the tables from Hive to UC using UCX tool; after completely running the setup and getting the assessment overview, we ran the following commands i.e. "databricks labs ucx create-table-mapping" but after...
- 2410 Views
- 6 replies
- 0 kudos
- 0 kudos
Please open an issue with the UCX team. https://github.com/databrickslabs/ucx/issues
- 0 kudos
- 28252 Views
- 11 replies
- 30 kudos
Selenium chrome driver on databricks driver On the databricks community, I see repeated problems regarding the selenium installation on the databricks...
Selenium chrome driver on databricks driverOn the databricks community, I see repeated problems regarding the selenium installation on the databricks driver. Installing selenium on databricks can be surprising, but for example, sometimes we need to g...
- 28252 Views
- 11 replies
- 30 kudos
- 30 kudos
Hi Hubert-Dudek,Are there any updates to your article? I have struggling to get databricks to recognise a Seleniumbase driver. I think the error might actually be a permissions problem as the error is:WebDriverException: Message: Can not connect to ...
- 30 kudos
- 2227 Views
- 2 replies
- 1 kudos
Unity Catalog metastore list is showing empty
Hi ,I am not able to list the meta-stores in databricks cli using the below command :databricks unity-catalog metastores list{}but when I tried databricks unity-catalog metastores get-summary I am able to get the meta-store info .Can anyone help me ...
- 2227 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Kaniz Fatma​ , Unity catalog is enabled in my workspace and i have been assigned metastore admin and account admin also.databricks unity-catalog metastores list --debugHTTP debugging enabledsend: b'GET /api/2.1/unity-catalog/metastores HTTP/1.1\r...
- 1 kudos
- 21486 Views
- 2 replies
- 2 kudos
Failed to Merge Fields Error on Delta Live Tables
I'm running into an issue during the "Setting up Tables" phase of our DLT pipelines where I'm told a particular field is unable to be merged due to incompatible datatypes. See this example: org.apache.spark.sql.AnalysisException: Failed to merge fiel...
- 21486 Views
- 2 replies
- 2 kudos