- 4640 Views
- 2 replies
- 1 kudos
Resolved! Materialize view creation is failed
I have 'ALL_PRIVILEGES' and 'USE_SCHEMA' on lhdev.gld_sbx schema but the following command has been failed with the error:DriverException: Unable to process statement for Table 'customermvx' create materialized view customermvxasselect *from lhdev.gl...
- 4640 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @shsalami ,According to below documentation snippet, you also need USE CATALOG privilege on the parent catalog. "The user who creates a materialized view (MV) is the MV owner and needs to have the following permissions:SELECT privilege over the ba...
- 1 kudos
- 10534 Views
- 15 replies
- 3 kudos
Session expired, cannot log back in to Community Edition
Whenever I am logged into my Community Edition account and leave it idle for a bit, it says that my session has expired, which is understandable. However, when I try logging back in with the exact same credentials, I receive an error saying that a Co...
- 10534 Views
- 15 replies
- 3 kudos
- 3 kudos
Hi All, Between 22:00 UTC on August 14, 2024, and 14:43 UTC on August 19, 2024, you may have been a user of Databricks’ Community Edition who experienced errors citing “Your session has expired, please authenticate again” within a few minutes of logg...
- 3 kudos
- 3142 Views
- 2 replies
- 0 kudos
Embedding external content and videos via IFrame
Hello there,I'm currently creating a notebook which contains a training course for data engineering.For certain topics it would be nice to embed external resources like Youtube videos so participants do not have to leave the notebook to watch the vid...
- 3142 Views
- 2 replies
- 0 kudos
- 0 kudos
Did you try using displayHTML() ? https://docs.databricks.com/en/visualizations/html-d3-and-svg.html
- 0 kudos
- 7457 Views
- 5 replies
- 0 kudos
Resolved! SQL UDF vs. Python UDF, SQL UDF vs. Pandas UDF
I would like to understand how(1) SQL UDFs compare to Python UDFs(2) SQL UDFs compare to Pandas UDFsEspecially in terms of performance.I cannot find any documentation on the topics, also not in the official Databricks documentation (which unfortunate...
- 7457 Views
- 5 replies
- 0 kudos
- 0 kudos
The first sublink has SQL UDFs where you can write your SQL UDF using SQL or Python. This Python implementation is different from the one mentioned above. https://docs.databricks.com/en/udf/unity-catalog.html
- 0 kudos
- 1470 Views
- 1 replies
- 0 kudos
Delta Live tables vs Azure SQL DB for a read intensive application
Hi,I am looking for some advice to compare cost and performace between Delta Live tables vs Azure SQL DB files in Azure Blob for building the backend for a web application.There would be very frequent read operation(Multiple searches every second) an...
- 1470 Views
- 1 replies
- 0 kudos
- 0 kudos
As far as I know, Azure SQL DB is RDBMS, whereas DLT is to build a data pipeline.
- 0 kudos
- 1071 Views
- 1 replies
- 0 kudos
Regarding Personal access token
Dear Team,In my account Personal access token or Link Git Account there is an error fetching credential. Please give me solution.Thanks & Regards
- 1071 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @mahesh_lature ,Could you provide more information? Some screenshots, which cloud privder do you use etc.?
- 0 kudos
- 6434 Views
- 3 replies
- 1 kudos
Resolved! Databricks Workflow if else task type
Need help on databricks workflow if else task. Task-A : Notebook : executing set of the pyspark commands and loading the data into delta table.I need to setup a custom status so that i can use status in the next if/else task.Task-b: if/else: once i g...
- 6434 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @suryateja405555 ,You can use task values in Task A to setup a custom status and then use that status in the if/else task to decide if you need to execute the of notebook on True condition or stop the workflow.https://docs.databricks.com/en/jobs/s...
- 1 kudos
- 6847 Views
- 2 replies
- 1 kudos
Databricks Job Trigger via webhook
Hi There,I have a scenarion where I plan to load a databricks table via fivetran Following which I need to trigger a set of dbt jobs running databricks sql waeehouseOnce fivetran loads the databricks delta tableCan databricks workflow be triggered vi...
- 6847 Views
- 2 replies
- 1 kudos
- 1 kudos
@data guy Try if you can implement python API in wehbook then sure you can use databricks workflow API to trigger the job from webhook#DAIS2023
- 1 kudos
- 2067 Views
- 2 replies
- 0 kudos
Databricks SQL Alerts
Hi All, Need one help. Is there any possibility to trigger a Databricks SQL Alert as a email notification to group of users/individual users without schedule option.We can add the Email id in the destinations but it will trigger an alert only if we s...
- 2067 Views
- 2 replies
- 0 kudos
- 0 kudos
HI there, can you provide a bit more detail - why do you need email addresses if you don't send an alert? Are you trying to email when the job finishes? Or do you want to send the results?
- 0 kudos
- 55382 Views
- 9 replies
- 30 kudos
Selenium chrome driver on databricks driver On the databricks community, I see repeated problems regarding the selenium installation on the databricks...
Selenium chrome driver on databricks driverOn the databricks community, I see repeated problems regarding the selenium installation on the databricks driver. Installing selenium on databricks can be surprising, but for example, sometimes we need to g...
- 55382 Views
- 9 replies
- 30 kudos
- 30 kudos
Hi Hubert-Dudek,Are there any updates to your article? I have struggling to get databricks to recognise a Seleniumbase driver. I think the error might actually be a permissions problem as the error is:WebDriverException: Message: Can not connect to ...
- 30 kudos
- 4063 Views
- 2 replies
- 1 kudos
Unity Catalog metastore list is showing empty
Hi ,I am not able to list the meta-stores in databricks cli using the below command :databricks unity-catalog metastores list{}but when I tried databricks unity-catalog metastores get-summary I am able to get the meta-store info .Can anyone help me ...
- 4063 Views
- 2 replies
- 1 kudos
- 1 kudos
Hi @Kaniz Fatma , Unity catalog is enabled in my workspace and i have been assigned metastore admin and account admin also.databricks unity-catalog metastores list --debugHTTP debugging enabledsend: b'GET /api/2.1/unity-catalog/metastores HTTP/1.1\r...
- 1 kudos
- 42097 Views
- 2 replies
- 3 kudos
Failed to Merge Fields Error on Delta Live Tables
I'm running into an issue during the "Setting up Tables" phase of our DLT pipelines where I'm told a particular field is unable to be merged due to incompatible datatypes. See this example: org.apache.spark.sql.AnalysisException: Failed to merge fiel...
- 42097 Views
- 2 replies
- 3 kudos
- 6471 Views
- 2 replies
- 0 kudos
Creating External Table from partitioned parquet table
I am trying to create an external table in catalog using parquet where the parquet file is partitioned I have tried using the below syntax,%sqlCREATE TABLE table_name(col1 type1, col2 type2, col3 type3, )USING parquet PARTITIONED BY ( col4 type4)LOCA...
- 6471 Views
- 2 replies
- 0 kudos
- 0 kudos
@data_extractor , How were you able to fix this problem? I am having same issue now
- 0 kudos
- 5930 Views
- 2 replies
- 0 kudos
Resolved! Error pushing changes Remote ref update was rejected. Make sure you have write access to this remote
Hello!I'm receiving the following error, when pushing from Databricks to GitHub. What I have done: Access token is set upRepository is publicI can pull from the repository to DatabricksI'm using standard tier"Error pushing changes Remote ref update w...
- 5930 Views
- 2 replies
- 0 kudos
- 0 kudos
Hello!thanks for the answer. Just figured it out. It turned out that I accidentally had secrets in my code and it was not allowed by GitHub. After removing them, all worked out. Arttu
- 0 kudos
- 1991 Views
- 1 replies
- 0 kudos
%sh fails to install mdbtools locally
HiI have a notebook that uses mdbtools:%sh sudo apt-get -y -S install mdbtoolsHowever, when I want to run it locally it returns error:sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure...
- 1991 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @KacperG ,Most likely the job is using different privileges than you.In your command -S needs to be specified before apt-get. Have you tried running: %sh sudo -S apt-get -y install mdbtools If it is just a typo, here are the options:1.Try to run t...
- 0 kudos
| User | Count |
|---|---|
| 1645 | |
| 793 | |
| 586 | |
| 349 | |
| 287 |
