- 2636 Views
- 1 replies
- 1 kudos
try_to_timestamp not working as expected
try_to_timestamp should return NULL for following expression but it is throwing error: try_to_timestamp( '2019-02-28 23:59:59.000', 'yyyy-MM-dd HH:mm:ss' ) I understand above expression is wrong as the date format does no...
- 2636 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @PriyanshuKumar,Thank you for your question in the Databricks community.The try_to_timestamp() function is designed to attempt to convert a string to timestamp format based on a specified pattern and return null if it fails to do so. However, in t...
- 1 kudos
- 8476 Views
- 5 replies
- 8 kudos
Resolved! Change Data Feed Databricks
Hello,I am doing some testing with this feature Change Data Feed using Databricks and Pyspark, of course the Delta format and I don't understand something:I created a tableSaved some data insideEnabled Change Data Feed featureApply a merge with a dat...
- 8476 Views
- 5 replies
- 8 kudos
- 8 kudos
@Mihai_Cog You have to split your merge statement into 2 parts. (Update and Insert/Delete).MERGE INTO test t USING src s ON s.Id = t.Id and s.date_field = t.date_field and s.fields <> t.fields WHEN MATCHED THEN UPDATE SET * MERGE INTO test t USING sr...
- 8 kudos
- 8154 Views
- 10 replies
- 9 kudos
Resolved! Request for reattempt voucher. Databricks Certified Associate Developer for Apache Spark 3.0 exam
Hi,I gave Databricks Certified Associate Developer for Apache Spark 3.0 exam today but missed by one percent. I got 68.33% and pass is 70%.I am planning to reattempt the exam, could you kindly give me another opportunity and provide reattempt voucher...
- 8154 Views
- 10 replies
- 9 kudos
- 9 kudos
Hi,I gave Databricks Certified Associate Developer for Apache Spark 3.0 Python exam yesterday but missed by three percent. I got 66.66% and pass is 70%.I am planning to reattempt the exam, could you kindly give me another opportunity and provide reat...
- 9 kudos
- 7489 Views
- 6 replies
- 12 kudos
Resolved! SSRS (on-prem) on Databricks SQL
Has anybody succeeded in querying Databricks SQL with an on-prem SSRS (so an on-prem Report Server and Report Builder)?I manage to create a connection that works (according to the connection test anyway), but the moment I try to create a dataset on t...
- 7489 Views
- 6 replies
- 12 kudos
- 12 kudos
Hi @-werners- , I am able to build connection between Microsoft visual studio and data bricks using Simba Spark ODBC driver. I can query delta tables sitting in Databricks from Microsoft Visual studio (SSRS). However, when I am deploying the report t...
- 12 kudos
- 7704 Views
- 4 replies
- 1 kudos
SSRS Connect to Databricks
Hi ,I need to connect databricks query from microsoft SSRS.is it possible ? How do you make the connection?
- 7704 Views
- 4 replies
- 1 kudos
- 1 kudos
@Haider93 https://www.databricks.com/company/partners/technology This is the list of supported databricks technology partners. SSRS is not yet part of it. We do have official support for Power BI. You can use this document to mimic it for SSRS - http...
- 1 kudos
- 852 Views
- 0 replies
- 0 kudos
Why no Practice Test for Databricks Professional Exam ?
Hi Databricks Team/Community,I'm planning for Databricks Data Engineering Professional Certification but what I have seen is that Databricks don't give any practice test for this professional/advanced certification. I don't know why, If anyone is rea...
- 852 Views
- 0 replies
- 0 kudos
- 28807 Views
- 2 replies
- 0 kudos
Can you delete a widget, or force a value to it?
Hello everyone! Basically, I have a dropdown widget, and at some point I want to change the options available, but still maintain the same selected option. The problems that I find are: - If I want to delete the widget and create a new one, it seems...
- 28807 Views
- 2 replies
- 0 kudos
- 0 kudos
I know this is 5+ years late but I would like to add an answer (or work around) to this in case anyone else was looking for the same solution.What I did was to essentially 'reset' the widget whenever I had to assign (or force) a value to it.#Cell #1 ...
- 0 kudos
- 6842 Views
- 5 replies
- 4 kudos
Consuming data from databricks[Hive metastore] sql endpoint using pyspark
I was trying to read some delta data from databricks[Hive metastore] sql endpoint using pyspark, but while doing so I encountered that all the values of the table after fetching are same as the column name.Even when I try to just show the data it giv...
- 6842 Views
- 5 replies
- 4 kudos
- 4 kudos
Encountered the same issue and downgrading to 2.6.22 helped me resolve this issue.
- 4 kudos
- 1659 Views
- 2 replies
- 1 kudos
How to expand display of workspace name in top right window?
How to expand display of workspace name in top right window? My workspace name is little bit longer and it cuts out, could not find a way to expand name window.
- 1659 Views
- 2 replies
- 1 kudos
- 1 kudos
@pg1 Is your workspace Unity Catalog enabled?We have identified this behaviour in Unity Catalog enabled workspaces and already working to show up the entire workspace name when we hover over it.
- 1 kudos
- 2684 Views
- 2 replies
- 2 kudos
Resolved! Adding Duration Warning During Workflow Deployment
Hi Team,Thank you very much for making it so simple to add notifications on failure and duration warnings to workflows.Each time we deploy to dev, through Jenkins, our email is unsubscribed and we stop getting alerts. Is there any documentation on ho...
- 2684 Views
- 2 replies
- 2 kudos
- 2 kudos
It heavily depends on how do you perform deployment - what APIs are used, etc. Most probably you're using Job Reset API instead of Job Update API
- 2 kudos
- 1102 Views
- 0 replies
- 0 kudos
[sql warehouse] Invalid configuration value detected for fs.azure.account.key with 'force' = 'true'
Hello,I am getting the following error when trying to copy data to databricks from an ADLS with SQL and using a SAS tokenFailure to initialize configuration for storage account <storage account>: Invalid configuration value detected for fs.azure.acco...
- 1102 Views
- 0 replies
- 0 kudos
- 26225 Views
- 5 replies
- 5 kudos
Resolved! What is the best way to handle big data sets?
I'm trying to find the best strategy for handling big data sets. In this case I have something that is 450 million records. I'm pulling the data from SQL Server very quickly but when I try to push the data to the Delta Table OR a Azure Container the...
- 26225 Views
- 5 replies
- 5 kudos
- 5 kudos
I think you should consult experts in Big Data for advice on this issue
- 5 kudos
- 3579 Views
- 1 replies
- 2 kudos
Amazon SES : boto3 credentials not found. DBR 11.2 Shared mode
We're trying to send email using Amazon SES using boto3.client in python. We've added SES Full access in clusters IAM Role. We were able to send email in "No isolation shared" mode in DBR 11.2 using ses = boto3.client('ses', region_name='us-****-2'...
- 3579 Views
- 1 replies
- 2 kudos
- 2 kudos
This appears to be an intentional design choice to prevent users from using the credentials of the host machine to carry out arbitrary AWS API calls. I really wish there was a workaround or setting to disable this behavior because we put a lot of wor...
- 2 kudos
- 1822 Views
- 1 replies
- 1 kudos
Resolved! Run notebooks on serverless SQL cluster
Is it just me or i'm I right that we can't run notebooks on a serverless SQL cluster?It would be a nice feature for SQL based notebooks.
- 1822 Views
- 1 replies
- 1 kudos
- 1 kudos
I figured out.I needed to start the cluster first.
- 1 kudos
- 3030 Views
- 1 replies
- 1 kudos
Multiple streaming sources to the single delta live table
In our case, we have multiple sources writing to the same target table. A target table can be populated from multiple source tables, each contributing a set of fields. How to add/update columns in a target table from multiple sources.In a delta live...
- 3030 Views
- 1 replies
- 1 kudos
- 1 kudos
Following.
- 1 kudos
| User | Count |
|---|---|
| 1613 | |
| 770 | |
| 349 | |
| 286 | |
| 253 |
