- 5967 Views
- 6 replies
- 3 kudos
Resolved! Random error related to dynamic variables in SQL - at least one column must be specified (shallowclone table)
Environment: AzureA data transformation template that take s table name as variable. The variable is set in separate notebook %run ../_configShallow clone is used to generate a staging table with exact same columns of target table.A random error occ...
- 5967 Views
- 6 replies
- 3 kudos
- 3 kudos
@lizou​ - That's great! I'm so glad. Would you be happy to share your solution with us and then mark the answer as best? That will help others find the solution more quickly.
- 3 kudos
- 4021 Views
- 2 replies
- 2 kudos
Resolved! How to find the identity column seed value?
How to find the identity column seed value? A seed value is required when we need specifically like start generating new values from a number (most likely we need to keep the original key values when data is reloaded from another source, and any new ...
- 4021 Views
- 2 replies
- 2 kudos
- 2 kudos
found it, thanks!of course, it will be nice to have a sql function available to query the value.example\"delta.identity.start\":984888,\"delta.identity.highWaterMark\":1004409,\"comment\":\"identity\",\"delta.identity.step\":1}
- 2 kudos
- 9094 Views
- 8 replies
- 3 kudos
Resolved! Clone the data from Prod Workspace to Test workspace
Hi there, I have requirement to deep clone the data from Prod workspace to Test Workspace. I know we can do in the same workspace, but I am not aware of between workspaces.I heard some key is needed and have some firewall issues when linking between ...
- 9094 Views
- 8 replies
- 3 kudos
- 2660 Views
- 3 replies
- 3 kudos
Resolved! DataBricks Job Orchestration in PROD
Can I suggest customer about databricks Job orchestration (public preview) ? Can we use this feature in Production as well?
- 2660 Views
- 3 replies
- 3 kudos
- 3 kudos
@ANOOP V​ , At present, we don’t have these features. I assume we do plan to include it by Q4 FY2022.What is next for Multitask Jobs?After GA we will be working on some highly-requested features during the private preview:- Job cluster reuse: make it...
- 3 kudos
- 12992 Views
- 5 replies
- 6 kudos
Resolved! Unable to make Databricks API calls from an HTML iframe rendered by a notebook's `displayHTML()` call, due to the browser enforcing CORS policy.
My GoalI want to make my Databricks Notebooks more interactive and have custom HTML/JS UI widgets that guide non-technical people through a business/data process. I want the HTML/JS widget to be able to execute a DB job, or execute some python code t...
- 12992 Views
- 5 replies
- 6 kudos
- 6 kudos
displayHTML content is served in production from an iframe on the domain databricksusercontent.comThis iframe is sandboxed and it seems to prevent any callsSo even by creating a CORS-friendly server in the notebook exposed through the driver-proxy-ap...
- 6 kudos
- 3541 Views
- 3 replies
- 3 kudos
Resolved! Cluster terminated.Reason:Unexpected launch failure
Using Community Edition. Cluster starts up and immediately terminates with the following error message.Why would that be?MessageCluster terminated.Reason:Unexpected launch failureAn unexpected error was encountered while setting up the cluster. Pleas...
- 3541 Views
- 3 replies
- 3 kudos
- 1416 Views
- 0 replies
- 1 kudos
- 1416 Views
- 0 replies
- 1 kudos
- 3713 Views
- 6 replies
- 4 kudos
Resolved! Learn Apache Spark
I want to learn Apache Spark for Developer, where do I start and want materials are recommended.
- 3713 Views
- 6 replies
- 4 kudos
- 4 kudos
If you are a databricks customer (any paid subscription like Azure databricks), please register through https://databricks.com/learn/training/home to Academy using email from subscription.Course there are the best on the internet.If you will not see ...
- 4 kudos
- 19655 Views
- 4 replies
- 5 kudos
Resolved! How to provide UPSERT condition in PySpark
I have a table `demo_table_one` in which I want to upsert the following valuesdata = [ (11111 , 'CA', '2020-01-26'), (11111 , 'CA', '2020-02-26'), (88888 , 'CA', '2020-06-10'), (88888 , 'CA', '2020-05-10'), (88888 , 'WA', '2020-07-10'), ...
- 19655 Views
- 4 replies
- 5 kudos
- 5 kudos
@John Constantine,​ can you additionally share what data is in demo_table_one? as we have only df (alias update_table) in that example
- 5 kudos
- 10556 Views
- 3 replies
- 2 kudos
Resolved! java.lang.NoSuchMethodError in databricks
I have created a package in scala. Now, I am calling a method from that package and using it in my notebook. During run time, it throws me an error java.lang.NoSuchMethodError. The method exists in the package but still, I am getting this error. Plea...
- 10556 Views
- 3 replies
- 2 kudos
- 2 kudos
Hi! @Kaniz Fatma​ . I am using scala version 2.11 with spark 2.4.3. According to Apache spark official website https://spark.apache.org/docs/2.4.3/#:~:text=For%20the%20Scala%20API%2C%20Spark,x.) Spark 2.4.3 uses Scala 2.12. (https://spark.apache.org/...
- 2 kudos
- 3551 Views
- 5 replies
- 3 kudos
Resolved! Update Databricks at notebook level?
Hi all,Can we update the Databricks from existing to newer at notebook level?I know we can create a newer cluster and attach the note book to update to the newer version. but, can we also update DB at notebook as we update the libraries?if we can't,...
- 3551 Views
- 5 replies
- 3 kudos
- 3 kudos
Hey there @Kiran Chalasani​ Just checking in. Glad that you were able to resolve your query. Would you be happy to mark the answer as best so that other members can find the solution more quickly?
- 3 kudos
- 5087 Views
- 3 replies
- 2 kudos
Resolved! NoSuchMethodError: com.google.common.util.concurrent.MoreExecutors.directExecutor()Ljava/util/concurrent/Executor
When I execute a function in google-cloud-bigquery:2.7.0 jar, it executes a function in gax:2.12.2 jar and then this gax jar file executes a function in guava jar. And this guava jar file is a Databricks default library which is located at /databrick...
- 5087 Views
- 3 replies
- 2 kudos
- 2 kudos
Hey there @Lily Kim​ Hope you are doing well!Thank you for posting your question. We are happy that you were able to find the solution.Would you please like to mark the answer as best?We'd love to hear from you.
- 2 kudos
- 7455 Views
- 8 replies
- 3 kudos
Resolved! Powerpoint file operations in Databricks
Hi Team, I am writing a python code in Azure Databricks where I have mounted a Azure storage and accessing the input dataset from Azure storage resource. I am accessing the input data from Azure storage and generating charts from that data in databri...
- 7455 Views
- 8 replies
- 3 kudos
- 3 kudos
Hi @Abhishek Jain​ Thanks for sending in your query. We are glad that you found a solution. Would you like to mark the answer as best so the other members can benefit from it too?Cheers!
- 3 kudos
- 3228 Views
- 6 replies
- 4 kudos
Resolved! Is there the possibility to protect Init script folder on DBFS
Hi everyone,We are looking for a way to protect the folder where init script is hosted from editing.This because we have implemented inside init script a parameter that blocks the download file from R Studio APP Emulator and we would like to avoid th...
- 3228 Views
- 6 replies
- 4 kudos
- 4 kudos
Hi @Marco Data​ Thank you for sending in your question. It is awesome that you found a solution. Would you like to mark the answer as best so others can find the solution quickly?Cheers!
- 4 kudos
- 5209 Views
- 2 replies
- 4 kudos
Azure Databricks Delta live table tab is missing
In my Azure Databricks workspace UI I do not have the tab "Delta live tables". In the documentation it says that there is a tab after clicking on Jobs in the main menu. I just created this Databricks resource in Azure and from my understanding the DL...
- 5209 Views
- 2 replies
- 4 kudos
- 4 kudos
Hi @Chr Jon​ How are you doing? Thanks for posting your question. Just checking in to see if one of the answers helped, would you let us know?
- 4 kudos
| User | Count |
|---|---|
| 1611 | |
| 768 | |
| 348 | |
| 286 | |
| 252 |
