Databricks Community

jeremy98

Hello, community!I have a question about deploying workflows in a production environment. Specifically, how can we deploy a group of workflows to production so that they are created only once and cannot be duplicated by others?Currently, if someone d...

jeremy98

Hello Community,Is it possible to modify the schema of an existing table that currently has an ID column without any constraints? I would like to update the schema to make the ID column a primary key with auto-increment starting by the maximum id al...

jeremy98

Hello community,I'm inserting in a table defined (with primary key and foreign key set) some records in overwrite mode every moment I run a workflow where the task is defined. Why after inserting those records the DDL schema changes? Why I have my pr...

jeremy98

Hello community,I installed databricks extension on my vscode ide. How to fix this error? I created the environment to run locally my notebooks and selected the available remote cluster to execute my notebook, what else?I Have this error: ImportError...

jeremy98

Hello,Is it possible to move in another resource group the databricks service without any problem?I have a resource group where there are two workspaces the prod and staging environment, I created another resource group to maintain only the databrick...

jeremy98

I had this night another issue:run failed with error message Unable to access the notebook "/Workspace/Users/<user email>/.bundle/rnc_data_pipelines/prod/files/notebook/prod/db_sync_initial_wip". Either it does not exist, or the identity used to run...

jeremy98

Hi Walter, the name of the workflow is the same. The only thing that I changed is the compute configuration that I changed to PHOTON configuration without using it. Also the creator of the workflow, that in this case the first creation was made by my...

jeremy98

So, I don't understand if there is a possibility to overwrite the same workflow because could be a mess if someone changes a cluster configuration I want to be sure that there is only one workflow activated with the new configuration. I'm saying thos...

jeremy98

Thanks guys, for those guys I'm going to try them!

jeremy98

@unj1m yes, as Alberto said you don't need to install pyspark, it is included in your cluster configuration.

Databricks Community

User Stats

User Activity

How to deploy unique workflows that running on production

Can we modify the constraint of a primary key in an existed table?

unvalidated the primary and foreign keys constraints?

ImportError: cannot import name 'AnalyzeArgument' from 'pyspark.sql.udtf'

Move Databricks service to another resource group

Re: How to deploy unique workflows that running on production

Re: How to deploy unique workflows that running on production

Re: How to deploy unique workflows that running on production

Re: How to deploy unique workflows that running on production

Re: ImportError: cannot import name 'AnalyzeArgument' from 'pyspark.sql.udtf'