Multiple Databricks cluster in same workspace
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-16-2022 05:36 PM
Hi All,
I have created three cluster(dev,qa,prod)in the same workspace to isolate data for different environment.How do we differentiate environment while running job using dev it should update data for dev environment?
Regards,
Rajib
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-17-2022 12:02 AM
you can create 2 workspaces dev n prod that also best practice
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-17-2022 06:31 AM
@sherbin w -The customer doesn't want to create separate workspace.We need to create multiple cluster in same workspace.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-17-2022 10:06 PM
hey @Rajib Rajib Mandal , this is very easy, i have done this multiple times, you can segregate data using your IAM role that is attached to the cluster, it is known as an Instance profile, you can only give the dev data access to dev role and the so on for other 2 test and prod cluster.and it will work like as you want
Thanks
Aviral