cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
alm
by • New Contributor III
  • 7094 Views
  • 6 replies
  • 2 kudos

Resolved! How to grant access to views without granting access to underlying tables

I have a medallion architecture: Bronze layer: Raw data in tablesSilver layer: Refined data in views created from the bronze layerGold layer: Data products as views created from the silver layerCurrently I have a data scientist that needs access to d...

Data Engineering
Reply
  • 7094 Views
  • 6 replies
  • 2 kudos
View Replies
Latest Reply
MoJaMa
Databricks Employee
  • 2 kudos

Single-user clusters use a different security mode which is the reason for this difference. On single-user/assigned clusters, you'll need the Fine Grained Access Control service (which is a Serverless service) - that is the solution to this problem (...

  • 2 kudos
5 More Replies
Nick_Hughes
by • New Contributor III
  • 5349 Views
  • 2 replies
  • 1 kudos

Authorised views in databricks?

In GCP you can give a user access to a view, and then the view itself access to the underlying object, meaning you don't have to give end users access to the tables themselves.Is there a similar way of managing these permissions in databricks? The vi...

Data Engineering
Reply
  • 5349 Views
  • 2 replies
  • 1 kudos
View Replies
Latest Reply
<div style= This widget could not be displayed.
" src="" />
This widget could not be displayed.
This widget could not be displayed.
This widget could not be displayed.
  • 1 kudos

This widget could not be displayed.
In GCP you can give a user access to a view, and then the view itself access to the underlying object, meaning you don't have to give end users access to the tables themselves.Is there a similar way of managing these permissions in databricks? The vi...

This widget could not be displayed.
  • 1 kudos
This widget could not be displayed.
1 More Replies
celver_tom
by • New Contributor
  • 690 Views
  • 0 replies
  • 0 kudos

Check consistency of global temp views

Currently we are facing an issue with global temp views. We create in one notebook a global temp view and query the results in another notebook on the same cluster. The issue is, that the result is not consistent. When we query the view several times...

Data Engineering
Reply
  • 690 Views
  • 0 replies
  • 0 kudos
bdugar
by • New Contributor II
  • 15470 Views
  • 1 replies
  • 2 kudos

Creating permanent views from dataframes?

Hi:It's possible to create temp views in pyspark using a dataframe (df.createOrReplaceTempView()), and it's possible to create a permanent view in Spark SQL. But as far as I can tell, there is no way to create a permanent view from a dataframe, somet...

Data Engineering
Reply
  • 15470 Views
  • 1 replies
  • 2 kudos
View Replies
Latest Reply
bdugar
New Contributor II
  • 2 kudos

Hi Kaniz:This is what I understood from the research I did, I was curious more as to why permanent views can't be created from dataframes and whether this is a feature that might be implemented by Databricks or Spark at some point. Temporary views ca...

  • 2 kudos
gbalboa
by • New Contributor
  • 16413 Views
  • 1 replies
  • 6 kudos

Resolved! How do temp views actually work?

So I'm querying data from parquet files that have a couple of billions records (table 1 or t1), and then have to filter and then join with other parquet files with another couple of billions records (t2). This takes quite a long time to run (like 10h...

Data Engineering
Reply
  • 16413 Views
  • 1 replies
  • 6 kudos
View Replies
Latest Reply
PeteStern
Databricks Employee
  • 6 kudos

Your intuition about views is correct. Views are not materialized, so they are basically just a saved query. Every time you access a view it will have to be recomputed. This is certainly not ideal if it take a long time (like 10hrs) to materialize a ...

  • 6 kudos
User16826990884
by • New Contributor III
  • 17687 Views
  • 1 replies
  • 1 kudos

Resolved! Views vs Materialized Delta Tables

Is there general guidance around using views vs creating Delta tables? For example, I need to do some filtering and make small tweaks to a few columns for use in another application. Is there a downside of using a view here?

Data Engineering
Reply
  • 17687 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
User16826990884
New Contributor III
  • 1 kudos

Views won't duplicate the data so if you are just filtering columns or rows or making small tweaks then views might be a good option. Unless, of course, the filtering is really expensive or you are doing a lot of calculations, then materialize the vi...

  • 1 kudos
Labels