- 4451 Views
- 2 replies
- 4 kudos
Let's say I create a table like CREATE TABLE IF NOT EXISTS new_db.data_table (
key STRING,
value STRING,
last_updated_time TIMESTAMP
) USING DELTA LOCATION 's3://......';Now when I insert into this table I insert data which has say 20 columns a...
- 4451 Views
- 2 replies
- 4 kudos
Latest Reply
I tried running "REFRESH TABLE tablename;" but I still do not see the added columns in the data explorer columns, while I do see the added columns in the sample data
1 More Replies
- 527 Views
- 1 replies
- 0 kudos
SELECT if((select count(*) from information_schema.table_privileges where grantee = 'samo@test.com' and table_schema='demo_schema' and table_catalog='demo_catalog')==1, (select count(*) from demo_catalog.demo_schema.demo_table), (select count(*) from...
- 527 Views
- 1 replies
- 0 kudos
Latest Reply
Hi, GRANT and REVOKE are privileges on an securable object to a principal. And a principal is a user, service principal, or group known to the metastore. Principals can be granted privileges and may own securable objects.Also, you can use REVOKE ON S...
by
Ovi
• New Contributor III
- 1338 Views
- 5 replies
- 10 kudos
Hi all! I have an S3 bucket with Delta parquet files/folders with different schemas each. I need to create an RDD or DataFrame from all those Delta Tables that should contain the path, name and different schema of each.How could I do that?Thank you!P...
- 1338 Views
- 5 replies
- 10 kudos
Latest Reply
You can mount S3 bucket or read directly from it.access_key = dbutils.secrets.get(scope = "aws", key = "aws-access-key")
secret_key = dbutils.secrets.get(scope = "aws", key = "aws-secret-key")
sc._jsc.hadoopConfiguration().set("fs.s3a.access.key", ac...
4 More Replies
- 1212 Views
- 2 replies
- 5 kudos
We have multiple environments where the same tables are added so it's really hard to manually update the schema of the table across all the environments. We know that it's not ideal to update table schema a lot but our product is still evolving and s...
- 1212 Views
- 2 replies
- 5 kudos
Latest Reply
Thanks for the reply @Pat Sienkiewicz​ .
1 More Replies
by
Panna
• New Contributor II
- 963 Views
- 2 replies
- 3 kudos
I'm creating an array which contains both string and double, just wondering if I can have multiple element type options for one array column? Thanks
- 963 Views
- 2 replies
- 3 kudos
Latest Reply
Hi @Panna Pan​ , We haven’t heard from you on the last response from @Debayan Mukherjee​, and I was checking back to see if his suggestions helped you. Or else, If you have any solution, please do share that with the community as it can be helpful to...
1 More Replies
