Databricks Community

qwerty1 · 05-29-2023

I am unable to create bloom filter index on my tableCREATE BLOOMFILTER INDEX ON TABLE my_namespace.foo FOR COLUMNS (id OPTIONS (fpp = 0.1, numItems = 6000000))Gives the errorAnalysisException: Table `spark_catalog`.`my_namespace`.`foo` did not specif...

qwerty1 · 05-26-2023

We have a live streaming table created using the commandCREATE OR REFRESH STREAMING LIVE TABLE foo TBLPROPERTIES ( "pipelines.autoOptimize.zOrderCols" = "c1,, c2, c3, c4", "delta.randomizeFilePrefixes" = "true" );But when I run the show table propert...

qwerty1 · 04-26-2023

The documentation statesYou can specify multiple columns for ZORDER BY as a comma-separated list. However, the effectiveness of the locality drops with each extra columnWhat does it mean for "effectiveness of the locality to drop" with each extra co...

qwerty1 · 04-24-2023

I am in a situation where I have a notebook that runs in a pipeline that creates a "live streaming table". So, I cannot use a language other than sql in the pipeline. I would like to format a certain column in the pipeline using a scala code (it's a ...

qwerty1 · 04-24-2023

My data is a dump of JSON response from an API. The schema of the json iscol_name data_type data array<struct<attributes:struct<name: String, age: Int relationships:struct<address:struct<data:arraay<struct<id: long, type: string>>>>>>> ...

qwerty1 · 04-26-2023

I used a similar solution (exploding only one column) and it worked

qwerty1 · 04-25-2023

yes, python is an option if I can use the library https://pypi.org/project/phonenumbers/

qwerty1 · 04-24-2023

@Kaniz Fatma isn't this basically doing an "explode" on "data" and "included" and then joining them? We end up doing join on the whole data set instead of within the row.

qwerty1 · 03-23-2023

Thanks for the response. Is there a tentative date for DBR 14 release?

Databricks Community

User Stats

User Activity

Unable to create bloom filter index

Why am I not able to view all table properties?

What is the disadvantage of using multiple Z-Order columns?

Is there a way to register a scala function that is available to other notebooks?

Doing a a join within the same row in SQL

Re: Doing a a join within the same row in SQL

Re: Is there a way to register a scala function that is available to other notebooks?

Re: Doing a a join within the same row in SQL

Re: When will databricks runtime be released for Scala 2.13?