- 4780 Views
- 1 replies
- 1 kudos
How to update the items in array of struct column with sql
create table test.json_test_01 ( id int, description string, struct_address STRUCT<street_number: STRING, street_name: STRING, city: STRING, province: STRING>, arrary_phone ARRAY<STRUCT<phone_number: STRING, phone_type: STRING>> ); insert into ...
- 4780 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @Richard Guo Great to meet you, and thanks for your question! Let's see if your peers in the community have an answer to your question. Thanks.
- 1 kudos
- 7577 Views
- 2 replies
- 1 kudos
How to apply a UDF to a property in an array of structs
I have a column that contains an array of structs as follows:"column" : [ { "struct_field1": "struct_value", "struct_field2": "struct_value" }, { "struct_field1": "struct_value", "struct_field2": "struct_value" } ]I want to apply a udf to each f...
- 7577 Views
- 2 replies
- 1 kudos
- 1 kudos
I have a column that contains an array of structs as follows:"column" : [ { "struct_field1": "struct_value", "struct_field2": "struct_value" }, { "struct_field1": "struct_value", "struct_field2": "struct_value" } ]I want to apply a udf to each f...
- 1 kudos
- 3035 Views
- 2 replies
- 0 kudos
Resolved! Is there a way to validate the values of spark configs?
We can set for example:spark.conf.set('aaa.test.junk.config', 99999) , and then run spark.conf.get("aaa.test.junk.config”) which will return a value.The problem occurs when incorrectly setting to a similar matching property.spark.conf.set('spark.sql....
- 3035 Views
- 2 replies
- 0 kudos
- 0 kudos
You would solve this just like we solve this problem for all lose string references. Namely, that is to create a constant that represents the key-value you want to ensure doesn't get mistyped.Naturally, if you type it wrong the first time, it will be...
- 0 kudos