Arrays of complex type always evaluate to ARRAY?

pt-jake — Mon, 01 May 2023 13:33:27 GMT

Arrays of complex types seemingly always evaluate to ARRAY<STRING>. Therefore, casting or attempting to load JSON data with empty array values fails. For example, attempting to cast a JSON value of {"likes": []...} on load to the following table schema fail with the following error:

Schema:

array<struct<gid:string,user:struct<gid:string,name:string,resource_type:string>>>

Error:

"Error copy: [DATATYPE_MISMATCH.CAST_WITHOUT_SUGGESTION] Cannot resolve "likes" due to data type mismatch: cannot cast "ARRAY<STRING>" to "ARRAY<STRUCT<gid: STRING, user: STRUCT<gid: STRING, name: STRING, resource_type: STRING>>>"

What is the best way to handle empty/null complex-typed arrays?

Re: Arrays of complex type always evaluate to ARRAY?

Anonymous — Thu, 18 May 2023 09:30:55 GMT

Hi @Jake Neyer

Thank you for posting your question in our community! We are happy to assist you.

To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your question?

This will also help other community members who may have similar questions in the future. Thank you for your participation and let us know if you need any further assistance!

topic Re: Arrays of complex type always evaluate to ARRAY<STRING>? in Data Engineering

Arrays of complex type always evaluate to ARRAY?

Re: Arrays of complex type always evaluate to ARRAY?