cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

delta sharing issue after enable predictive optimization

lizou8
New Contributor III

Some of our delta sharing tables are not working 

May be related to this, or maybe not, we enabled predictive optimization on all tables a few days ago

es not working any more

but any new tables created works fine after setting this

SET TBLPROPERTIES (delta.enableDeletionVectors=false);

anyone experience same issue?  thanks

1 ACCEPTED SOLUTION

Accepted Solutions

lizou8
New Contributor III

after some debugging, I find out a very unique cause if we used a JSON string in column comment, and it make sense that a JSON string in column comment breaks delta sharing

example: column COMMENT  {"key": "primary_key", "is_identity": "true"}

The error said Unexpected character ('k' (code 107)):  k comes from the "key" in JSON string leads me to find a solution is to set comment as blank

but 

 

View solution in original post

2 REPLIES 2

lizou8
New Contributor III

error

JsonParseException: Unexpected character ('k' (code 107)): was expecting comma to separate Object entries at [Source: (String)"{"type":"struct","fields":[{"name":"UserKey","type":"long","nullable":false,"metadata":{"comment":"{"key":"primary_key","is_identity":"true"}"}},{"name":"SystemDate","type":"date","nullable":false,"metadata":{}},{"name":"UserId","type":"string","nullable":false,"metadata":{}},{"name":"Email","type":"string","nullable":true,"metadata":{}},{"name":"UserName","type":"string","nullable":true,"metadata":{}},{"name":"Active","type":"boolean","nullable":true,"metadata":{}},{"name":"FullName","type":"st"[truncated 713 chars]; line: 1, column: 103]
at com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:2477)

lizou8
New Contributor III

after some debugging, I find out a very unique cause if we used a JSON string in column comment, and it make sense that a JSON string in column comment breaks delta sharing

example: column COMMENT  {"key": "primary_key", "is_identity": "true"}

The error said Unexpected character ('k' (code 107)):  k comes from the "key" in JSON string leads me to find a solution is to set comment as blank

but 

 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group