Skip to content

[VL] json tuple mismatch when json key have .  #10159

@lyy-pineapple

Description

@lyy-pineapple

Backend

VL (Velox)

Bug description

Currently, Gluten translates json_tuple(a, key) directly into get_json_object(a, key). This causes issues when the key contains a dot (.), leading to incorrect parsing behavior.

Details:
For example, if a = '{"a.b":"a"}', then:

json_tuple(a, 'a.b') correctly returns "a"

But the translated expression get_json_object(a, '$.a.b') treats the key as a nested path, looking for a field b under a, which results in null

Gluten version

main branch

Spark version

None

Spark configurations

No response

System information

No response

Relevant logs

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingtriage

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions