Closed
Description
Describe the bug
The "ignore_malformed" option should allow inconsistent data to be indexed, losing only the malformed fields, but it is ignoring the entire item.
To Reproduce
- Create an empty index with the setting "ignore_malformed": "true".
- insert the following data {
"name":"test 1",
"other_field":"string content"
} - insert the following data {
"name":"test 2",
"other_field":{"comment":"object content","size":2}
}
Expected behavior
In this situation the second item should be indexed only the field "other_field" should be missed, but the hole item is lost.
Host/Environment (please complete the following information):
- OS: centos 8
- Version 2.1
Additional context
I'm using this to index a lot of unstructured data, and sometimes a few fields are invalid, but it shouldn't lose the valid fields.