Skip to content

[Backport 2.x] [Rule based auto tagging] Add in-memory rule processing service #17781

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Apr 3, 2025

Conversation

kaushalmahi12
Copy link
Contributor

backport 2.x for #17365

…search-project#17365)

* [rule based autotagging] add attribute value store

Signed-off-by: Kaushal Kumar <[email protected]>

* add in-memory rule processing service

Signed-off-by: Kaushal Kumar <[email protected]>

* add missing javadoc

Signed-off-by: Kaushal Kumar <[email protected]>

* merge the in-memory store changes:

commit d02e544
Author: Kaushal Kumar <[email protected]>
Date:   Mon Feb 17 13:05:20 2025 -0800

    add licenses directory

    Signed-off-by: Kaushal Kumar <[email protected]>

commit 3f98f9d
Author: Kaushal Kumar <[email protected]>
Date:   Mon Feb 17 11:52:56 2025 -0800

    improve binary search bisecting expression

    Signed-off-by: Kaushal Kumar <[email protected]>

commit 630a3ee
Author: Kaushal Kumar <[email protected]>
Date:   Mon Feb 17 11:14:39 2025 -0800

    improve javadoc for attribute value store

    Signed-off-by: Kaushal Kumar <[email protected]>

commit acdb27c
Author: Kaushal Kumar <[email protected]>
Date:   Fri Feb 14 10:09:58 2025 -0800

    add missing javadoc

    Signed-off-by: Kaushal Kumar <[email protected]>

commit 24c4ea6
Author: Kaushal Kumar <[email protected]>
Date:   Fri Feb 14 09:28:46 2025 -0800

    run spotless apply

    Signed-off-by: Kaushal Kumar <[email protected]>

commit 75b6e68
Author: Kaushal Kumar <[email protected]>
Date:   Fri Feb 14 09:24:32 2025 -0800

    make the store interface generic

    Signed-off-by: Kaushal Kumar <[email protected]>

Signed-off-by: Kaushal Kumar <[email protected]>

* fix generics error

Signed-off-by: Kaushal Kumar <[email protected]>

* add CHANGELOG entry

Signed-off-by: Kaushal Kumar <[email protected]>

* remove stubs

Signed-off-by: Kaushal Kumar <[email protected]>

* move generic logic to lib

Signed-off-by: Kaushal Kumar <[email protected]>

* fix javadoc error

Signed-off-by: Kaushal Kumar <[email protected]>

* fix javadoc error

Signed-off-by: Kaushal Kumar <[email protected]>

* delete licenses from the wlm plugin

Signed-off-by: Kaushal Kumar <[email protected]>

* expose feature level attribute value store init method

Signed-off-by: Kaushal Kumar <[email protected]>

* add extra space to remove unwanted entry from the changelog diff

Signed-off-by: Kaushal Kumar <[email protected]>

* address comments

Signed-off-by: Kaushal Kumar <[email protected]>

* use constructors over static methods

Signed-off-by: Kaushal Kumar <[email protected]>

* make member var final in InMemoryRuleProcessingService

Signed-off-by: Kaushal Kumar <[email protected]>

* make concurrency checks more granular

Signed-off-by: Kaushal Kumar <[email protected]>

* add concurrent test

Signed-off-by: Kaushal Kumar <[email protected]>

* remove forbidden api usage

Signed-off-by: Kaushal Kumar <[email protected]>

---------

Signed-off-by: Kaushal Kumar <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>
Copy link
Contributor

github-actions bot commented Apr 3, 2025

❌ Gradle check result for ae3289b: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Copy link
Contributor

github-actions bot commented Apr 3, 2025

❌ Gradle check result for b46d54f: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

@jainankitk
Copy link
Contributor

One test failed, looks unrelated:

[Test Result](https://build.ci.opensearch.org/job/gradle-check/55500/testReport/) (1 failure / +1)

    [org.opensearch.cluster.allocation.SearchReplicaFilteringAllocationIT.testSearchReplicaDedicatedIncludes_DoNotAssignToOtherNodes](https://build.ci.opensearch.org/job/gradle-check/55500/testReport/junit/org.opensearch.cluster.allocation/SearchReplicaFilteringAllocationIT/testSearchReplicaDedicatedIncludes_DoNotAssignToOtherNodes/)

Copy link
Contributor

github-actions bot commented Apr 3, 2025

✅ Gradle check result for b46d54f: SUCCESS

Copy link

codecov bot commented Apr 3, 2025

Codecov Report

Attention: Patch coverage is 87.32394% with 9 lines in your changes missing coverage. Please review.

Project coverage is 72.12%. Comparing base (03b7d62) to head (b46d54f).
Report is 3 commits behind head on 2.x.

Files with missing lines Patch % Lines
...wlm/rule/attribute_extractor/IndicesExtractor.java 0.00% 5 Missing ⚠️
...opensearch/rule/InMemoryRuleProcessingService.java 94.87% 0 Missing and 2 partials ⚠️
...earch/rule/storage/AttributeValueStoreFactory.java 83.33% 1 Missing and 1 partial ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##                2.x   #17781      +/-   ##
============================================
+ Coverage     71.99%   72.12%   +0.13%     
- Complexity    66114    66197      +83     
============================================
  Files          5348     5351       +3     
  Lines        307550   307639      +89     
  Branches      44906    44918      +12     
============================================
+ Hits         221409   221886     +477     
+ Misses        67714    67288     -426     
- Partials      18427    18465      +38     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@jainankitk jainankitk merged commit e985fc2 into opensearch-project:2.x Apr 3, 2025
45 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants