-
Notifications
You must be signed in to change notification settings - Fork 120
Add Gemini test infrastructure. #1343
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
umaannamalai
merged 7 commits into
feature-gemini-instrumentation
from
gemini-test-infrastructure
Apr 1, 2025
Merged
Add Gemini test infrastructure. #1343
umaannamalai
merged 7 commits into
feature-gemini-instrumentation
from
gemini-test-infrastructure
Apr 1, 2025
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
🦙 MegaLinter status: ✅ SUCCESS
See detailed report in MegaLinter reports |
…elic-python-agent into gemini-test-infrastructure
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## feature-gemini-instrumentation #1343 +/- ##
==================================================================
- Coverage 81.48% 81.29% -0.19%
==================================================================
Files 204 204
Lines 22821 22821
Branches 3617 3617
==================================================================
- Hits 18595 18553 -42
- Misses 3013 3050 +37
- Partials 1213 1218 +5 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
TimPansino
approved these changes
Apr 1, 2025
2cadc57
into
feature-gemini-instrumentation
46 of 52 checks passed
umaannamalai
added a commit
that referenced
this pull request
Apr 7, 2025
* Add Gemini test infra. * Pull tox.ini changes. * [MegaLinter] Apply linters fixes * Remove mock package dependency. * [MegaLinter] Apply linters fixes --------- Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
umaannamalai
added a commit
that referenced
this pull request
Apr 30, 2025
* Add Gemini test infra. * Pull tox.ini changes. * [MegaLinter] Apply linters fixes * Remove mock package dependency. * [MegaLinter] Apply linters fixes --------- Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
umaannamalai
added a commit
that referenced
this pull request
Apr 30, 2025
* Add Gemini test infra. * Pull tox.ini changes. * [MegaLinter] Apply linters fixes * Remove mock package dependency. * [MegaLinter] Apply linters fixes --------- Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
umaannamalai
added a commit
that referenced
this pull request
Apr 30, 2025
* Add Gemini test infra. * Pull tox.ini changes. * [MegaLinter] Apply linters fixes * Remove mock package dependency. * [MegaLinter] Apply linters fixes --------- Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
TimPansino
pushed a commit
that referenced
this pull request
May 1, 2025
* Add Gemini test infrastructure. (#1343) * Add Gemini test infra. * Pull tox.ini changes. * [MegaLinter] Apply linters fixes * Remove mock package dependency. * [MegaLinter] Apply linters fixes --------- Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com> * Add Gemini embeddings. * [MegaLinter] Apply linters fixes * Address review comments. * Key into kwargs dict. * Update embedding error logic. * Fix embeddings error tests for py39. * [MegaLinter] Apply linters fixes * Add Gemini test infrastructure. (#1343) * Add Gemini test infra. * Pull tox.ini changes. * [MegaLinter] Apply linters fixes * Remove mock package dependency. * [MegaLinter] Apply linters fixes --------- Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com> * Add Gemini embeddings. * [MegaLinter] Apply linters fixes * Address review comments. * Key into kwargs dict. * Update embedding error logic. * Fix embeddings error tests for py39. * [MegaLinter] Apply linters fixes * Add Gemini text generations. * Bump tests. * [MegaLinter] Apply linters fixes * Fix py39 errors test failure. * [MegaLinter] Apply linters fixes * Add comments. * Update request message logic. * [MegaLinter] Apply linters fixes * Add string-based tests. * Add Gemini test infrastructure. (#1343) * Add Gemini test infra. * Pull tox.ini changes. * [MegaLinter] Apply linters fixes * Remove mock package dependency. * [MegaLinter] Apply linters fixes --------- Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com> * Add Gemini embeddings. * [MegaLinter] Apply linters fixes * Address review comments. * Key into kwargs dict. * Update embedding error logic. * Fix embeddings error tests for py39. * [MegaLinter] Apply linters fixes * Add Gemini text generations. * Bump tests. * Fix py39 errors test failure. * [MegaLinter] Apply linters fixes * Add comments. * [MegaLinter] Apply linters fixes * Add Gemini embeddings. * Address review comments. * Key into kwargs dict. * Fix embeddings error tests for py39. * [MegaLinter] Apply linters fixes * Update request message logic. * Add string-based tests. * [MegaLinter] Apply linters fixes * Address review. * Temporarily pin redis tests. * Temporarily pin redis tests to below v5.3.0. --------- Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com> Co-authored-by: Hannah Stepanek <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR adds test infrastructure to support embeddings and text completions in
google-genai
Gemini LLMs including:google-genai
conftest.py
file that configures and yields test clients, the main server, and includes logic to intercept real Gemini requests and responses and log them out to a log file for later use to update the existing mocked server with new prompts