Skip to content

test: quarantine GoogleReverseImageTest, engine returns no results - #16

Open
jvmvik wants to merge 1 commit into
masterfrom
fix/google-reverse-image-test
Open

jvmvik wants to merge 1 commit into
masterfrom
fix/google-reverse-image-test

Conversation

@jvmvik

@jvmvik jvmvik commented Nov 5, 2026

Copy link
Copy Markdown
Contributor

🤖 AI-generated: Claude Opus 5.5 (claude-opus-5-5) · effort unknown · main session · diagnosed the failing live test, quarantined it, ran the full live suite locally

Why

GoogleReverseImageTest fails on every run and keeps master CI red. The google_reverse_image engine returns HTTP 200 with status: "Success" and only:

"error": "Google Reverse Image hasn't returned any results for this query."

This reproduced on 2026-11-05 with three unrelated images, all of which download fine:

image search id
https://i.imgur.com/5bGzZi7.jpg (the test image) 6aec5ec26114bdb313a51f26
Wikimedia Eiffel Tower photo 6aec654ed65b8c309615cb4e
serpapi.com logo 6aec65590a89f6f211ca09ec

So the problem is the engine, not the image or this client. The test also failed 0/3 on both master and implement-image-api during review.

Change

  • Mark the test @Ignore with the evidence in a comment, the same way GoogleEventsTest and GoogleJobsTest already handle engines that are broken upstream. JUnit 4.3 has no Assume, so the test can't skip itself at runtime.
  • Assert image_sizes, as serpapi-ruby does, so the test checks real results once it's turned back on.

Testing

./gradlew test with SERPAPI_KEY set (local, JDK 25, macOS): BUILD SUCCESSFUL, 42 passed / 0 failed / 3 skipped (GoogleReverseImageTest, GoogleEventsTest, GoogleJobsTest).

Follow-up

Report the google_reverse_image engine to the SerpApi team, using the search ids above, and re-enable the test once it returns results again.

✍️ Human context (fill in before posting or sharing): where this stands, what you tested by hand, what your gut says.

🤖 Generated with Claude Code

AI: Claude Opus 5.5 · effort unknown · main session: diagnosed the failing live test and quarantined it

The google_reverse_image engine answers every query with HTTP 200, status
"Success" and "Google Reverse Image hasn't returned any results for this
query.", for three unrelated images that all download fine (search ids
6aec5ec26114bdb313a51f26, 6aec654ed65b8c309615cb4e, 6aec65590a89f6f211ca09ec).
This is the engine, not the client, and it keeps master CI red.

Mark the test @ignore with the evidence, as GoogleEventsTest and
GoogleJobsTest already do, and assert image_sizes (as serpapi-ruby does) so
the test checks real results once it is re-enabled.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant