Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[OWLv2] One-shot results (using an image as a query) do NOT work as they do in the Google Colab notebook #1096

Open
sheikh1000 opened this issue Aug 22, 2024 · 0 comments

Comments

@sheikh1000
Copy link

sheikh1000 commented Aug 22, 2024

Hi,
You've done some great work!

Although I've run the Colab notebook here and the results of Image-conditioned detection are great, I don't get the same results when I try it in my local environment.

I'm using the Hugging Face implementation.

Results with text prompts:

results_of_text_prompt

Image used for prompting:

image_prompt

Results of prompting with the above image:

results_of_image_prompt

The Colab notebook takes an image prompt in the form of a UI, where the user makes a bounding box on the query image to select the object of interest. Hence, I provided the cropped image of the object of interest (a resistor, in this case).

Below is the Hugging Face implementation that I'm using (the query image is the cropped image of the resistor in this case):

inputs = processor(images=image, query_images=query_image, return_tensors="pt") with torch.no_grad(): outputs = model.image_guided_detection(**inputs)

@sheikh1000 sheikh1000 changed the title One-shot results (using an image as a query) are not the same as in the Google Colab notebook. One-shot results (using an image as a query) do NOT work as they do in the Google Colab notebook. Aug 22, 2024
@sheikh1000 sheikh1000 changed the title One-shot results (using an image as a query) do NOT work as they do in the Google Colab notebook. One-shot results (using an image as a query) do NOT work as they do in the Google Colab notebook Aug 22, 2024
@sheikh1000 sheikh1000 changed the title One-shot results (using an image as a query) do NOT work as they do in the Google Colab notebook [OWLv2] One-shot results (using an image as a query) do NOT work as they do in the Google Colab notebook Aug 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant