Google Cloud Vision API enables developers to integrate vision detection features into applications, including image labeling, face and landmark detection, optical character recognition (OCR), and explicit content tagging.
Available to claim
Build and ship the Google Cloud Vision plugin to earn 39 points when we merge it to main. You have 1 hour to link an issue, then 3 hours to open a PR with the plugin scaffold.
Add a Product to a ProductSet in Google Cloud Vision Product Search. This action associates a Product with a ProductSet, enabling the product to be included in product search queries against that set. Both resources must exist in the same Google Cloud project and location before calling this action. Key characteristics: - Idempotent: If the Product is already in the ProductSet, no change is made and no error occurs - Constraint: One Product can be added to at most 100 ProductSets - The Product and ProductSet must be in the same project and location - Valid locations: us-west1, us-east1, europe-west1, asia-east1 Use this after creating both a Product and a ProductSet to establish their association. Returns an empty response on success.
Tool to perform image detection and annotation for batch files in Google Cloud Vision. Supports PDF, TIFF, and GIF files. Extracts up to 5 frames (GIF) or pages (PDF/TIFF) from each file and performs detection for each image. Use when you need to analyze documents or multi-page images with features like text detection, label detection, face detection, or other Vision API capabilities.
Run image detection and annotation for a batch of images using Google Cloud Vision API. Performs various types of image analysis including face detection, landmark detection, logo detection, label detection, text detection (OCR), safe search detection, image properties, crop hints, web detection, product search, and object localization. Supports up to 16 images in a single batch request. Each image can have multiple feature types analyzed simultaneously.
Tool to run asynchronous image detection and annotation for a batch of images. Use when processing multiple images or large images that require longer processing time. Results are written to Google Cloud Storage as JSON files.
Tool to run image detection and annotation for a batch of images scoped to a specific project and location. Performs various types of image analysis including label detection, face detection, landmark detection, logo detection, OCR text detection, safe search detection, image properties, crop hints, web detection, product search, and object localization. Supports processing up to 16 images per request with regional endpoint routing (us, asia, eu). Use this when you need to analyze images with location-specific processing for content extraction, text recognition, object detection, face identification, or landmark/logo recognition.
Tool to run asynchronous image detection and annotation for a list of generic files (PDF, TIFF, GIF). Use when processing multi-page documents that may contain multiple images per page. Results are written to Google Cloud Storage and progress can be tracked via the returned operation name using VisionGetOperation.
Starts asynchronous cancellation of a long-running Vision API operation. Returns an empty response on successful cancellation request. Note that the server makes a best effort to cancel the operation, but success is not guaranteed. Use the Get Operation action to check if cancellation succeeded or if the operation completed despite the cancellation attempt. The server may return UNIMPLEMENTED if the operation does not support cancellation.
Creates a new ProductSet resource in Google Cloud Vision Product Search. A ProductSet is a container for grouping related products together for visual search. After creating a product set, you can add products to it using the AddProductToProductSet action. Prerequisites: - Vision API must be enabled in your Google Cloud project - Product Search must be enabled - Valid project ID and location (us-west1, us-east1, europe-west1, or asia-east1) Use this action to: - Create a new product set container - Organize products into logical groups - Obtain a product set resource name for adding products
Tool to create a ReferenceImage under a product. Use when adding a new image to a product for detection.
Creates a new Product resource in Google Cloud Vision Product Search. A Product represents a physical item that can be visually searched using reference images. After creating a product, you can add reference images to it and include it in product sets for visual search capabilities. Prerequisites: - Vision API must be enabled in your Google Cloud project - Product Search must be enabled - Valid project ID and location (us-west1, us-east1, europe-west1, or asia-east1) Use this action to: - Register a new product for visual search - Set up product metadata (display name, description, category, labels) - Obtain a product resource name for adding reference images
Permanently deletes a Product and its associated reference images from Google Cloud Vision API. This is a destructive operation that cannot be undone. The product metadata and all images are deleted immediately, though search queries against ProductSets may temporarily return cached results until caches refresh. Use this tool when you need to remove a product that is no longer needed. Ensure you have the correct product resource name before deletion.
Tool to permanently delete a ProductSet. Use after confirming the ProductSet's resource name.
Permanently removes a reference image from a product in Google Cloud Vision Product Search. This action deletes the reference image association from the specified product. The image will be marked for deletion and removed during the next indexing operation. Note that the actual image file in Google Cloud Storage is not deleted. Use this when you need to: - Remove outdated or incorrect product reference images - Clean up test images from products - Update product imagery by removing old references Prerequisites: - The product must exist - The reference image must have been previously created under the product - You need the full resource path of the reference image (use List Reference Images if unknown)
Tool to delete a long-running Vision API operation. Use after confirming the operation name.
Tool to get information associated with a Product. Use when you have the product resource name and need its details.
Tool to get a ProductSet. Use when you need metadata details of an existing ProductSet by its full resource name. Use after obtaining the resource name.
Tool to get information associated with a ReferenceImage. Use when you have the full resource name and need its metadata.
Retrieves the latest state of a long-running Vision API operation. Use this to poll the status of asynchronous operations like importProductSets or purgeProducts. The operation name is returned when you start an async operation.
Asynchronously imports product sets and reference images from a CSV file stored in Google Cloud Storage. This bulk import operation creates ProductSets, Products, and ReferenceImages from a properly formatted CSV file. Returns a long-running Operation that can be polled for completion status. The import automatically creates new ProductSets and Products if they don't exist based on the IDs in the CSV. Use this when you need to: - Bulk import multiple products and images at once - Create product catalogs from existing CSV data - Set up initial product search datasets Note: Requires OAuth authentication with cloud-platform or cloud-vision scope, and read access to the GCS bucket.
Tool to list available Vision AI service locations for a project. Use when you need to discover supported regions before making region-specific API calls.
Tool to list Products in a specified ProductSet. Use when you need to retrieve Products associated with a ProductSet after confirming it exists, with optional pagination.
List Google Cloud projects accessible to the authenticated user via Cloud Resource Manager API. This action queries the Cloud Resource Manager API (not Vision API directly) to enumerate projects. It requires OAuth 2.0 authentication - API key auth is insufficient. Use this when you need to discover available project IDs before making Vision API calls that require project identifiers. Note: Returns projects you have 'resourcemanager.projects.get' permission on.
Tool to list reference images for a product. Use when you need to retrieve stored reference images under a specified product resource name, with optional pagination.
Lists IndexEndpoints in Vertex AI Vision for a given project and location. IndexEndpoints are deployed instances of image indexes used for visual search and retrieval in Vision AI's media warehouse. Use this tool to discover existing endpoints before querying them or to manage deployed indexes. IMPORTANT: Requires OAuth2 authentication (API keys are NOT supported). Needs 'visionai.indexEndpoints.list' IAM permission.
Tool to list operations that match the specified filter. Use when you need to retrieve all operations under a specific project and location.
Tool to asynchronously delete products in a ProductSet or orphan products. Use when you need to clean up products at scale; ensure `force` is true to execute.
Removes a Product from a specified ProductSet in Google Cloud Vision API. This operation unlinks a product from a product set but does not delete either resource. Both the product and product set must exist in the same Google Cloud project and location. The product must have been previously added to the product set for this operation to succeed. Use this when you need to reorganize products across product sets or remove a product from a set without deleting the product itself.
Tool to update a Product's mutable fields: displayName, description, and productLabels. Use after confirming the product resource name.
Tool to update a ProductSet resource. Use when you need to modify the displayName of an existing ProductSet.
No webhooks.
