Humanloop helps developers build and refine AI applications, offering user feedback loops, model training, and data annotation to iterate on language model performance
Available to claim
Build and ship the Humanloop plugin to earn 14 points when we merge it to main. You have 1 hour to link an issue, then 3 hours to open a PR with the plugin scaffold.
This tool creates a new project in Humanloop. It is an independent action that generates a project by accepting a project's name (required), an optional description, and an optional organization_id. Upon execution, it returns details of the created project, including the project's id, name, description, created_at timestamp, and organization_id.
This tool allows you to delete a specific project from your Humanloop organization. The deletion is permanent and cannot be undone. All associated data, including sessions, datapoints, and evaluations linked to the project, will be permanently removed.
This tool retrieves an array of experiments associated with a specific project in Humanloop. It requires a project_id (starting with 'pr_') and returns details including experiment_id, name, description, creation timestamp, status, configuration details, and metrics/results. It is useful for monitoring experiments, analyzing results, tracking model configurations, and comparing experimental setups.
This tool retrieves a paginated list of sessions for a specific project in Humanloop. It requires a project_id (and optionally, page and size for pagination) and returns session details such as id, reference_id, project information, datapoints_count, first_inputs, last_output, created_at, and updated_at. This enables users to monitor and analyze historical project interactions.
No webhooks.
