> ## Documentation Index
> Fetch the complete documentation index at: https://docs.honeyhive.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# CreateEvaluatorRequest

> TypeScript request type for the HoneyHive API

## Properties

### definition

> **definition**: \{ `python`: \{ `code_execution`: \{ `code_snippet`: `string`; }; `filters`: \{ `filterArray`: `object`\[]; }; `metadata`: \{ `description?`: `string`; }; `name`: `string`; `sampling`: \{ `sampling_percentage`: `number`; }; `score_schema`: \{\[`key`: `string`]: `unknown`; }; `test_criteria?`: \{ `criteria`: \{ `operator`: `"gt"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"gte"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"lt"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"lte"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"eq"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"neq"`; `type`: `"numeric"`; `value`: `number`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"between"`; `type`: `"numeric"`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"not_between"`; `type`: `"numeric"`; } | \{ `operator`: `"one_of"`; `type`: `"numeric"`; `values`: `number`\[]; } | \{ `operator`: `"not_one_of"`; `type`: `"numeric"`; `values`: `number`\[]; } | \{ `operator`: `"is_true"`; `type`: `"boolean"`; } | \{ `operator`: `"is_false"`; `type`: `"boolean"`; } | \{ `case_sensitive`: `boolean`; `operator`: `"eq"`; `type`: `"string"`; `value`: `string`; } | \{ `case_sensitive`: `boolean`; `operator`: `"neq"`; `type`: `"string"`; `value`: `string`; } | \{ `case_sensitive`: `boolean`; `operator`: `"contains"`; `type`: `"string"`; `value`: `string`; `whole_word`: `boolean`; } | \{ `case_sensitive`: `boolean`; `operator`: `"one_of"`; `type`: `"string"`; `values`: `string`\[]; } | \{ `case_sensitive`: `boolean`; `operator`: `"not_one_of"`; `type`: `"string"`; `values`: `string`\[]; } | \{ `operator`: `"gt"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"gte"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"lt"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"lte"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"eq"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"neq"`; `type`: `"categorical"`; `value`: `number`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"between"`; `type`: `"categorical"`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"not_between"`; `type`: `"categorical"`; } | \{ `operator`: `"category_eq"`; `type`: `"categorical"`; `value`: `string`; } | \{ `operator`: `"category_neq"`; `type`: `"categorical"`; `value`: `string`; } | \{ `operator`: `"category_one_of"`; `type`: `"categorical"`; `values`: `string`\[]; } | \{ `operator`: `"category_not_one_of"`; `type`: `"categorical"`; `values`: `string`\[]; }; `field`: `string`; }; }; `type`: `"python"`; } | \{ `llm`: \{ `filters`: \{ `filterArray`: `object`\[]; }; `llm_execution`: \{ `system_prompt`: `string`; }; `metadata`: \{ `description?`: `string`; }; `model`: \{ `model_name`: `string`; `model_provider`: `string`; }; `name`: `string`; `sampling`: \{ `sampling_percentage`: `number`; }; `score_schema`: \{\[`key`: `string`]: `unknown`; }; `test_criteria?`: \{ `criteria`: \{ `operator`: `"gt"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"gte"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"lt"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"lte"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"eq"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"neq"`; `type`: `"numeric"`; `value`: `number`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"between"`; `type`: `"numeric"`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"not_between"`; `type`: `"numeric"`; } | \{ `operator`: `"one_of"`; `type`: `"numeric"`; `values`: `number`\[]; } | \{ `operator`: `"not_one_of"`; `type`: `"numeric"`; `values`: `number`\[]; } | \{ `operator`: `"is_true"`; `type`: `"boolean"`; } | \{ `operator`: `"is_false"`; `type`: `"boolean"`; } | \{ `case_sensitive`: `boolean`; `operator`: `"eq"`; `type`: `"string"`; `value`: `string`; } | \{ `case_sensitive`: `boolean`; `operator`: `"neq"`; `type`: `"string"`; `value`: `string`; } | \{ `case_sensitive`: `boolean`; `operator`: `"contains"`; `type`: `"string"`; `value`: `string`; `whole_word`: `boolean`; } | \{ `case_sensitive`: `boolean`; `operator`: `"one_of"`; `type`: `"string"`; `values`: `string`\[]; } | \{ `case_sensitive`: `boolean`; `operator`: `"not_one_of"`; `type`: `"string"`; `values`: `string`\[]; } | \{ `operator`: `"gt"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"gte"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"lt"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"lte"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"eq"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"neq"`; `type`: `"categorical"`; `value`: `number`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"between"`; `type`: `"categorical"`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"not_between"`; `type`: `"categorical"`; } | \{ `operator`: `"category_eq"`; `type`: `"categorical"`; `value`: `string`; } | \{ `operator`: `"category_neq"`; `type`: `"categorical"`; `value`: `string`; } | \{ `operator`: `"category_one_of"`; `type`: `"categorical"`; `values`: `string`\[]; } | \{ `operator`: `"category_not_one_of"`; `type`: `"categorical"`; `values`: `string`\[]; }; `field`: `string`; }; }; `type`: `"llm"`; } | \{ `human`: \{ `metadata`: \{ `description?`: `string`; }; `name`: `string`; `score_schema`: \{\[`key`: `string`]: `unknown`; }; `test_criteria?`: \{ `criteria`: \{ `operator`: `"gt"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"gte"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"lt"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"lte"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"eq"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"neq"`; `type`: `"numeric"`; `value`: `number`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"between"`; `type`: `"numeric"`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"not_between"`; `type`: `"numeric"`; } | \{ `operator`: `"one_of"`; `type`: `"numeric"`; `values`: `number`\[]; } | \{ `operator`: `"not_one_of"`; `type`: `"numeric"`; `values`: `number`\[]; } | \{ `operator`: `"is_true"`; `type`: `"boolean"`; } | \{ `operator`: `"is_false"`; `type`: `"boolean"`; } | \{ `case_sensitive`: `boolean`; `operator`: `"eq"`; `type`: `"string"`; `value`: `string`; } | \{ `case_sensitive`: `boolean`; `operator`: `"neq"`; `type`: `"string"`; `value`: `string`; } | \{ `case_sensitive`: `boolean`; `operator`: `"contains"`; `type`: `"string"`; `value`: `string`; `whole_word`: `boolean`; } | \{ `case_sensitive`: `boolean`; `operator`: `"one_of"`; `type`: `"string"`; `values`: `string`\[]; } | \{ `case_sensitive`: `boolean`; `operator`: `"not_one_of"`; `type`: `"string"`; `values`: `string`\[]; } | \{ `operator`: `"gt"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"gte"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"lt"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"lte"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"eq"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"neq"`; `type`: `"categorical"`; `value`: `number`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"between"`; `type`: `"categorical"`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"not_between"`; `type`: `"categorical"`; } | \{ `operator`: `"category_eq"`; `type`: `"categorical"`; `value`: `string`; } | \{ `operator`: `"category_neq"`; `type`: `"categorical"`; `value`: `string`; } | \{ `operator`: `"category_one_of"`; `type`: `"categorical"`; `values`: `string`\[]; } | \{ `operator`: `"category_not_one_of"`; `type`: `"categorical"`; `values`: `string`\[]; }; `field`: `string`; }; }; `type`: `"human"`; }

#### Union Members

##### Type Literal

\{ `python`: \{ `code_execution`: \{ `code_snippet`: `string`; }; `filters`: \{ `filterArray`: `object`\[]; }; `metadata`: \{ `description?`: `string`; }; `name`: `string`; `sampling`: \{ `sampling_percentage`: `number`; }; `score_schema`: \{\[`key`: `string`]: `unknown`; }; `test_criteria?`: \{ `criteria`: \{ `operator`: `"gt"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"gte"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"lt"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"lte"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"eq"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"neq"`; `type`: `"numeric"`; `value`: `number`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"between"`; `type`: `"numeric"`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"not_between"`; `type`: `"numeric"`; } | \{ `operator`: `"one_of"`; `type`: `"numeric"`; `values`: `number`\[]; } | \{ `operator`: `"not_one_of"`; `type`: `"numeric"`; `values`: `number`\[]; } | \{ `operator`: `"is_true"`; `type`: `"boolean"`; } | \{ `operator`: `"is_false"`; `type`: `"boolean"`; } | \{ `case_sensitive`: `boolean`; `operator`: `"eq"`; `type`: `"string"`; `value`: `string`; } | \{ `case_sensitive`: `boolean`; `operator`: `"neq"`; `type`: `"string"`; `value`: `string`; } | \{ `case_sensitive`: `boolean`; `operator`: `"contains"`; `type`: `"string"`; `value`: `string`; `whole_word`: `boolean`; } | \{ `case_sensitive`: `boolean`; `operator`: `"one_of"`; `type`: `"string"`; `values`: `string`\[]; } | \{ `case_sensitive`: `boolean`; `operator`: `"not_one_of"`; `type`: `"string"`; `values`: `string`\[]; } | \{ `operator`: `"gt"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"gte"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"lt"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"lte"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"eq"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"neq"`; `type`: `"categorical"`; `value`: `number`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"between"`; `type`: `"categorical"`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"not_between"`; `type`: `"categorical"`; } | \{ `operator`: `"category_eq"`; `type`: `"categorical"`; `value`: `string`; } | \{ `operator`: `"category_neq"`; `type`: `"categorical"`; `value`: `string`; } | \{ `operator`: `"category_one_of"`; `type`: `"categorical"`; `values`: `string`\[]; } | \{ `operator`: `"category_not_one_of"`; `type`: `"categorical"`; `values`: `string`\[]; }; `field`: `string`; }; }; `type`: `"python"`; }

##### python

> **python**: `object`

###### python.code\_execution

> **code\_execution**: `object`

###### python.code\_execution.code\_snippet

> **code\_snippet**: `string`

###### python.filters

> **filters**: `object`

###### python.filters.filterArray

> **filterArray**: `object`\[]

###### python.metadata

> **metadata**: `object`

###### python.metadata.description?

> `optional` **description?**: `string`

###### python.name

> **name**: `string`

###### Description

Evaluator display name, independent of its immutable slug.

###### python.sampling

> **sampling**: `object`

###### python.sampling.sampling\_percentage

> **sampling\_percentage**: `number`

###### python.score\_schema

> **score\_schema**: `object`

###### Index Signature

\[`key`: `string`]: `unknown`

###### python.test\_criteria?

> `optional` **test\_criteria?**: `object`

###### python.test\_criteria.criteria

> **criteria**: \{ `operator`: `"gt"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"gte"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"lt"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"lte"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"eq"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"neq"`; `type`: `"numeric"`; `value`: `number`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"between"`; `type`: `"numeric"`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"not_between"`; `type`: `"numeric"`; } | \{ `operator`: `"one_of"`; `type`: `"numeric"`; `values`: `number`\[]; } | \{ `operator`: `"not_one_of"`; `type`: `"numeric"`; `values`: `number`\[]; } | \{ `operator`: `"is_true"`; `type`: `"boolean"`; } | \{ `operator`: `"is_false"`; `type`: `"boolean"`; } | \{ `case_sensitive`: `boolean`; `operator`: `"eq"`; `type`: `"string"`; `value`: `string`; } | \{ `case_sensitive`: `boolean`; `operator`: `"neq"`; `type`: `"string"`; `value`: `string`; } | \{ `case_sensitive`: `boolean`; `operator`: `"contains"`; `type`: `"string"`; `value`: `string`; `whole_word`: `boolean`; } | \{ `case_sensitive`: `boolean`; `operator`: `"one_of"`; `type`: `"string"`; `values`: `string`\[]; } | \{ `case_sensitive`: `boolean`; `operator`: `"not_one_of"`; `type`: `"string"`; `values`: `string`\[]; } | \{ `operator`: `"gt"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"gte"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"lt"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"lte"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"eq"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"neq"`; `type`: `"categorical"`; `value`: `number`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"between"`; `type`: `"categorical"`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"not_between"`; `type`: `"categorical"`; } | \{ `operator`: `"category_eq"`; `type`: `"categorical"`; `value`: `string`; } | \{ `operator`: `"category_neq"`; `type`: `"categorical"`; `value`: `string`; } | \{ `operator`: `"category_one_of"`; `type`: `"categorical"`; `values`: `string`\[]; } | \{ `operator`: `"category_not_one_of"`; `type`: `"categorical"`; `values`: `string`\[]; }

###### python.test\_criteria.field

> **field**: `string`

##### type

> **type**: `"python"`

###### Description

discriminator enum property added by openapi-typescript

***

##### Type Literal

\{ `llm`: \{ `filters`: \{ `filterArray`: `object`\[]; }; `llm_execution`: \{ `system_prompt`: `string`; }; `metadata`: \{ `description?`: `string`; }; `model`: \{ `model_name`: `string`; `model_provider`: `string`; }; `name`: `string`; `sampling`: \{ `sampling_percentage`: `number`; }; `score_schema`: \{\[`key`: `string`]: `unknown`; }; `test_criteria?`: \{ `criteria`: \{ `operator`: `"gt"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"gte"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"lt"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"lte"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"eq"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"neq"`; `type`: `"numeric"`; `value`: `number`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"between"`; `type`: `"numeric"`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"not_between"`; `type`: `"numeric"`; } | \{ `operator`: `"one_of"`; `type`: `"numeric"`; `values`: `number`\[]; } | \{ `operator`: `"not_one_of"`; `type`: `"numeric"`; `values`: `number`\[]; } | \{ `operator`: `"is_true"`; `type`: `"boolean"`; } | \{ `operator`: `"is_false"`; `type`: `"boolean"`; } | \{ `case_sensitive`: `boolean`; `operator`: `"eq"`; `type`: `"string"`; `value`: `string`; } | \{ `case_sensitive`: `boolean`; `operator`: `"neq"`; `type`: `"string"`; `value`: `string`; } | \{ `case_sensitive`: `boolean`; `operator`: `"contains"`; `type`: `"string"`; `value`: `string`; `whole_word`: `boolean`; } | \{ `case_sensitive`: `boolean`; `operator`: `"one_of"`; `type`: `"string"`; `values`: `string`\[]; } | \{ `case_sensitive`: `boolean`; `operator`: `"not_one_of"`; `type`: `"string"`; `values`: `string`\[]; } | \{ `operator`: `"gt"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"gte"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"lt"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"lte"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"eq"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"neq"`; `type`: `"categorical"`; `value`: `number`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"between"`; `type`: `"categorical"`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"not_between"`; `type`: `"categorical"`; } | \{ `operator`: `"category_eq"`; `type`: `"categorical"`; `value`: `string`; } | \{ `operator`: `"category_neq"`; `type`: `"categorical"`; `value`: `string`; } | \{ `operator`: `"category_one_of"`; `type`: `"categorical"`; `values`: `string`\[]; } | \{ `operator`: `"category_not_one_of"`; `type`: `"categorical"`; `values`: `string`\[]; }; `field`: `string`; }; }; `type`: `"llm"`; }

##### llm

> **llm**: `object`

###### llm.filters

> **filters**: `object`

###### llm.filters.filterArray

> **filterArray**: `object`\[]

###### llm.llm\_execution

> **llm\_execution**: `object`

###### llm.llm\_execution.system\_prompt

> **system\_prompt**: `string`

###### llm.metadata

> **metadata**: `object`

###### llm.metadata.description?

> `optional` **description?**: `string`

###### llm.model

> **model**: `object`

###### llm.model.model\_name

> **model\_name**: `string`

###### llm.model.model\_provider

> **model\_provider**: `string`

###### llm.name

> **name**: `string`

###### Description

Evaluator display name, independent of its immutable slug.

###### llm.sampling

> **sampling**: `object`

###### llm.sampling.sampling\_percentage

> **sampling\_percentage**: `number`

###### llm.score\_schema

> **score\_schema**: `object`

###### Index Signature

\[`key`: `string`]: `unknown`

###### llm.test\_criteria?

> `optional` **test\_criteria?**: `object`

###### llm.test\_criteria.criteria

> **criteria**: \{ `operator`: `"gt"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"gte"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"lt"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"lte"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"eq"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"neq"`; `type`: `"numeric"`; `value`: `number`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"between"`; `type`: `"numeric"`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"not_between"`; `type`: `"numeric"`; } | \{ `operator`: `"one_of"`; `type`: `"numeric"`; `values`: `number`\[]; } | \{ `operator`: `"not_one_of"`; `type`: `"numeric"`; `values`: `number`\[]; } | \{ `operator`: `"is_true"`; `type`: `"boolean"`; } | \{ `operator`: `"is_false"`; `type`: `"boolean"`; } | \{ `case_sensitive`: `boolean`; `operator`: `"eq"`; `type`: `"string"`; `value`: `string`; } | \{ `case_sensitive`: `boolean`; `operator`: `"neq"`; `type`: `"string"`; `value`: `string`; } | \{ `case_sensitive`: `boolean`; `operator`: `"contains"`; `type`: `"string"`; `value`: `string`; `whole_word`: `boolean`; } | \{ `case_sensitive`: `boolean`; `operator`: `"one_of"`; `type`: `"string"`; `values`: `string`\[]; } | \{ `case_sensitive`: `boolean`; `operator`: `"not_one_of"`; `type`: `"string"`; `values`: `string`\[]; } | \{ `operator`: `"gt"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"gte"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"lt"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"lte"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"eq"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"neq"`; `type`: `"categorical"`; `value`: `number`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"between"`; `type`: `"categorical"`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"not_between"`; `type`: `"categorical"`; } | \{ `operator`: `"category_eq"`; `type`: `"categorical"`; `value`: `string`; } | \{ `operator`: `"category_neq"`; `type`: `"categorical"`; `value`: `string`; } | \{ `operator`: `"category_one_of"`; `type`: `"categorical"`; `values`: `string`\[]; } | \{ `operator`: `"category_not_one_of"`; `type`: `"categorical"`; `values`: `string`\[]; }

###### llm.test\_criteria.field

> **field**: `string`

##### type

> **type**: `"llm"`

###### Description

discriminator enum property added by openapi-typescript

***

##### Type Literal

\{ `human`: \{ `metadata`: \{ `description?`: `string`; }; `name`: `string`; `score_schema`: \{\[`key`: `string`]: `unknown`; }; `test_criteria?`: \{ `criteria`: \{ `operator`: `"gt"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"gte"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"lt"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"lte"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"eq"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"neq"`; `type`: `"numeric"`; `value`: `number`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"between"`; `type`: `"numeric"`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"not_between"`; `type`: `"numeric"`; } | \{ `operator`: `"one_of"`; `type`: `"numeric"`; `values`: `number`\[]; } | \{ `operator`: `"not_one_of"`; `type`: `"numeric"`; `values`: `number`\[]; } | \{ `operator`: `"is_true"`; `type`: `"boolean"`; } | \{ `operator`: `"is_false"`; `type`: `"boolean"`; } | \{ `case_sensitive`: `boolean`; `operator`: `"eq"`; `type`: `"string"`; `value`: `string`; } | \{ `case_sensitive`: `boolean`; `operator`: `"neq"`; `type`: `"string"`; `value`: `string`; } | \{ `case_sensitive`: `boolean`; `operator`: `"contains"`; `type`: `"string"`; `value`: `string`; `whole_word`: `boolean`; } | \{ `case_sensitive`: `boolean`; `operator`: `"one_of"`; `type`: `"string"`; `values`: `string`\[]; } | \{ `case_sensitive`: `boolean`; `operator`: `"not_one_of"`; `type`: `"string"`; `values`: `string`\[]; } | \{ `operator`: `"gt"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"gte"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"lt"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"lte"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"eq"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"neq"`; `type`: `"categorical"`; `value`: `number`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"between"`; `type`: `"categorical"`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"not_between"`; `type`: `"categorical"`; } | \{ `operator`: `"category_eq"`; `type`: `"categorical"`; `value`: `string`; } | \{ `operator`: `"category_neq"`; `type`: `"categorical"`; `value`: `string`; } | \{ `operator`: `"category_one_of"`; `type`: `"categorical"`; `values`: `string`\[]; } | \{ `operator`: `"category_not_one_of"`; `type`: `"categorical"`; `values`: `string`\[]; }; `field`: `string`; }; }; `type`: `"human"`; }

##### human

> **human**: `object`

###### human.metadata

> **metadata**: `object`

###### human.metadata.description?

> `optional` **description?**: `string`

###### human.name

> **name**: `string`

###### Description

Evaluator display name, independent of its immutable slug.

###### human.score\_schema

> **score\_schema**: `object`

###### Index Signature

\[`key`: `string`]: `unknown`

###### human.test\_criteria?

> `optional` **test\_criteria?**: `object`

###### human.test\_criteria.criteria

> **criteria**: \{ `operator`: `"gt"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"gte"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"lt"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"lte"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"eq"`; `type`: `"numeric"`; `value`: `number`; } | \{ `operator`: `"neq"`; `type`: `"numeric"`; `value`: `number`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"between"`; `type`: `"numeric"`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"not_between"`; `type`: `"numeric"`; } | \{ `operator`: `"one_of"`; `type`: `"numeric"`; `values`: `number`\[]; } | \{ `operator`: `"not_one_of"`; `type`: `"numeric"`; `values`: `number`\[]; } | \{ `operator`: `"is_true"`; `type`: `"boolean"`; } | \{ `operator`: `"is_false"`; `type`: `"boolean"`; } | \{ `case_sensitive`: `boolean`; `operator`: `"eq"`; `type`: `"string"`; `value`: `string`; } | \{ `case_sensitive`: `boolean`; `operator`: `"neq"`; `type`: `"string"`; `value`: `string`; } | \{ `case_sensitive`: `boolean`; `operator`: `"contains"`; `type`: `"string"`; `value`: `string`; `whole_word`: `boolean`; } | \{ `case_sensitive`: `boolean`; `operator`: `"one_of"`; `type`: `"string"`; `values`: `string`\[]; } | \{ `case_sensitive`: `boolean`; `operator`: `"not_one_of"`; `type`: `"string"`; `values`: `string`\[]; } | \{ `operator`: `"gt"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"gte"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"lt"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"lte"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"eq"`; `type`: `"categorical"`; `value`: `number`; } | \{ `operator`: `"neq"`; `type`: `"categorical"`; `value`: `number`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"between"`; `type`: `"categorical"`; } | \{ `max`: `number`; `min`: `number`; `operator`: `"not_between"`; `type`: `"categorical"`; } | \{ `operator`: `"category_eq"`; `type`: `"categorical"`; `value`: `string`; } | \{ `operator`: `"category_neq"`; `type`: `"categorical"`; `value`: `string`; } | \{ `operator`: `"category_one_of"`; `type`: `"categorical"`; `values`: `string`\[]; } | \{ `operator`: `"category_not_one_of"`; `type`: `"categorical"`; `values`: `string`\[]; }

###### human.test\_criteria.field

> **field**: `string`

##### type

> **type**: `"human"`

###### Description

discriminator enum property added by openapi-typescript

***

### message?

> `optional` **message?**: `string`

#### Description

Message for the initial version; defaults to an empty string.

***

### project\_id

> **project\_id**: `string`

#### Description

Project that owns the evaluator; must be within the API key root scope.

***

### publish?

> `optional` **publish?**: `boolean`

#### Description

Publish the saved version atomically. Requires project.evaluator.publish in addition to the operation permission.

#### Default

```ts theme={null}
false
```

***

### slug

> **slug**: `string`

#### Description

Immutable, case-sensitive project-unique slug containing 1–64 ASCII letters, digits, underscores or hyphens. Must not be a valid ULID, regardless of case. Cannot change after creation.


## Related topics

- [Evaluators Methods](https://docs.honeyhive.ai/v2/sdk-reference/typescript/ref/evaluators/index.md)
- [Clients](https://docs.honeyhive.ai/v2/changelog/clients.md)
- [CreateRunRequest](https://docs.honeyhive.ai/v2/sdk-reference/typescript/ref/experiments/CreateRunRequest.md)


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.