Exampleset

An Exampleset is a collection of Examples that should be annotated together.

LightTags fundamental unit of work is the Task which is the annotation of examples in an Exampleset with a Schema Examplesets are a concept internal to LightTag that are visible to the user in two places.

Examplesets during Annotation

First, during the annotation project, if an aggregation key has been defined on the Dataset, then the combined examples are considered an Exampleset.

An exampleset with three examples

An Exampleset with three examples

In the picture above, the annotator is shown three examples at the same time. The three examples together came from
the same Dataset and were grouped together because they share the same Aggregation Key.

Examplesets in Analytics

The second place you’ll encounter Examplesets is in the Analytics sections. Since the annotator works through Examplesets, you’ll want to measure progress in terms of Examplesets and not just in terms of Examples.

Metrics on examples and Exampleset(task)

The underlined metrics correspond to individual examples as well as “Tasks”/ which are the annotation of an Exampleset

In the image above, we can see that there are 809 Examples to be annotated, but they are broken down into 295 Tasks e.g. Examplesets