An app is implemented.
Ecosystem link: https://ecosystem.supervise.ly/apps/labeler-first-time-through
Github link: https://github.com/supervisely-ecosystem/labeler-first-time-through
First Time True (FTT) metric (in percentage) shows how many items labeler annotated right the first time (i.e. reviewer accepted his work on first round). This metric helps to find accurate labelers (i.e. reviewers accepts many of their annotations).
Application shows the table of all labeling jobs in the team that were assigned to specific member and calculates FTT metric for every job (last column). Also it produces average FTT for all non-zero values.