Results

This page consists of tabulated study results of non-experts session. Note that we exclude the participants that do not give consistent answers to over 75% of the questions, and we also exclude all inconsistent answers. Please find details in the paper.

Per-participant consistency

This page visualizes per-participant consistency. X axis is the index of participants, and Y axis is the fraction of answers that are consistent for each participant. All participants are ranked according to consistency. (Tabulated results can be found at results.)

Per-question consistency from reliable participants

This page visualizes per-question consistency for participants that present consistency for over 75% of the questions, who are considered as reliable participants. One question takes one line, and the blue part means the fraction of the participants that are consistent on it, and the red part means the fraction of the participants that are inconsistent. The questions are ranked according to consistency. (Tabulated results can be found at results).

Per-question consistency from all participants

This page visualizes per-question consistency for all participants. One question takes one line, and the blue part means the fraction of the participants that are consistent on it, and the red part means the fraction of the participants that are inconsistent. The questions are ranked according to consistency. (Tabulated results can be found at results).