<h4>This is a simple website using <strong> Best-Worst-Scaling</strong></a> for items evaluation. </h4>
<h4>This is a simple website using <ahref="https://saifmohammad.com/WebPages/BestWorst.html"target="_blank"rel="noopener noreferrer"style="text-decoration-line: underline; text-decoration-style: dotted; color: darkgreen;"><strong> Best-Worst-Scaling</strong></a> for evaluating items. </h4>
<hr>
<ul>
<li>If you come here as a user who wants to get your datas through this method evaluated, click on <strong> User</strong>-Button! </li>
<li> If you are an annotator who wants to submit the annotation for a given project, click on <strong> Annotator</strong>-Button!</li>
</ul>
<ahref="https://saifmohammad.com/WebPages/bwsVrs.html"> More about Best-Worst-Scaling</a>
<li><pclass="mb-0"> You can get your results including a file with scores for each item and a report about the whole annotation process at any time as long as the process starts. </p></li>
{% if mturk %}
<li><p> Click on <strong>Mechanical Turk</strong>-Button and type the project name in search box to find your uploaded project on Mechanical Turk </p></li>
<li><pclass="mb-0"> Click on <strong>Mechanical Turk</strong>-Button and type the project name in search box to find your uploaded project on Mechanical Turk </p></li>
{% else %}
<li><pclass="mb-0"> Click on <strong>Keywords</strong>-Button to get the access keywords for annotators to your data survey. </p></li>
<h2class="alert-heading"><b> New project </b></h2>
<hr>
<ul>
<li>You can upload your project here. You must fill in all fields (<b>project name </b> is optional). 'best' and 'worst' must not have the same definitions, or you can't submit your project.</li>
<li>You can upload your project here. You must fill in all fields (<em>project name </em> is optional). <b>best</b> and <b>worst</b> must not have the same definitions, or you can't submit your project.</li>
<li> Every uploaded file must have the format, in which each line contains only one item!. You'd better give each of your project a unique name!</li>
</ul>
<hr>
You have 2 options to have annotators:
<ul>
<li><strong>Option 1 </strong>: Local annotator system - you will get the number of keywords corresponding to the number of annotators you require. Who annotate your project is of your choice, give each of them a keyword so that they can finish the annotations!</li>
<li><strong>Option 1 </strong>: Local annotator system - you will get the number of keywords corresponding to the number of annotators you require. Who annotate your project is of your choice, give each of them a keyword and redirect them to our <ahref="{{url_for('start')}}"style="color: darkgreen; text-decoration-line: underline; text-decoration-style: dotted;"> homepage </a>so that they can finish the annotations!</li>
<li><strong>Option 2 </strong>: Mechanical Turk - your annotations will be done on this platform with anonymous annotators.</li>
<labelclass="custom-control-label"data-toggle="tooltip"title="Mechanical Turk is an Amazon crowdsourcing platform"for="defaultChecked2">Mechanical Turk (<ahref="https://www.mturk.com/">read more</a>)</label> {{wtf.form_field(form.mturk)}} <ahref=""data-toggle="tooltip"title="if you choose this option, you must change the default values of the forms below"style="position: absolute; left: 70%; bottom: 15%">(Hint)</a>
<labelclass="custom-control-label"data-toggle="tooltip"title="Mechanical Turk is an Amazon crowdsourcing platform"for="defaultChecked2">Mechanical Turk (<ahref="https://www.mturk.com/"target="_blank"rel="noopener noreferrer">read more</a>)</label> {{wtf.form_field(form.mturk)}}
<spanhref=""data-toggle="tooltip"title="If you choose this option, you must change the default values of the forms below"style="position: absolute; left: 48%; bottom: 10%; color: darkgreen;"class="glyphicon glyphicon-info-sign"style="size: 100pt"/>
<ahref="https://docs.aws.amazon.com/IAM/latest/UserGuide/id_credentials_access-keys.html"data-toggle="tooltip"title="Click here to get information how to get your IAM AWS data"target="_blank"rel="noopener noreferrer"style="position: absolute; left: 30%; bottom: 73%; color: darkgreen;"><spanclass="glyphicon glyphicon-info-sign"></span></a>
<spanhref=""data-toggle="tooltip"title="How much will you pay an annotator (in $) for annotating each HIT?"style="position: absolute; bottom: 73%; left: 70%; color: darkgreen;"class="glyphicon glyphicon-info-sign"/></a>
<pclass="input-hint"style="position: absolute; bottom: 60%; left: 55%"><ahref=""data-toggle="tooltip"title="How long does this project stay available on Mechanical Turk? Accept only e.g. 1, 2, ... (no 1.5)">(Hint)</a></p>
<spanhref=""data-toggle="tooltip"title="How long does this project stay available on Mechanical Turk? Accept only e.g. 1, 2, ... (no 1.5)"style="position: absolute; bottom: 73%; left: 55%; color: darkgreen;"class="glyphicon glyphicon-info-sign"/>
<pclass="input-hint"style="position: absolute; bottom: 60%; left: 50%"><ahref=""data-toggle="tooltip"title="How much time does each annotator have for annotating a HIT if he accepts it? Accept only e.g. 1, 2, ... (no 1.5)">(Hint)</a></p>
<spanhref=""data-toggle="tooltip"title="How much time does each annotator have for annotating a HIT if he accepts it? Accept only e.g. 1, 2, ... (no 1.5)"style="position: absolute; bottom: 73%; left: 50%; color: darkgreen;"class="glyphicon glyphicon-info-sign"/>