HG8011 Annotation - Quick Start Guide

(Please refer to the main assignment page for details or clarification)

Last Updated: 19-02-2018

Questions? Drop an email to both bond (+ @ieee.org) and depa0003 (+ @e.ntu.edu.sg)

  1. Getting Started
  2. Annotation

1) Getting Started

  1. Go to the main HG8011 course page
  2. Go to Disambiguation Task (not "Project 1"!)
  3. You will be at the task page.
    Scroll down slightly and you will see a list of names. Look for your name.
  4. Click on Start Here beside your name
  5. You will be asked to log in. Click on the "house" ⌂ icon (see image below)
  6. At the login screen:

    Your username is indicated in the task page (in the format "s1", "s2", etc, etc)
    Your password is Watson (capital "W"). Please change it ASAP!*
    * But please, don't change it to something like Holmes...
  7. After logging in, you will be at the dashboard. To change password, click on User Preferences

  8. To change your password: Click on User Preferences. You will see the Change Password screen.

    Use this to change your password.
  9. Go back to the Disambiguation Task page, and click once more on "Start Here" beside your name.

2) Annotation

2.1 - General

  1. After you clicked "Start Here" beside your name, you will see the main annotation interface:

    The interface is split into two panels:
  2. On the annotation half of the screen (left panel):
  3. On the synset half of the screen (right panel):
  4. You will be presented with at least one tagging bar for the word. The numbered choices on the tagging bar correspond to the numbered choices for the synsets, as illustrated below:
  5. To tag, simply select the appropriate synset via the tagging toolbar. (What do the numbers and letters mean?)

    Your choice will be automatically saved once selected. A notification message will appear at the bottom to indicate it has been saved.

    (In the above image, I have selected "1a" as the synset used to tag the word.)
  6. Repeat the above step for all other words, until you have finished tagging your assigned sentences.
  7. If it is a multi-word expression (MWE), you might be presented with multiple choices (multiple tagging bars):
  8. If the word...

2.2 - What do the numbers and letters mean? (↑ Back)

In the tagging bar, you will see some letters as well as a series of numbers (if any). The table below explains what they are:
1, 2, 3...nThese numbered choices correspond to the numbers of the synsets shown in the right panel.
The letters in subscript (Eg: 1a, 2n) are the parts of speech
eUsed to indicate an error in corpus/text (spelling, lemmatization, tokenization, etc)
Eg: does being mistakenly analysed as doe+s and not do+es in "He does not know"

Refer to the Detailed Documentation for more cases to use 'e'
xUsed to indicate that there is no need to tag the word
Examples include closed class parts-of-speech, such as auxiliaries (Fred is swimming; Fred has swum)
(Note: Copula is (to be) and verb has (to have) should still be tagged)

Refer to the Detailed Documentation for more cases to use 'x'
wUsed to indicate suggestions or changes to the wordnet. These include suggestions to add/remove lemmas, or to add a new synset.
You can also write other comments such as "I can't really decide between 012345678-x and 012345678-y"

Refer to the Detailed Documentation for more cases to use 'w'
↓ For names (or part of a name), use the tags below ↓
Note: If the name already exists in the Wordnet as a synset (such as "Holmes"), choose that synset instead.
Eg: Scotland Yard
(Note: Tag both Scotland and Yard individually as org)
Eg: Riding Thorpe Manor; Norfolk
(Note: Tag Riding, Thorpe and Manor individually as loc)
Eg: Irene; Irene Adler
(Note: Tag both Irene and Adler individually as per)
OthAny Other proper name
Samsung Galaxy S5
(Note: Tag Samsung, Galaxy and S5 individually as oth)
↓ For other types, use the tags below ↓
Eg: 3:13am; 26/01/1788
Eg: 12756; 1138; 802701
(Note: If the number already has a synset, tag it with that synset instead)
1984; 2016
(Note: Be sure this is not just a normal Number)

2.3 - What if there is no (appropriate) synset to select? (↑ Back)

In some cases, a word might not have any (or any appropriate) sense/synset to select in the right panel.

This can mean a few things: In such a case, tag the word as 'w'.

Now, begin by assuming the word (and its lemma) is not in a synset, but the concept of it exists somewhere in the wordnet.

You should then try the following:

» Refer to the Detailed Documentation for more on what to write in the Comments box

Ok, you tried the above, but still nothing turns up.

It could thus be that the concept does not exist at all in the wordnet. In this case, you can suggest a new synset. Sometimes, it could mean the base form was mis-identified (Eg: mis-identifying the base form of verb leaves as leaf, instead of leave)
Note down in the Comments box for such cases.
Questions? Drop an email to both bond (+ @ieee.org) and depa0003 (+ @e.ntu.edu.sg)