Download Penn Treebank Tagset Here are the most important tags. See also

Penn Treebank Tagset
Here are the most important tags. See also:
M. Marcus, Beatrice Santorini and M.A. Marcinkiewicz: Building a large annotated corpus of
English: The Penn Treebank. In Computational Linguistics, volume 19, number 2, pp313-330.
POS Tag
Description
CC
coordinating conjunction
CD
cardinal number
DT
determiner
Example
and
1, third
the
EX
FW
existential there
foreign word
there is
d'hoevre
IN
JJ
JJR
JJS
LS
MD
NN
NNS
preposition/subordinating conjunction
adjective
adjective, comparative
adjective, superlative
list marker
modal
noun, singular or mass
noun plural
in, of, like
green
greener
greenest
1)
could, will
table
tables
NNP
NNPS
PDT
POS
PRP
PRP$
RB
RBR
RBS
proper noun, singular
proper noun, plural
predeterminer
possessive ending
personal pronoun
possessive pronoun
adverb
adverb, comparative
adverb, superlative
John
Vikings
both the boys
friend's
I, he, it
my, his
however, usually, naturally, here, good
better
best
RP
TO
UH
VB
VBD
VBG
VBN
particle
to
interjection
verb, base form
verb, past tense
verb, gerund/present participle
verb, past participle
give up
to go, to him
uhhuhhuhh
take
took
taking
taken
VBP
VBZ
WDT
WP
WP$
WRB
verb, sing. present, non-3d
verb, 3rd person sing. present
wh-determiner
wh-pronoun
possessive wh-pronoun
wh-abverb
take
takes
which
who, what
whose
where, when
Download the original attachment
Tag Set for Indian Languages (decided 1st July 2006, at IIIT Hyderabad)
Sl
No.
1.1
1.2
2.
3.1.
3.2
4.
5
6.
7.1
7.2
8.
9.
10
11
12
13
14.1
14.2
14.3
14.4
15
16
Category
Tag
name
Noun
NN
NLoc
NST
Proper Noun NNP
Pronoun
PRP
Demonstrative DEM
Verb-finite
VF
Verb-nonfinite VNF
Verb Aux
VAUX
Gerund
VNN
Infinitive
VINF
Adjective
JJ
Adverb
RB
Post position PSP
Particles
RP
Conjuncts
CC
Question
WQ
Words
Quantifiers
QF
Cardinal
QC
Ordinal
QO
Classifier
CL
Intensifier
INTF
Interjection
INJ
Example
*vAlA also
*Only manner adverb
bhI, to, hI, jI, hA.N, na,
bole (Bangla)
bahut, tho.DA, kam (Hindi)
17
18
19
Negation
Sym
Quotative
NEG
SYM
UT
20
Compounds
*C
ani (Telugu), endru (Tamil), bole/mAne
(Bangla), mhaNaje (Marathi), mAne
(Hindi)
It was decided that for foreign/unknown words that the POS tagger may give a tag ”UNK”
Download the original attachment
Mapping existing IL tagsets to MSRI tagset
In this exercise we consider several IL tagsets and map them to the MSRI tagset. The following
tagsets are considered




IIIT-H tagset for Indian language – 26 tags
AU-KBC tagset for Tamil – 68 tags
IIT-Kharagpur tagset for Hindi – 43 tags
IIT-Kharagpur tagset for Bangla – 40 tags
Though the IIIT-H tagset is common for Indian languages, we provide examples only from Hindi
mostly taken from the tagset document.
IIIT-H tagset
Tag
Description
Example(s)
NN
Noun
NNP
Proper Noun
PRP
Pronoun
JJ
Adjective
RB
Adverb
RP
CC
UH
SYM
Particle
Conjunct
Interjection
Symbols
laDaZkA (boy), nadI
(river)
rAma (Ram), manamoHan
(Manmohan)
vaha (he), jisane (by
whom), jo (who)
sundara (beautiful), acchA
(good)
dhIre (slowly), tejI (fast)
se/RP
taka (till), to (if)
Ora (and), yA (or), ki (that)
HAM (yes)
., $, +, ?
Intermediate
Tag
N(1|3|4)
N2
PR
JJ
RB
RP
RP(1|2)
RP5
PU|RD
PREP
QF
Postpositions
Quantifier
ne (by), ke liye (for)
jyAdA (more), thoDA
(little), saba (all), kama
(much)
tIsarA (third), tIna (three)
QFNUM/ Number quantifier
QFN
VFM
Verb finite main (finite vaHa pItA/VFM HE (he
info is attached to the drinks)
main verb)
vaHa laDaZkA HE/VFM
(he is a boy)
VAUX
Verb auxiliary
khA cukA/VAUX
HE/VAUX (has eaten)
†
VJJ
Verb non-finite
khAte/VJJ Hue/VAUX
adjectival
(eating)
†
Verb non-finite
adverbial
VNN †
Verb non-finite
nominal
VRB
QW
Question word
NLOC
Noun location
INTF
Intensifier
NEG
NNC
Negative
Compound noun
NNPC
Compound proper
noun
NVB 1
verb from noun
PP
QT1
QT(2|3)
V1
V2
V4 (for IA)
PL2 (For Dra)
V4 (for IA)
khAkara pIte/VRB
Hue/VAUX (drinking after
eating)
PL3 (For Dra)
pInA (drinking)
N4 (for IA)
kyA (what), kEsA (how)
PL4 (For Dra)
PR6
RB103
upara (above), Age (front), N5
pahele (before_time), bAda
(big)
baHuta/INTF jyAdA/QF
JJ
(too much), Ora/INTF
jyAdA/QF (much more)
nA (no), naHIM (not)
RP001
kendra/NNC sarakAra/NN N1
(central government)
aTala/NNPC
N2
biHArI/NNPC
vAjapayI/NNP (Atal Bihari
Vajpayee)
snAna/NVB karatA/VFM N
HE/VAUX (bathing)
snAna/NVB karake/VRB
(after bathing)
JVB *
RBVB *
verb from adjective
verb from adverb
lAla/JVB HotA/VAUX
hE/VAUX (reddened)
JJ
pUrA/JVB Hokara/VRB
(after completion)
jarUra/RBVB HotA/VFM RB
HE/VAUX (happens
surely)
AU-KBC tagset for Tamil
Tag
Description
Example(s)
N.Sg
N.Pl
Noun singular
Noun plural
Pr.Sg
Pr.Obl.Sg
Pronoun singular
Pronoun oblique
form
Pronoun plural
Pronoun plural
oblique
#Euphonic
increment
Accusative
maram (tree)
marafkalY (trees),
pUkkalY (flowers)
avanY (he), nAnY (me)
eVnY (mine)
Pro.Pl
Pro.Obl.Pl
Eu
Acc
Dat
Inst
Soc
Loc
Abl
Dative
Instrumental
Sociative
Locative
Ablative
avarkalY (they)
eVfkalY (ours), ufkalY
(yours)
pacuvinY (of the cow)
Intermediate
Tag
N(1|3)01
N(1|3)02
PR1{0}1
PR1{0}102
PR1{0}2
PR1{0}202
avanYE (him accusative) {N000}2
avanYukku (to)
{PR0000}2
{N000}4
cAviyAl (by the key)
{PR0000}4
{N000}3
avanYotu (with him),
avanYutanY (with him)
{PR0000}3
{N000}6
pUfkAvil (in the park)
{PR0000}6
{N000}7
urilirunwu (from my
{PR0000}7
{N000}8
city/town)
Ben
Benefactive
Gen
Genitive
Voc
Vocative
Cl
V
VT
VI
VC
Inf
Neg
V.Pl
Pl.Neg
Imp
Pre
Pst
Fut
1S
Clitics
Verb
Transitive Verb
Intransitive Verb
Causative
Infinitive
Singular Negative
(imperative)
Plural Imperative
Plural Negative
(imperative)
Imperative +
Suffixes
Present Tense
avalYukkAka (for her)
{PR0000}8
{N000}9
{PR0000}9
{N000}5
pacuvinY (of the cow),
rAmanYutEya (of
Raman), avanYawu (his) {PR0000}5
{N000}10
thaan (only)
pati (read)
wiruppu (turn sth)
wirumpu (turn)
werivi (inform)
ceyya (to do)
ceyAwe ((you) don’t do)
{PR0000}10
RP
V101
V
V
V1
V300000
V101001
ceyyufkalY ((you) do –
V102
hon or plu)
ceyyAwIrkalY ((you) don’t V102001
do – hon or plu)
...vAta, (ceyy)ammA
-patikkirYAnY (reading)
{V(1|2)000}2
Past Tense
patikkirYavanY (one who {PL(2|4)0000}2
is reading)
patiwwAnY (read)
{V(1|2)000}1
Future Tense
patiwwavanY (one who is {PL(2|4)0000}1
read)
patippAnY (will read)
{V(1|2)000}3
First Person
Singular
patippavanY (one who
will be reading)
patikkirYenY (I am
reading)
{PL(2|4)0000}3
{V(1|2)0}11
{PR10}11
1Pl
ndAnY (I)
First Person Plural patiwwom (we were
{V(1|2)0}21
reading)
{PR10}21
2S
2Pl
3MS
Second Person
Singular
ndAfkalY (we)
patiwwAy (you will read) {V(1|2)0}12
ndii (you)
{PR10}12
Second Person
patikkirYiirkalY
{V(1|2)0}22
Plural/Honorific
(you_pl./hon. are reading)
{PR10}22
ndiir (you_hon.),
ndiifkalY (you_pl.)
Third Person
patippAnY
{V(1|2)1}13
Masculine Singular (someone_masc. will be
reading)
{PR11}13
avanY (he)
3FS
Third Person
patippAlY (someone_fem. {V(1|2)2}13
Feminine Singular will be reading)
{PR12}13
avalY (she)
3HS
Third Person
patippAr (someone_hon. {V(1|2)0}43
Honorific Singular will be reading)
{PR10}43
avar (he_hon.)
3HPl
Third Person
patippArkalY (they will be {V(1|2)0}23
Honorific Plural
reading)
{PR10}24
avarkalY (he_hon. or
they)
3NS
Third Person
patikkum (it_neu. will be {V(1|2)3}13
Singular Neuter
reading)
(non-human)
{PR13}13
awu (it)
3NPL
Third Person
patikkum (they_neu. will {V(1|2)3}23
Plural Neuter (non- be reading)
human)
{PR13}23
avE (they_neu.)
3NfutNeg Third Person
vitAwu ((it/they) won’t) {V(1|2)}30331
Neuter Future
Negative
HumFutNeg Future Negative
mAttenY ((I) won’t)
{V(1|2)}(1|2)0031
Human
NfutNeg
Present/Past
varavillE (didn’t come) {V(1|2)300}(1|2)1
Negative (non-
Opt
Vbp
Vbp Neg
Cnd
Cnd Neg
AdjP
AdjPFut
AdjPNeg
VbnUnt
Vbn
VbnNeg
PplN
AdjN
Sel
Ord
Rep
Cmp
Aux
Cnj
Adj
Adv
future)
Optative
Verbal Participle
Positive
Verbal Participle
Negative
Conditional
Positive
Conditional
Negative
Adjectival
Participle
Present/Past
Adjectival
Participle Future
Adjectival
Participle Negative
Verbal Noun
Untensed
Verbal Noun
Tensed Positive
Verbal Noun
Tensed Negative
Participial Noun
vAlYYka (long live)
ceVywu (done)
RP(4)
PL3000000
ceVyyAmal (not done)
PL3000001
ceVywAl (if done)
V400000
ceVyyAvittAl (if not done) V400001
ceVywa (do pre/pst sth), PL20000(1|2)0
ceVykirYa (do pre/pst sth)
ceVyyum (do future sth)
PL2000030
ceVyAwa (don’t do sth)
PL2000001
ceVyyal (doing), ceVywal N4
(doing), patikkal
(reading), patiwwal
(reading), ceVykai
(doing), patikkai (reading)
ceVywawu (have done)
PL40000{1|2|3}0
ceVyAwawu (have not
done)
ceVywavanY (one who
did)
nallavanY (good man)
avanYAvawu (at least
him)
muwalAvawu (first)
Adjectival Noun
Selective
(Concessive)
Ordinal Suffix
Reportative Suffix
Complementizer eVnRu (that)
Auxiliary
koVlY - takes the meaning
of main verb
Conjuncts
eVnave (so), marYrYum
(and)
Adjectives
alYYakAnYa (beautiful –
with adj suffix)
Adverbs
alYYakAka (beautiful –
PL40000{1|2|3}1
PL4
N3
-{QT3}suf
-RP(2)
V2
RP(1|2)
JJ
RB
PSP
Postpositions
Q
Quantifiers
Det
INT
Determiners
Wh Words
UNK
Unknown
with adv suffix)
meel (above), kIlYY
N1000001
(below)
oVnYrYu (one), cila (few), QT(1|2|3)
koFcam (some)
anwa (that), inwa (this)
DM
eVnYnYa (what), eVvai
PR6
(which), eVppati (how)
DM3
RD
IIT-Kgp Tagset for Hindi
Tag
NN{G.N.F}
NP{G.N.F}
NV{G.N.F}
PC{N.P.I}
PQ{G.N.I}
PT{F}
PS{F}
PC{C.F}
PO{N.F}
RPP{N.I}
RPT{F}
RPS{F}
PPP{G,N}
Description2
Example(s)
Intermediate
Tag
Noun
laDaZkA (boy), nadI (river) N1
Proper noun
rAma (Ram), manamoHan N2
(Manmohan)
Verbal noun
pAne (get), karanA (do)
N4
Personal pronoun thumHArA (your), Hama
PR(1|2)
(we)
Question markers kyA (what), kEsA (how)
PR6
pronoun
Temporal
Aja (today), kala
PR10000001
pronoun
(yesterday/ tomorrow)
N1000001
Spatial pronoun yaHAM (here), dUra
PR10000001
(distance)
N1000001
Cardinal pronoun eka (one)
QT2
Ordinal pronoun kuch (few), sabhI (all)
QT3
Relative personal jo, jise
PR5
pronoun
Relative temporal jaba
PR50000001
pronoun
Relative spatial jaHAM
PR50000001
pronoun
Postpositions
kA, ke, kI
PP
possessive
PPI
JJ{D.G.N}
JQC{C}
JQH{R}
JQQ
JF
markers
Postpositions
inflectional
markers
Non-quantifying
Adjective
Cardinal
adjectives
Hedged
expressions
adjectives
Quantifier
adjectives
Following
adjectives
AVB
Verbal adverb
(adverbial
participle)
ADV{D}
Avyaya adverb
VGT{T.G.N} Gx & Tx forms
verb
VR
Root verb
VK
Kx form verb
se, paHale, me.N, ke
PP
baDA, lAla, sundara
JJ
eka, do
QT2
eka-do, pAMcha-dasa, eka- QT2
Adha
bahuta, kAfi
QT1
merA, inakI
PR(1|2)
Adjectives following the
qualifying noun
pIte (drinking), khAte
(eating)
QT1
V4
acchA (good), tejI (fast)
RB
karatA (doing), khAyegA
(will eat)
bola (speak), gharajA (roar)
khAkara (after eating),
pahanke ()
baHA (), tAnI ()
banAo (make), do (wash)
VYA{G.N} A form verb
VIS{P.N.T.G} Imperative/
Subjunctive verbs
VH{G.N}
hai
All forms of hai
V1
VT{G.N}
V2
V1
thA
All forms of thA
V2
VM{T.G.N}
VA{A.G.N}
DTR
Modal verb
Aspect marker
Relative
determiner
saktA (can), letA ()
raHA (), chukA ()
koi (any), kisI (any), saba
(all)
When used before other
nouns, pronouns without
DM2
DTA
QUA{G.N}
Absolute
determiner
Qualifier
referring to any
person/entity
usa (that), vaha (that
he/she), isI (this)
bahuta (many), thoDA
(few)
Conjunction
CND
EMP
Conditional
Particle
emphasizer
Particle negative na (no), nahI,n (not), mata
(don’t)
Cardinal number 15, eka
Ityadi
Adi, ityadi (etc.)– words of
continuation or ellipsis
Interjection
Aya, hAya, vAha
Sentinel
Punctuation marks as ., ;, ,
etc.
Symbol
$, @, +
Foreign word
Propernouns of foreign
words are marked NP
NUM{C}
ETC
INT
SEN
SYM
FW
QT1
Those qualifying adjectives
& adverbs
aur (and), yA (or), para
RP(1|2)
(but)
agara-to-nahIN, yadi-to
bhI (also), hI (only)
RP6
CNJ
NEG
DM1
RP001
QT2
RP6
RP4
PU
RD
RD
Attributes legend
The attributes along with their symbol are listed below. It should be noted that the symbols are
not unique; for example the symbol ‘U’ is used for unspecified attributes of both Gender and
Number. However, the attributes are marked in fixed positions in the tag after the lexical
category and hence are unambiguous. They are in no particular order.
(G) Gender
M – Masculine
F – Feminine
N – Neuter (In Hindi this is not present)
A – Anything (i.e. can be either M, F or N)
U – Unspecified or irrelevant in the current context.
X – Unknown (to the tagger)
(N) Number
S – Singular
P – Plural
A – Anything (can be either S or P)
H – Honorary plural
U – Unspecified or irrelevant
X – Unknown (to the tagger)
(F) Form
D – Direct
O – Oblique
A – Anything (can be either D or O)
U – Unspecified or irrelevant
X – Unknown (to the tagger)
(P) Person
1 – 1st person
2 – 2nd person normal (tuma)
3 – 3rd person normal (vaha)
4 – 2nd person familiar (tu)
5 – 2nd person formal (Apa)
6 – 3rd person formal (ve)
7 – Formal (5 or 6 above)
U – Unspecified or irrelevant
X – Unknown (to the tagger)
(T) Tense
E – Present
S – Past
F – Future
A – Anything (either E, A or F)
U – Unspecified or irrelevant
X – Unknown (to the tagger)
(A) Aspect
C – Continuous
P – Perfect
A – Anything (either P or C)
U – Unspecified or irrelevant
X – Unknown (to the tagger)
(I) Inflection
O – Null or none (as in jisa)
N – ne (as in jisane)
K – ko (as in jisako)
S – se (as in jisase)
E – e (as in jise)
P – Possessive markers (ShaShTi vibhakti as in jisakA, jisakI etc.)
M – me.n (as in jisame.n)
A – Anything (can be either S or P)
U – Unspecified or irrelevant
X – Unknown (to the tagger)
(C) Cardinality
Any rational number
(D) Degree
S – Superlative
C – Comparative
N – Normal
A – Anything (either S, C or N)
U – Unspecified or irrelevant
X – Unknown (to the tagger)
(R) Range
Ordered tuple of two rational numbers e.g. <5, 10>