Download A Generalized Procedure of Opinion Mining and Sentiment Analysis

A Generalized Procedure of Opinion Mining and Sentiment Analysis
Sanjeev Kumar a, Prabhat Kumar b*, Maheshwari Prasad Singh c
a
Department of Computer Science and Engineering, National Institute of Technology Patna, Ashok Rajpath, Patna-05, India
b
Department of Information Technology, NIT Patna, Ashok Rajpath, Patna – 05,
b
Department of Computer Science and Engineering, NIT Patna, Ashok Rajpath, Patna – 05
Abstract
Today, with the network globalization there is a burst of opinion on the WWW about almost every event, subject, product etc. So
mining public opinion buried in the form of text on blogs, forums, and comment on social networking Websites etc. about any product,
event, experience etc. is a challenging task as often these opinions are not in structured format. And also this mined opinion is important
information to many related companies that directly affecting their future strategies for manufacturing updated product. In this paper we
present a general procedure for opinion mining and sentiment analysis after surveying several papers
Keywords: Opinion mining, sentiment analysis, pattern recognition, features extraction, machine learning.
1.
Introduction
expresses features and then sentiment of whole text. Now
all type of text are expressing some emotion that may be
positive, negative, and rarely neutral that we termed as
sentiment.
With the fiery advancement in computer technology,
specially the speed of processing and capacity of data
storage, this resolves the problem of mining huge data. So
data mining research focuses towards searching methods or
techniques of mining that resembles human intelligence in
spite of focusing on processing or management of large
data set. As a result now mining opinion is a perspective
research area since [8][9][10].
With the arrival of web2.0, there is an explosive growth
in internet user that forms network globalization. As a
result peoples are sharing their day to day life routines,
happenings, experiences with each other comfortably using
internet. Now it becomes a habit for young generation to
share each and every memorable moment of life to masses
on WWW through small electronic mobile devices
supporting internet like cell phone, tablet, laptop, note,
PDA, etc. These habits of people generate a new area of
research i.e. mining public opinion buried in the form of
text on blogs, forums, and comment on social networking
Websites etc. about any product, event, experience etc. OM
(Opinion Mining) is an important area of research in data
mining that incorporating several small issues like patter
recognition in text (textual contents reside on blogs,
forums, and social networking website etc.), sentiment
orientation of text. Basically the text expressing opinions
are categorized into five parts. (1) The text written in
regional language, (2) The text written in English, (3) The
opinion expressed through symbol, (4) The opinion
expressed through short text, (5) Regional language written
in English (or called as non-English). Fundamentally for
mining opinion from these texts we have to find a word that
2.
Related Work
In this section, we present a review of existing and
related works on Opinion Mining (OM) and Sentiment
Classification (SC) proposed in the field of data mining. Hu
and Liu [1][2] are the first who proposed an algorithm to
identify and summarize product features on which
customer have expressed either positive or negative
opinions. Their algorithm basically defines the features of
product by a string and there was no attempt for clustering
different features. Clustering of different features is an
* Corresponding author Tel: +91-612-2371715-139; 9835011206
E-mail: [email protected]
105
important work in opinion mining, since each product
feature may have a variety of variants. Like if we talk about
price of a product then terms such as rate, cost, and charges
etc. means same. Technique of clustering is used to
assemble similar features together and identify all as single
feature. Zhuang et al. [3] proposed yet another approach of
feature extraction to summarize sentiment themes in movie
reviews. He examines data taken from movie reviews that
has been pre-classified into different categories by human
experts.
Yee and Vidyasagar [4] categorized existing works on
Opinion Mining into seven categories.(1) Item extraction,
(2) Feature extraction, (3) Sentiment Classification in
General, (4) Sentiment Classification on Item, (5)
Sentiment Classification on Features, (6) Strength of
Sentiments, (7) Comparison of Items and Features. They
explain various techniques used for Opinion Mining and
Sentiment Classification from the existing work. The
various techniques used for mining opinions, categorize
sentiment of mined items and features, as well as the
strength of the sentiment are analysed, compared and
differentiated against each other. Khairullah, Baharudin,
Aurangzeb and Fazal [5] also analysed the opinion mining
by conducting five stages of work, (1)Analysis of linguistic
resources for OM; (2) Text features Identification and
Orientation; (3) Adjective, Noun, Verbs, and Adverbs; (4)
Semantic Orientation of Text; (5) Ontology Based
Learning. They basically gave an overview of different
techniques for “generation of a set of search outcome for a
given product by generating a list of attribute like quality
and features and aggregating opinion”.
3.
General Framework
The framework showed in fig.1 presents a generalized
procedure for opinion mining with consideration of
sentiment. OM Machine is the most important component
of my framework. It works centrally and utilizes every
component. There are three components in my framework
i.e. as follows:
(a) OM Text File
(b) OM Machine
(c) Corpus of Words for OM
“OM Text File” contains text from blogs, forums, social
networking websites, BBS, news group etc. which source
of text as input to OM. “Corpus of words for OM” contains
dictionary words for comparison with opinion text (text
contained in “OM Text File”). OM Machine works as core
component of the framework.
Fig.1. Framework for Opinion Mining
Three parts are as follows:
(a) Input to OM Machine
(b) OM Machine, and
(c) Output of OM Machine.
Input to OM Machine consists of different sources of
text i.e. “OM Text File”. So the text leaved by internet
users on WWW as review, feedback, post and comment
etc. is collected and kept in “OM Text File”. OM Machine
processes on these texts contained in “OM Text File” by
analysing it with the help of different opinion mining
technique. OM Machine is also responsible for sentiment
analysis, in which it judges the polarities of text expressed
by user.
Fundamentally sentiment is of two categories negative
and positive but sometimes neutral is also considered. But
for understanding sentiment of the text we have to take help
of techniques like machine learning (Support Vector
Machine, Naive Bayes, K-Nearest Neighbour etc.) and
semantic orientation. At last this OM machine assigns rank
to the text provided based on extracted features. We can
understand procedure of opinion mining and sentiment
detection more clearly after going through “pattern
recognition
and
feature
extraction”,
“sentiment
orientation”, and “sentiment analysis”. So now we explain
these topics one by one as follows.
106
3.1. Patter Recognition and Feature Extraction
[1] initially proposed feature based sentiment mining and
he divides the task into four subtask: (1) Identifying
product features from review comments; (2) Identifying
opinion words regarding product features; (3) Determining
the polarity of opinion words; (4) Polarity determination of
review regarding product features. There after many
research has been going in this area to improve the
accuracy and efficiency of existing methods. Some works
that attempts to determine sentiment polarity with
improved accuracy for review text [8] [9], or sensitive
words [10]. Sentiment mining can be understandable
completely by knowing sentiment orientation and
sentiment analysis that we have explain next.
Patter recognition and feature extraction from the text
involves different steps i.e. first, collecting similar text
from different sources; second, we analyse the text; third,
we identify the patterns in text; and last extraction of
features after matching text with corpus of words which is
previously made for verification.
3.1.1. Data source
Sources of people’s opinion are mainly gathered from
different web resources. These web resources are different
social networking websites (Most famous among all are
Facebook, Twitter, and LinkedIn etc.), blogs, BBS, online
shopping’s website (reviews or customer feedback), news
group, discussion forum, and questionnaire based survey
conducted offline and online.
3.2.1. Sentiment Orientation
Sentiment orientation is the classification of sentimental
expression according to their sense and surroundings
knowledge. L. Cai and T. Hofmann [11] used WordNet for
automatic extraction of concept from text by combining
semantic knowledge and theoretic information of text.
Their model is based on the distribution of predicates and
their arguments. Separating word from multi-word
expression, representing the synonymous words into
different components, and words having several meaning as
one single component are the different issues. Further these
issues can be resolved through semantic analysis. Turney
[12] and Pu Wang et [13] have used set of word and
semantic concept to extract concept from text. They also
proposed the representation of text classification.
3.1.2. Data analysis
After collecting data we analyse it by using different
methodologies to extract features and sentiment. According
to Hu and Liu, it is tough to identify proper techniques for
any text. Since, we are dealing with contextual text so
different texts have different meaning. For [1] [2] and
Zhang et al. [3] proposed for feature extraction. Their
algorithm basically defines the features of product by a
string.
3.1.3. Patterns in Data
Data pattern finding is the most important work among
the feature extraction process. It involves a large number of
vague techniques that is defined for particular case
example, “U.S.
bombs
Taliban
troops”
and
“Taliban bombs U.S. troops”[7], “I find the functionality of
the new mobile less practical” and “Perhaps it is a great
phone, but fail to see why”[6]. In first example the context
of word changes the meaning completely and in the second
example it is a vague text to recognize pattern so we have
to define large set of pattern finding technique to work with
contextual text.
3.2.2. Sentiment Analysis
Sentiment analysis involves the quantification of
sentiment according to the strength of meaning coming
from text. Fundamentally sentiment is of two categories
negative and positive but when we analyse sentiment in
depth then furthermore categories needed. For example,
two review about a movie, (1) “Movie is wonderful” and
(2) “Movie is not bad”. The word “wonderful”, express
sentiment stronger with respect to “not bad”. So we have to
rank the sentiment according to the strength of word for
expression.
3.1.4. Feature Extraction
And finally after the reorganization of pattern we extract
the features and list them according to the nature of
dictionary meaning but sometimes considering only
dictionary is not appropriate to decide features like the case
when, due the alignment of sentiment of text sometime it
yields meaning that is different from the actual dictionary
meaning. For example, “perhaps most of the people like
this hotel, but I am feeling different”. In this example for
human it is easy to understand the reviewer’s feedback but
really tough for a machine to recognize the feeling. So
these types of text need some sentiment analysis.
Machine learning models [5][6] are used for sentiment
analysis mostly implement supervised learning technique of
data mining. So in machine learning we provide two sets of
data, first training set, and second is test set. Training set
teaches machine by providing characteristic of
differentiation among the document, and test set is used to
validate this. Various machine learning technique have
been adopted to identify sentiment of reviewer. Support
Vector Machines (SVM), Navie Bayes (NB), Maximum
Entropy are some most likely Machine learning techniques.
Besides these some other natural language processing
methods are also used like K-Nearest neighbourhood, ID3,
C5, Centroid Classifier, Winno Classifier and the N-gram
Models.
3.2. Sentiment Mining
Sentiment mining is a procedure to determine the
attitude of a speaker or a writer with respect to some topic
or the overall contextual polarity of a document. Hu, Liu
107
4.
Issues, Challenges and Future Scope
References
[1] M. Hu and B. Liu, “Mining and Summarizing Customer Reviews,”
Proc. of the 2004 ACM SIGKDD International Conference on
Knowledge Discovery and Data Mining, ACM Press, 2004, pp. 168177.
[2] M. Hu and B. Liu, “Mining Opinion Features in Customer Reviews,”
Proc. of Nineteenth National Conference on Artificial Intelligence
(AAAI’04), AAAI Press, 2004, pp. 755-760.
[3] L. Zhuang, F. Jing and X. Zhu, “Movie Review Mining and
Summarization,” Proc. of the 15th ACM International Conference on
Information and Knowledge Management (CIKM), ACM Press, 2006,
pp. 43-50.
[4] Yee W. Lo, Vidyasagar Potdar, “A Review of Opinion Mining and
Sentiment Classification Framework in Social Networks,” Proc. of the
2009 Third IEEE International Conference on Digital Ecosystems and
Technologies, 2009, pp. 396-401.
[5] Khairullah Khan, Baharum B.Baharudin, Aurangzeb Khan, Fazal-eMalik, “Mining Opinion from Text Documents: A Survey,” Proc. of
the Third IEEE International Conference on Digital Ecosystems and
Technologies, 2009, pp. 217-222.
[6] G. Vinodhini, R. M. Chandrasekaran, “Sentiment Analysis and
Opinion Mining: A Survey,” Proc. of the 2012 International Journal of
Advanced Research in Computer Science and Software Engineering,
2012, pp. 282-292.
[7] Hai Bang Ma, Yi Bang Geng, Jun Rui Qiu, “Analysis of three
methods for web-based Opinion Mining,” Proc. of the 2011
International Conference on Machine Learning and Cybernetics,
Guilin, 10-13 July, 2011.
[8] J. Zhu, H. Wang, B. K. Tsou, and M. Zhu, “Multi-aspect opinion
polling from textual reviews,” in Proceeding of the 18th ACM
conference on Information and knowledge management, Hong Kong,
China, November 2009, pp. 1799–1802.
[9] T. T. Thet, J.-c. Na, and C. S. G. K. Khoo, “Aspect-based sentiment
analysis of movie reviews on discussion boards,” Journal of
Information Science, vol. 36, no. 6, pp. 823–848, 2010.
[10] J.-Y. Yang, H.-J. Kim, and S.-G. Lee, “Feature-based product review
summarization utilizing user score,” Journal of Information Science
and Engineering, vol. 26, pp. 1973–1990, 2010.
[11] L. Cai and T. Hofmann. Text Categorization by Boosting
Automatically Extracted Concepts. In Proceedings of the 26th Annual
International ACM SIGIR Conference on Research and Development
in Information Retrieval, Toronto, Canada, 2003.
[12] Turney, “Thumbs up or thumbs down? Semantic orientation applied
to unsupervised classification of reviews”, Proceedings of the 40th
Annual Meeting of the Association of Computational Linguistics
(ACL’02), 417-424, 2002.
[13] Turney P. and Littman, ”Measuring praise and criticism: Inference of
semantic orientation from association”, ACM Transactions on
Information Systems, 21(4), 315-346, 2003.
Opinion mining and sentiment analysis suffer from
many issues and challenges, among all recent major issues
is Opinion mining and sentiment analysis suffer from many
issues and challenges, among all recent major issues is
noisy text (text containing English language word mixed
with mother tongue or regional or Non-English language
word, symbolic text, short text) which is growing rapidly
due to the new trend of expression that contain mixture of
different language word, symbol, and short text. For
example, given review about a camera: “Suprb!!!!”,
“@Jabardast”, “awsom###” etc. Also opinion sources are
widely spread over internet and that all are not easily
searched is yet another issue. Opinionated text may be
bogus, as well as relevant text may be skipped due to
limitation of opinion mining technique.
Therefore, lots of areas that need researcher to focus like
extract opinion from noisy text, proposition of new pattern
recognition methods, more sophisticated sentiment analysis
algorithm etc.
5.
Conclusion
Opinion mining and sentiment analysis has extensive
range of applications in IT, like classification of reviews,
summarization of reviews and some real time applications.
In this paper we propose a general procedure of opinion
mining and sentiment analysis with appropriate number of
survey. This paper also presents a systematic way of feature
extraction using opinion mining technique. And summarize
different methods of sentiment analysis for detecting more
accurate opinion. Some machine learning models are also
included to elaborate the sentiment analysis procedure.
108