Download Group Detection - Social Spaces Group

MAKE COMMUNITY DETECTION
MORE HUMAN
Motahhare Eslami
Cutlure as Data
Fall 2012
GROUPS (COMMUNITIES, CLUSTERS,…)

Sociogram: to analyze choices or preferences within
a group.
An example of a social network diagram

Groups in structural terms:
“whenever human association is examined, we see what
can be described as thick spots— relatively unchanging
clusters or collections of individuals who are linked by
frequent interaction and often by sentimental ties. These are
surrounded by thin areas—where interaction does occur, but
tends to be less frequent and to involve little if any
sentiment.”(Freeman[2])
2
A CLASS SOCIOGRAM
3
DETECTING GROUPS

Small networks


Sociograms are useful
Large Networks

TOO Big to know
4
SOLUTION & CHALLENGE
Using community detection algorithms
 Ground-truth for evaluation
 BIG data will make having the Ground-truth
hard/impossible

Evaluation Metrics other than Ground-truth
 How evaluate evaluation metrics?!


Use different networks to compare selected
algorithms
Network
Node# Edge#
Description
NetScience
1590
2742
Collaboration Network
Football
115
615
US football games Network
Facebook
290
5041
Network of FB friends
5
DIFFERENT NETWORKS ANALYSIS
Modularity
High modularity: dense connections between the nodes
within modules but sparse connections between nodes in
different modules
1
0.9
0.8
0.7
0.6
0.5
0.4
0.3
0.2
0.1
0
GN
CNM
6
NetScience
Football
Networks
Facebook
COMMUNITY DETECTION APPLICATION(CDA)

Demo
7
EVALUATION

Questions

What if a group makes no sense?! -2

What if a group is very large to revise? -1

What if a group is the combination of two specific groups? -1

What if a group is separated to two groups?-1

What if you think this clustering work better?+1

What if you find some interesting point about this clustering?
+1
Metric
Algorithm
Quality
(of 5)
Unknown#
Error#
Accuracy
GN
5
20
15
95%
CNM
4
4
15
95%
MCL
3
1
2
99%
8
FUTURE WORK…
 First
of all: IRB approval!
 Finding
evaluation metrics correlation with
our method accuracy by measuring them
before & after applying our method
 Establishing
 Designing
the online application
more specific interview questions
9
REFERENCES
1.
Sociogram, http://en.wikipedia.org/wiki/Sociogram
2.
http://www.6seconds.org/2012/05/08/sociograms-mapping-theemotional-dynamics-of-a-classroom/->Image
3.
FREEMAN, L.C., AND WEBSTER, C.M. (1994), "Interpersonal
proximity in social and cognitive space,“ Social Cognition, 12,
223-247
4.
Large:http://www.ece.umd.edu/~wenjunlu/research.html
5.
Fortunato, Santo. Community detection in graphs. Physics
Reports 486.3 (2010): 75-174.
6.
Lancichinetti, Andrea, Santo Fortunato, and Filippo Radicchi.
Benchmark graphs for testing community detection algorithms.
Physical Review E 78.4 (2008): 046110.
7.
Han, Jiawei, and Micheline Kamber. Data mining: concepts and
techniques. Morgan Kaufmann, 2006.
10
QUESTIONS?
11