Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
MAKE COMMUNITY DETECTION MORE HUMAN Motahhare Eslami Cutlure as Data Fall 2012 GROUPS (COMMUNITIES, CLUSTERS,…) Sociogram: to analyze choices or preferences within a group. An example of a social network diagram Groups in structural terms: “whenever human association is examined, we see what can be described as thick spots— relatively unchanging clusters or collections of individuals who are linked by frequent interaction and often by sentimental ties. These are surrounded by thin areas—where interaction does occur, but tends to be less frequent and to involve little if any sentiment.”(Freeman[2]) 2 A CLASS SOCIOGRAM 3 DETECTING GROUPS Small networks Sociograms are useful Large Networks TOO Big to know 4 SOLUTION & CHALLENGE Using community detection algorithms Ground-truth for evaluation BIG data will make having the Ground-truth hard/impossible Evaluation Metrics other than Ground-truth How evaluate evaluation metrics?! Use different networks to compare selected algorithms Network Node# Edge# Description NetScience 1590 2742 Collaboration Network Football 115 615 US football games Network Facebook 290 5041 Network of FB friends 5 DIFFERENT NETWORKS ANALYSIS Modularity High modularity: dense connections between the nodes within modules but sparse connections between nodes in different modules 1 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0 GN CNM 6 NetScience Football Networks Facebook COMMUNITY DETECTION APPLICATION(CDA) Demo 7 EVALUATION Questions What if a group makes no sense?! -2 What if a group is very large to revise? -1 What if a group is the combination of two specific groups? -1 What if a group is separated to two groups?-1 What if you think this clustering work better?+1 What if you find some interesting point about this clustering? +1 Metric Algorithm Quality (of 5) Unknown# Error# Accuracy GN 5 20 15 95% CNM 4 4 15 95% MCL 3 1 2 99% 8 FUTURE WORK… First of all: IRB approval! Finding evaluation metrics correlation with our method accuracy by measuring them before & after applying our method Establishing Designing the online application more specific interview questions 9 REFERENCES 1. Sociogram, http://en.wikipedia.org/wiki/Sociogram 2. http://www.6seconds.org/2012/05/08/sociograms-mapping-theemotional-dynamics-of-a-classroom/->Image 3. FREEMAN, L.C., AND WEBSTER, C.M. (1994), "Interpersonal proximity in social and cognitive space,“ Social Cognition, 12, 223-247 4. Large:http://www.ece.umd.edu/~wenjunlu/research.html 5. Fortunato, Santo. Community detection in graphs. Physics Reports 486.3 (2010): 75-174. 6. Lancichinetti, Andrea, Santo Fortunato, and Filippo Radicchi. Benchmark graphs for testing community detection algorithms. Physical Review E 78.4 (2008): 046110. 7. Han, Jiawei, and Micheline Kamber. Data mining: concepts and techniques. Morgan Kaufmann, 2006. 10 QUESTIONS? 11