Download Statistics and Data Mining

Lecture 1
Introduction to the Master’s Programme
”Statistics and Data Mining”
Practical questions
1
Personnel at Statistics and Machine Learning department
Name
Name
Oleg Sysoev
Mattias Villani
Senior lecturer
Professor
Responsible for
“Statistics and
Data Mining”
Division chief
Anders
Nordgaard
Ann-Charlotte
Hallberg
(Lotta)
Senior lecturer
Director of
studies
Lecturer
Introductory course "Statistics and Data Mining"
2
Personnel at Statistics and Machine Learning department
Name
Name
Bertil Wegmann
Per Sidén
Postdoc
PhD student
Annelie
Almquist
Isak Hietela
Administrator
(registration, course
reporting,…)
Introductory course "Statistics and Data Mining"
3
Study councellor
Lecturer
Personnel at Statistics and Machine Learning department
Name
Name
Linda Wänström
Måns
Magnusson
Senior lecturer
Responsible for the
bachelor program
PhD Student
Sarah Alsaadi
Josef Wilzén
PhD Student
PhD Student
Introductory course "Statistics and Data Mining"
4
Personnel at ADIT
Name
Name
Patrick Lambrix
Jose Pena
Professor
Senior lecturer
Introductory course "Statistics and Data
Mining"
5
This course







Lectures – Attendance is obligatory
Reading one statistical paper and writing a summary
URKUND is used  Plagiarism is forbidden! (discovered
plagiarism implies a request to disciplinary board)
Course end: October 2016
Grading for this course: Pass fail
Several teachers from IDA are involved
You meet other IDA master students
Introductory course "Statistics and Data
Mining"
6
Statistics and Data Mining program
Aims:
 To build advanced models for explaining complex real-life
systems and predicting new events
 To extract, organize and explore large volumes of data
 To learn how to discover important (hidden) information
(trends, patterns) from large and complex data sets
 To get an in-deep knowledge of models and methods
Competences:
 Data mining, machine learning, statistical modeling, big
data, visualization methods, databases, programming etc
Introductory course "Statistics and Data
Mining"
7
Introductory course "Statistics and Data
Mining"
8
Job opportunities


A plenty of jobs are waiting in USA and Europe
Master program gives excellent background to search jobs as
analyst, data scientist, engineer, manager or consultant in





Business Intelligence (BI)
Customer Resource Management (CRM)
Bioinformatics
Economics
IT industry
…and many other areas where large or complex datasets are
involved
Example jobs:

Statistical Modeller/Software Developer, London

Data scientist at Spotify, Stockholm

Data scientist at Schibsted, Stockholm
Introductory course "Statistics and Data
Mining"
9
Master program overview

Master program= 120 ECTS credits

Obligatory courses (42 ECTS)


Introductory courses (at least 6 ECTS)




Those are courses in statistics that you need to take in order to get a degree
in Statistics.
Complementary courses


Advanced R programming: recommended for all students missing a solid
programming background
Statistical methods: recommended for people with a little statistics in the
background, i.e. computer scientists or engineers (check syllabus if you are
not sure)!
Profile courses (at least 12 ECTS)


You must take and finish these courses to get a degree
If you have found some interesting course which is not in the schedule, we
may count it as profile, contact Oleg S.
Master thesis (30 ECTS)
In order to make a sufficient progress in studies, you need to
gain 30 ECTS credits/ semester
Introductory course "Statistics and Data Mining"
10
Semester admission rules

at least 6 ECTS credits of the first semester to be
admitted to the second semester

at least 40 ECTS credits of the first year, in order to be
admitted to the third semester

65 ECTS credits of the programme, including all
obligatory courses, in order to be admitted to the
master thesis course.
Introductory course "Statistics and Data
Mining"
11
Master program overview
Year 1
Semester 1
Semester 2
Period 3
Data mining - clustering and
association analysis
(732A61, 15 credits)
Period 1
Period 2
Advanced Academic Studies
(732A60, 3 credits)
Visualization
(732A98, 6 credits)
Introduction to
Machine
Learning (732A95, 9
credits)
Advanced R programming
(732A94, 6 credits)
Computational statistics
(732A38, 6 credits)
Neural Networks and Learning
Systems
(TBMI26, 6 credits)
Big Data Analytics
(732A54, 6 credits)
Statistical methods
(732A93, 6 credits)
Introductory course "Statistics and Data
Mining"
Web programming and
interactivity
(TDDD24, 4 credits)
12
Period 4
Philosophy of
science
(720A04,3
credits)
Bayesian learning,
(732A91, 6 credits)
Master program overview
Year 2
Semester 3
Period 1
Period 2
Time series
Multivariate statistical
analysis(732A62, 6 credits)
methods
(732A97, 6 credits)
Semester 4
Period 3
Period 4
MASTER THESIS
(732A64, 30 credits)
Advanced Machine Learning
(732A96, 6 credits)
Text Mining
(732A92, 6 credits)
Probability theory
(732A40, 6 credits)
Database Technology
(TDDD37 , 6 credits)
Data mining project (732A65, 6 credits)
Decision theory (732A66, 6 credits)
EXCHANGE STUDIES
Introductory course "Statistics and Data
Mining"
13
Obligatory courses


Academic studies
Introduction to Machine Learning


Data Mining – Clustering and Association analysis


Laws of nature and scientific models, theories and
observations
Computational statistics


Unsupervised learning, focus on algorithms
Philosophy of science


Predictive modelling: Ridge regression, Generalized additive
models, neural networks, support vector machines etc
Random number generation, MCMC
Bayesian learning

Using prior knowledge to make better decisions and
inferences
Introductory course "Statistics and Data
Mining"
14
Introductory courses

Statistical Methods





Probability, conventional distributions: Normal, Poisson,
Gamma…
Point and interval estimation
Hypothesis testing
Basics of Bayesian statistics
Advanced programming in R


Basic programming (loops, data types)
Advanced topics (debugging, peformance enhancement,
package building etc)
Introductory course "Statistics and Data
Mining"
15
Profile courses

Advanced Machine Learning


Visualization


Multivariate random variables, transforms, order statistics,
convergence. Necessary for PhD studies.
Multivariate statistical methods


Autocorrelation, forecasting, ARIMA models
Probability theory


Static, interactive and dynamic graphics for data analysis
Time Series Analysis


Bayesian networks, state space models, particle filtering
Principal components, factor analysis, canonical correlation
Decision Theory

Bayesian hypothesis evaluation, Decision theoretic elements,
Utility and loss functions, Graphical modelling, Sequential
analysis
Introductory course "Statistics and Data
Mining"
16
Complementary courses

Big Data Analytics


Neural networks and learning systems


Specify, implement and evaluate a data mining or machine
learning algorithm
Text Mining


HTML, XML, PHP
Data mining project


Given by Department of Biomedical Engineering Advanced
neural networks, kernel methods, reinforcement learning,
genetic algorithms
Web programming course


Hadoop, Spark, scaling up machine learning
Extracting text data from different sources and analysis
linguistically and by statistical tools
Database technology

Relational databases, relational algebra, SQL, query
optimization
Introductory course "Statistics and Data
Mining"
17
Other information
Master program’s homepage(schedule, courses, news…):
http://www.liu.se/en/education/master/programmes/F7MSG
/student?l=en
Facebook page:
https://www.facebook.com/liustatisticsmaster
Email to staff: [email protected]
 Example: [email protected]
Webpages of courses: www.ida.liu.se/~course_code/
 This course: www.ida.liu.se/~732A60/
Introductory course "Statistics and Data
Mining"
18
Course registration




To participate in exam and get credits for a course, you must register
for it.
International students: register for max 120 ECTS, otherwise you
pay for more than that! (Swedish language courses not included)
Registration is done by Student Portal:
https://www3.student.liu.se/portal/eng
If you have problems with registration, contact our administrator
Annelie Almquist ([email protected] )
Here you can choose between registration for
single subject course or study program
Introductory course "Statistics and Data
Mining"
19
LiU-Account and personal number

It is necessary for you to get a LIU-account as soon as
possible (house Zenit, student office)





Access to Student Portal
Course registration
Access to course materials
Access to department computers
If you come outside Sweden, it is very important to get a
Personal Number at the Tax office:


Address: Kungsgatan 37, Linköping
Needed for medical help
Introductory course "Statistics and Data
Mining"
20
Lectures, Labs, Seminars



Lectures: normally presented in PowerPoint, later
available either at course page or LISAM. Attendance is
typically not obligatory
Labs: typically computer exercises done individually or in
groups of two. Attendance is typically not obligatory. A
written report should be normally submitted.
Seminars: Discussions of theory and labs, student
presentations. Attendance typically obligatory.
Introductory course "Statistics and Data
Mining"
21
Exams and points

Exams





Each course has 1 exam and 2 re-exams
You must register for the written or computer exam at
least 10 days in advance.
Exam results may not be improved  if aim for high grade
and feel that written badly  cross every non-empty page in
solutions
Exam results should normally be available after 2 weeks
Credits


Most courses have separate credits for labs (or project) and
for the exam
Credits for some courses can be obtained only after you are
completely done with the course
Introductory course "Statistics and Data
Mining"
22
Course evaluation

KURT: course evaluation system at LiU





You evaluate the courses you have done
Sent via email
The surveys are anonymous!
Very important for improvements of courses – please
answer these surveys!
You will be invited to a meeting with study councellor
periodically to discuss your current studies and plan the
coming studies.
Introductory course "Statistics and Data
Mining"
23
Schedules of the courses

Some schedules are on the course homepages

Some schedules accessed via TimeEdit:

https://se.timeedit.net/web/liu/db1/schema

Type the course name and run
Introductory course "Statistics and Data
Mining"
24
How to find a room

Room at LiU:


http://www.liu.se/karta/?l=en
Room at the department (IDA)

Go to www.ida.liu.se and choose “Find IDA room” from the
droplist.
Introductory course "Statistics and Data
Mining"
25
Useful links




Homepage "Statistics and Data Mining"
Information from the faculty
Practical Guide
Welcome activities for masters
Introductory course "Statistics and Data
Mining"
26
Questions

Questions related to the program?


Contact Oleg Sysoev
http://www.ida.liu.se/department/contact/contactsearch.en.s
html?NAME=Oleg%20Sysoev
Questions about master studies in general?

Contact Darja Utgof
http://www.student.liu.se/masters/master-scoordinators?l=en
Introductory course "Statistics and Data
Mining"
27