Download Multimedia Basics

Survey
yes no Was this document useful for you?
   Thank you for your participation!

* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project

page
1
page
2
page
3
page
4
page
5
page
6
page
7
page
8
page
9
page
10
page
11
page
12
page
13
page
14
page
15
page
16
page
17
page
18
Document related concepts
no text concepts found
Transcript 
Instructor: Dr. Wen-Hung Liao
2/21/2017
Outline
• Course Instructor
• Social Multimedia Computing: Why and
How
• Multimedia Basics
–
–
–
–
Graphics and Image Data Representation
Color in Image and Video
Fundamental Concepts in Video
Basic of Digital Audio
• Social Multimedia Computing
• Readings
About the Instructor
• Dr. Wen-Hung Liao [email protected]
• Dept. of Computer Science, National
Chengchi University
• Course website:
http://www.cs.nccu.edu.tw/~whliao/mm2017
• Textbook (for this part): Fundamentals of
Multimedia, 2nd edition, 2014. (local copy)
Quick Survey
• Prior background in:
– Digital signal processing
– Digital image processing
– Computer vision
– Multimedia
– Machine learning, Deep learning
– Data mining
– Social network
Applications and Tools (1/3)
Applications and Tools (2/3)
• Multimedia Grand Challenges 2016
• Master’s thesis under my supervision
– Identifying User Profile Using Facebook Photos
– Color Analysis of Instagram Photos and Its Application
Applications and Tools (3/3)
• Object recognition:
http://cloudacademy.com/blog/google-vision-vsamazon-rekognition/
• Content-Based Image Retrieval (CBIR)
http://www.lire-project.net/
• Text Parsing
– Stanford CoreNLP: http://stanfordnlp.github.io/CoreNLP/
– JIEBA https://github.com/fxsjy/jieba
– Academia Sinica: http://ckipsvr.iis.sinica.edu.tw/
• Word2vec
https://en.wikipedia.org/wiki/Word2vec
Multimedia Basics
• Chapter 3 :
Graphics and Image Data Representation
• Chapter 4: Color in Image and Video
• Chapter 5: Fundamental Concepts in Video
• Chapter 6: Basic of Digital Audio
Chapter 3
• 3.1 Graphics/Image Data Types
– 1-bit images
– 8-bit gray-level images
– Image data types
– 24-bit color images
– Higher bit-depth images
– 8-bit color images
– Color lookup tables (LUTs)
• 3.2 Popular File Formats
Multimedia Viewer
• XnView
http://www.xnview.com/en/xnview/
• Perception of gray scale images
More on Dithering
• http://www.visgraf.impa.br/Courses/ip00/proj/Dit
hering1/algoritmos_desenvolvidos.htm
• http://www.tannerhelland.com/3643/grayscaleimage-algorithm-vb6/
• Median Cut Algorithm
• Color Quantization
Higher bit-depth images
• Medical imaging (10-bit gray level)
• Multispectral imaging
EXIF
• Not supported in JPEG 2000, PNG and GIF.
• Q1: What information can be obtained by
analyzing the EXIF?
• Q2: Can you read exif data from pictures
on facebook or instagram?
PTM Format
• Polynomial texture mapping: a technique for
storing a representation of a camera scene
that contains information about a set of
images taken under a set of lights that each
have the same spectrum, but with each
placed at a different direction from the scene.
PTM Example
Chapter 4
• 4.1 Color Science
• 4.2 Color Models in Images
• 4.3 Color Models in Video
Color Space Conversions
• http://www.poynton.com/PDFs/colo
ureq.pdf
• OpenCV function: cvtColor
http://docs.opencv.org/modules/img
proc/doc/miscellaneous_transformat
ions.html
Readings
1. Chapter 3, 4 of the textbook (required)
2. Social multimedia computing. (required)
3. User-centric social multimedia computing.
(optional)
Related documents