Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Real-time Knowledge Discovery and Dissemination Panel Position Dr. Bhavani Thuraisingham The University of Texas at Dallas [email protected] February 2008 5/22/2017 15:32 1-2 What is Real-time? 0 Hard Real-time - The transactions/queries/updates must meet strict timing constraints 0 Soft Real-time - The goal is to have as many transactions/queries/updates to meet their timing constraints 0 Other concepts - Firm real-time. Near real-time, Fast 5/22/2017 15:32 1-3 Real-time Transaction/Query Processing 0 Transactions may be assigned priorities based on their deadline; e.g., transactions that have short deadline may have higher priorities 0 If two transactions compete for a resource then the higher priority transaction is given the resource 0 If a transaction T1 is of higher priority than transaction T2, and if T1 wants a resource that T2 has then T2 may be aborted and the resource is given to T1 0 Approximate query processing is a technique developed for handling queries that have to return results in real-time 0 Main memory data management is an approach for real-time data management 5/22/2017 15:32 1-4 Real-time Knowledge Discovery (RT-KDD) 0 How does a data mining technique meet the timing constraint? - E.g., if an association rule mining algorithm has a 5 minutes constraint, then should it output as many rules as possible within 5 minutes - How does this affect the accuracy of the results? - Will there be an increase in false positives and negatives? 0 Approximate data mining - Are there techniques analogous to techniques in approximate query processing - Are incomplete results better than no results 0 What are the applications for RT-KDD - Give the results to the war fighter in 5 minutes so that he can take appropriate actions 5/22/2017 15:32 1-5 Real-time Knowledge Discovery (Concluded) 0 Should we take each data mining techniques and develop a real- 0time version of it - This is how research is proceedings in privacy preserving data mining = Privacy preserving association rule mining, Privacy preserving decision treed etc. 0 Is a real0time data warehouse needed for real-time data mining? - If so, how do we build a real-time data warehouse? 0 Can we do without a human in the loop? - If the war fighter needs answer within 5 minutes, then is there time for a human to analyze the results? 0 Does real-time knowledge discovery mean knowledge discover to be carried out during operational time instead of analytical processing? 5/22/2017 15:32 1-6 Directions 0 There is research now on steam knowledge discovery and active data management; this will contribute toward RT-KDD 0 We also need to start a research program on integrating real-time processing research with KDD research 0 When we started with privacy preserving data mining there were questions as to whether we can have privacy as well as useful data mining research; the community is now more accepting of this research. Thee are opportunities for RT-KDD 0 We need to focus on the types of applications that RT-KDD will be needed. 0 Focus more on software real-time approach than a hard real-time approach 0 Building models in real-time as well techniques meeting real-time constraints