Compression Schemes for Mining Large Datasets A Machine Learning Perspective

As data mining algorithms are typically applied to sizable volumes of high-dimensional data, these can result in large storage requirements and inefficient computation times. This unique text/reference addresses the challenges of data abstraction generation using a least number of database scans, co...

Full description

Bibliographic Details
Main Authors: Ravindra Babu, T., Narasimha Murty, M. (Author), Subrahmanya, S.V. (Author)
Format: eBook
Language:English
Published: London Springer London 2013, 2013
Edition:1st ed. 2013
Series:Advances in Computer Vision and Pattern Recognition
Subjects:
Online Access:
Collection: Springer eBooks 2005- - Collection details see MPG.ReNa
LEADER 03335nmm a2200349 u 4500
001 EB000421926
003 EBX01000000000000000275008
005 00000000000000.0
007 cr|||||||||||||||||||||
008 131205 ||| eng
020 |a 9781447156079 
100 1 |a Ravindra Babu, T. 
245 0 0 |a Compression Schemes for Mining Large Datasets  |h Elektronische Ressource  |b A Machine Learning Perspective  |c by T. Ravindra Babu, M. Narasimha Murty, S.V. Subrahmanya 
250 |a 1st ed. 2013 
260 |a London  |b Springer London  |c 2013, 2013 
300 |a XVI, 197 p. 62 illus., 3 illus. in color  |b online resource 
505 0 |a Introduction -- Data Mining Paradigms -- Run-Length Encoded Compression Scheme -- Dimensionality Reduction by Subsequence Pruning -- Data Compaction through Simultaneous Selection of Prototypes and Features -- Domain Knowledge-Based Compaction -- Optimal Dimensionality Reduction -- Big Data Abstraction through Multiagent Systems -- Intrusion Detection Dataset: Binary Representation 
653 |a Artificial Intelligence 
653 |a Data mining 
653 |a Artificial intelligence 
653 |a Data Mining and Knowledge Discovery 
653 |a Automated Pattern Recognition 
653 |a Pattern recognition systems 
700 1 |a Narasimha Murty, M.  |e [author] 
700 1 |a Subrahmanya, S.V.  |e [author] 
041 0 7 |a eng  |2 ISO 639-2 
989 |b Springer  |a Springer eBooks 2005- 
490 0 |a Advances in Computer Vision and Pattern Recognition 
028 5 0 |a 10.1007/978-1-4471-5607-9 
856 4 0 |u https://doi.org/10.1007/978-1-4471-5607-9?nosfx=y  |x Verlag  |3 Volltext 
082 0 |a 006.4 
520 |a As data mining algorithms are typically applied to sizable volumes of high-dimensional data, these can result in large storage requirements and inefficient computation times. This unique text/reference addresses the challenges of data abstraction generation using a least number of database scans, compressing data through novel lossy and non-lossy schemes, and carrying out clustering and classification directly in the compressed domain. Schemes are presented which are shown to be efficient both in terms of space and time, while simultaneously providing the same or better classification accuracy, as illustrated using high-dimensional handwritten digit data and a large intrusion detection dataset. Topics and features:  Presents a concise introduction to data mining paradigms, data compression, and mining compressed data Describes a non-lossy compression scheme based on run-length encoding of patterns with binary valued features Proposes a lossy compression scheme that recognizes a pattern as a sequence of features and identifying subsequences Examines whether the identification of prototypes and features can be achieved simultaneously through lossy compression and efficient clustering Discusses ways to make use of domain knowledge in generating abstraction Reviews optimal prototype selection using genetic algorithms Suggests possible ways of dealing with big data problems using multiagentsystems  A must-read for all researchers involved in data mining and big data, the book proposes each algorithm within a discussion of the wider context, implementation details and experimental results. These are further supported by bibliographic notes and a glossary