Mining Imperfect Data: Dealing with Contamination and Incomplete Records - Softcover

Pearson, Ronald K.

Softcover

ISBN 10: 0898715822 ISBN 13: 9780898715828

Publisher: Society for Industrial and Applied Mathematics, 2005

Synopsis

This book thoroughly discusses the varying problems that occur in data mining, including their sources, consequences, detection, and treatment. Specific strategies for data pretreatment and analytical validation that are broadly applicable are described, making them useful in conjunction with most data mining analysis methods. Examples illustrate the performance of the pretreatment and validation methods in a variety of situations. The book, which deals with a wider range of data anomalies than are usually treated, includes a discussion of detecting anomalies through generalized sensitivity analysis (GSA), a process of identifying inconsistencies using systematic and extensive comparisons of results obtained by analysis of exchangeable datasets or subsets. Real data is made extensive use of, both in the form of a detailed analysis of a few real datasets and various published examples. A succinct introduction to functional equations illustrates their utility in describing various forms of qualitative behavior for useful data characterizations.

About this title

Review

'An accessible presentation of statistical methods and analysis to deal with imperfect data in real data mining applications.' Joydeep Ghosh, University of Texas at Austin

'An appealing feature of this book is the use of fresh datasets that are much larger than those currently found in standard books on outliers and statistical diagnostics.' Anthony Atkinson, London School of Economics

'The book provides the reader with clear descriptions and accessible discussions of problems, motivations, methods and interpretations. The author excels when describing the importance of tools and their applications. The first chapter is a prime example of how to introduce important concepts and methods to a wide readership that may be composed of students, researchers and non-specialists.' Francisco J. Azuaje, BioMedical Engineering OnLine

Book Description

Data mining is concerned with the analysis of databases large enough that various anomalies, including outliers, incomplete data records, and more subtle phenomena such as misalignment errors, are virtually certain to be present. This book describes in detail a number of these problems including their sources, consequences, detection and treatment.

Edition details

• Publisher: Society for Industrial and Applied Mathematics
• Publication date: 2005
• Language: English
• ISBN 10: 0898715822
• ISBN 13: 9780898715828
• Binding: Paperback
• Number of pages: 184