Information Theory: A Tutorial Introduction - Softcover

Stone, James V

Softcover

ISBN 10: 0956372856 ISBN 13: 9780956372857

Publisher: Sebtel Press, 2015

Synopsis

Originally developed by Claude Shannon in the 1940s, information theory laid the foundations for the digital revolution, and is now an essential tool in telecommunications, genetics, linguistics, brain sciences, and deep space communication. In this richly illustrated book, accessible examples are used to introduce information theory in terms of everyday games like ‘20 questions’ before more advanced topics are explored. Online MatLab and Python computer programs provide hands-on experience of information theory in action, and PowerPoint slides give support for teaching. Written in an informal style, with a comprehensive glossary and tutorial appendices, this text is an ideal primer for novices who wish to learn the essential principles and applications of information theory.

About this title

Review

“ An accessible and cohesive style of presentation for those seeking to learn information transmission basics, along with an intuitive understanding of applications in linguistics, biology, genetics, and neuroscience. ”Computing Reviews, 2016.

"This is a really great book – it describes a simple and beautiful idea in a way that is accessible for novices and experts alike. This "simple idea" is that information is a formal quantity that underlies nearly everything we do. In this book, Stone leads us through Shannon’s fundamental insights; starting with the basics of probability and ending with a range of applications including thermodynamics, telecommunications, computational neuroscience and evolution. There are some lovely anecdotes: I particularly liked the account of how Samuel Morse (inventor of the Morse code) pre-empted modern notions of efficient coding by counting how many copies of each letter were held in stock in a printer's workshop. The treatment of natural selection as "a means by which information about the environment is incorporated into DNA" is both compelling and entertaining. The substance of this book is a clear exposition of information theory, written in an intuitive fashion (true to Stone's observation that "rigour follows insight"). Indeed, I wish that this text had been available when I was learning about information theory. Stone has managed to distil all of the key ideas in information theory into a coherent story. Every idea and equation that underpins recent advances in technology and the life sciences can be found in this informative little book." Professor Karl Friston, Fellow of the Royal Society.
Scientific Director of the Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London.

"Information lies at the heart of biology, societies depend on it, and our ability to process information ever more efficiently is transforming our lives. By introducing the theory that enabled our information revolution, this book describes what information is, how it can be communicated efficiently, and why it underpins our understanding of biology, brains, and physical reality. Its tutorial approach develops a deep intuitive understanding using the minimum number of elementary equations. Thus, this superb introduction not only enables scientists of all persuasions to appreciate the relevance of information theory, it also equips them to start using it. The same goes for students. I have used a handout to teach elementary information theory to biologists and neuroscientists for many years. I will throw away my handout and use this book." Simon Laughlin, Professor of Neurobiology, Fellow of the Royal Society, Department of Zoology, University of Cambridge, England.

"Ideal for the curious undergraduate in biology, neuroscience or computer science who wants to absorb the intuitions and methods of information theory." Professor Barak A. Pearlmutter, Brain and Computation Lab, Maynooth University, Ireland.

Edition details

• Publisher: Sebtel Press
• Publication date: 2015
• ISBN 10: 0956372856
• ISBN 13: 9780956372857
• Binding: Paperback
• Language: English
• Edition number: 1
• Number of pages: 260