The Beauty of Mathematics in Computer Science explains the mathematical fundamentals of information technology products and services we use every day, from Google Web Search to GPS Navigation, and from speech recognition to CDMA mobile services. The book was published in Chinese in 2011 and has sold more than 600,000 copies. Readers were surprised to find that many daily-used IT technologies were so tightly tied to mathematical principles. For example, the automatic classification of news articles uses the cosine law taught in high school.
The book covers many topics related to computer applications and applied mathematics including:
Natural language processing
Speech recognition and machine translation
Statistical language modeling
Quantitive measurement of information
Graph theory and web crawler
Pagerank for web search
Matrix operation and document classification
Mathematical background of big data
Neural networks and Google's deep learning
Jun Wu was a staff research scientist in Google who invented Google's Chinese, Japanese, and Korean Web Search Algorithms and was responsible for many Google machine learning projects. He wrote official blogs introducing Google technologies behind its products in very simple languages for Chinese Internet users from 2006-2010. The blogs had more than 2 million followers. Wu received PhD in computer science from Johns Hopkins University and has been working on speech recognition and natural language processing for more than 20 years. He was one of the earliest engineers of Google, managed many products of the company, and was awarded 19 US patents during his 10-year tenure there. Wu became a full-time VC investor and co-founded Amino Capital in Palo Alto in 2014 and is the author of eight books.
Jun Wu was a staff research scientist in Google who invented Google’s Chinese, Japanese, and Korean Web Search Algorithms and was responsible for many Google machine learning projects. He wrote official blogs introducing Google technologies behind its products in very simple languages for Chinese internet users from 2006-2010. The blogs had more than two million followers. He received Ph.D. in computer science from the Johns Hopkins University and had been working on speech recognition and natural language processing for more than 20 years. He was one of the earliest engineers of Google, managed many products of the company, and was awarded more than ten US patents during his ten-year tenure there. He became a full-time VC investor and co-founded Amino Capital in Palo Alto in 2014 and is the author of eight books.
This book is important for computer scientist, mathematicians, statisticians, software engineers. Because, it gives an outline of mathematical tools one needs to grasp solve problems in technology industry.
2. What is inside?
One cannot know everything but one needs to have an outline of what mathematical tools might be needed in the future to solve a problem. The broad scope of the book is to give the reader, an understanding of mathematics in Modern Computing especially through Author’s experience as a Research Scientist in Google.
The Purpose of this book is not to go into details of hidden algorithms behind a product.
We could reformulate the above as, the purpose is to give a gentle introduction to mathematical theories intuitively behind products, rather than software documentation or algorithms.
I took this book to help me categorize mathematics and how one uses them in industry. The Book is well-written and stories intertwined behind products inspire you.
The Chapter on Andrew Viterbi was the best for me.
Outline:
1- Words, Languages, Numbers & Information 2-NLP: From Rules to Statistics 3- Statistical Language Model 4-Word Segmentation 5-Hidden Markov Model 6-Quantifying Information 7-Jelinek and Modern Language processing 8-Boolean Algebra and Search Engines 9-Graph theory and Web Crawlers 10-Page Rank: Google’s ranking technology 11- Relevance in Web Search 12-Finite state machines and Dynamic Programming, Google Maps & Navigation 13-Google’s Designer Ak-47, Dr. Amit Signal 14-Cosine and News Classification 15-Solving classification problem in text processing with matrices 16-Information fingerprint and application 17-Mathematical principles of Cryptography 18-Search Engine’s problem: Anti-Spam, authoritativeness 19-Importance of Mathematical models 20-Don’t put all your eggs in one basked: Principle of Maximum Entropy 21-Mathematical Principles of Chinese input method editors 22-Bloom Filters 23-Bayesian Network: Extension of Markov Chain 24-Conditional random fields, syntactic parsing 25-Andrew Viterbi and Viterbi algorithm 26-God’s algorithm: Expectation max Algorithm 27-Logistic Regression and Web Search Advertisement 28-Google Brain and Artificial neural network 29: Power of Big Data
The Beauty of Mathematics in Computer Science (BMCS) paints hope on a canvas which I have feared is but thinly veiling a research landscape saturated with papers consisting of throwing together integrations of pieces of exiting models or perhaps not much more than a simple increase in model size or parameter count without sufficiently supported insights. On such a bleak landscape, BMCS brings to life stories of researchers in natural language processing (NLP) and related fields with succinct but insightful explanations of the underlying mathematics. To the layman, "machine learning" (ML) is a foreign term, the all-consuming monster lurking in the corner where only those who have aced their high school and college math classes may approach. BMCS demonstrates that "machine learning" is no more than 10 sheets of book-sized paper filled with pictures, rightfully standing up against those who would rather use nebulous terms to show off their intelligence rather than attempting an honest explanation to a peer.
By no means is BMCS is meant to substitute a deeper dive into any of its topics. In Wu's struggle against his various NDAs, he makes an honest attempt to teach the readers in the most approachable way possible. In this process, combating any growing elitism in the AI research industry, Wu identifies in his personal experiences with another established researcher, Jelinek, the largest factor of success in academia: personal motivation. To this end, Wu works to foster interest before mathematical depth, all while maintaining the same rigor one would expect from a formal class.
I can only envy Rachel Wu, the translator of the English version of this book, and a fellow teacher of an introduction to ML class at MIT, for growing up with such a knowledgeable father.
This book's Chinese title is the beauty of math, which confuses the reader a bit. Rather, this is like an introductory material to natural language processing, a subarea in AI. Good for beginners.