Make log processing a real asset to your organization with powerful and free open source tools.
In Logging in Action you will learn how
Deploy Fluentd and Fluent Bit into traditional on-premises, IoT, hybrid, cloud, and multi-cloud environments, both small and hyperscaled Configure Fluentd and Fluent Bit to solve common log management problems Use Fluentd within Kubernetes and Docker services Connect a custom log source or destination with Fluentd's extensible plugin framework Logging best practices and common pitfalls
Logging in Action is a guide to optimize and organize logging using the CNCF Fluentd and Fluent Bit projects. You'll use the powerful log management tool Fluentd to solve common log management, and learn how proper log management can improve performance and make management of software and infrastructure solutions easier. Through useful examples like sending log-driven events to Slack, you'll get hands-on experience applying structure to your unstructured data.
Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications.
About the technology Don't fly blind! An effective logging system can help you see and correct problems before they cripple your software. With the Fluentd log management tool, it's a snap to monitor the behavior and health of your software and infrastructure in real time. Designed to collect and process log data from multiple sources using the industry-standard JSON format, Fluentd delivers a truly unified logging layer across all your systems.
About the book Logging in Action teaches you to record and analyze application and infrastructure data using Fluentd. Using clear, relevant examples, it shows you exactly how to transform raw system data into a unified stream of actionable information. You'll discover how logging configuration impacts the way your system functions and set up Fluentd to handle data from legacy IT environments, local data centers, and massive Kubernetes-driven distributed systems. You'll even learn how to implement complex log parsing with RegEx and output events to MongoDB and Slack.
What's inside
Capture log events from a wide range of systems and software, including Kubernetes and Docker Connect to custom log sources and destinations Employ Fluentd's extensible plugin framework Create a custom plugin for niche problems
About the reader For developers, architects, and operations professionals familiar with the basics of monitoring and logging.
About the author Phil Wilkins has spent over 30 years in the software industry. Has worked for small startups through to international brands.
Table of Contents PART 1 FROM ZERO TO "HELLO WORLD" 1 Introduction to Fluentd 2 Concepts, architecture, and deployment of Fluentd PART 2 FLUENTD IN DEPTH 3 Using Fluentd to capture log events 4 Using Fluentd to output log events 5 Routing log events 6 Filtering and extrapolation PART 3 BEYOND THE BASICS 7 Performance and scaling 8 Driving logs with Docker and Kubernetes 9 Creating custom plugins PART 4 GOOD LOGGING PRACTICES AND FRAMEWORKS TO MAXIMIZE LOG VALUE 10 Logging best practices 11 Logging frameworks APPENDICES A Installation of additional tools and services B Processing times & dates, regular expressions and other configuration values C Plugins summary D Real-world use case E Useful resources
The application of technology in my professional life is informed by the use of architectural practices – such perspectives help to ensure that, particularly on large transformational initiatives, you can trace the business needs and decisions through to specific technical decisions. This isn’t documentation for the sake of it, but enough to communicate well-thought-out strategies to enable effective communication and continuity of understanding within an organization. But to be a technical architect means you need to be able to get your hands dirty and be able to create proof of concepts and understand the practicalities of implementing a technical strategy.
The value is in knowledge, but that value is only realized when you enable others by sharing it. This leads me elegantly to why I have (co)authored several books and written a book solo, not to mention written articles for journals, blogged and presented.
Getting out and presenting is a great way not only to share but also to learn. The more situations you discover, the more ideas can be adapted to be reusable and, therefore, worth sharing. I am active with the UK Oracle User Group – working as the Dev & Middleware stream lead, helping in a variety of different ways, from planning events and sourcing submissions to reviewing articles for the journal.
This emphasis on enabling others with an Oracle focus has led to my being recognized as an Oracle Ace Director, which I have now stepped down from as I have since joined Oracle.
I’ve been fortunate to work for a variety of organizations, global IT consumers/customers, System Integrators (SI)/consultancies – both niche and large, Independent Software Vendors, and technology manufacturing. This has meant I’ve gained a broad and diverse set of perspectives.
This book adequately covers the content promised in its title.
However, what I really anticipated was not merely a reiteration of the official documentation, but also an in-depth sharing of practical experiences in logging, an aspect in which this book is significantly deficient, especially in Parts 3 and 4, which I found to be superficial. Additionally, the text in many parts of the book is not very smooth, and the quality of the illustrations is inferior compared to some of the Manning books I've read recently.