Apache Flume is a distributed, reliable, and available
service used to efficiently collect, aggregate, and move large amounts
of log data. It is used to stream logs from application servers to HDFS
for ad hoc analysis.
This book starts with an architectural overview of Flume and its
logical components. It explores channels, sinks, and sink processors,
followed by sources and channels. By the end of this book, you will be
fully equipped to construct a series of Flume agents to dynamically
transport your stream data and logs from your systems into Hadoop.
A step-by-step book that guides you through the architecture and
components of Flume covering different approaches, which are then pulled
together as a real-world, end-to-end use case, gradually going from the
simplest to the most advanced features.
About The Author
Steve Hoffman has 32 years of experience in software
development, ranging from embedded software development to the design
and implementation of large-scale, service-oriented, object-oriented
systems. For the last 5 years, he has focused on infrastructure as code,
including automated Hadoop and HBase implementations and data ingestion
using Apache Flume. Steve holds a BS in computer engineering from the
University of Illinois at Urbana-Champaign and an MS in computer science
from DePaul University. He is currently a senior principal engineer at
Orbitz Worldwide (http://orbitz.com/).
More information on Steve can be found at http://bit.ly/bacoboy and on Twitter at @bacoboy.
This is the first update to Steve's first book, Apache Flume: Distributed Log Collection for Hadoop, Packt Publishing.
