Bookbot

Apache Flume

Distributed Log Collection for Hadoop

Parametri

  • 108pagine
  • 4 ore di lettura

Maggiori informazioni sul libro

Apache Flume is a distributed service designed for efficiently collecting, aggregating, and moving large volumes of log data, primarily aimed at delivering data to Apache Hadoop's HDFS. Its architecture is simple and flexible, focusing on streaming data flows while ensuring robustness and fault tolerance through various failover and recovery mechanisms. This resource addresses issues related to HDFS and streaming data/logs, demonstrating how Flume can effectively resolve these challenges. The book begins with an architectural overview of Flume, detailing each component and guiding readers through the installation and compilation processes. It covers the use of channels and channel selectors, providing in-depth explanations of architectural components such as Sources, Channels, Sinks, Channel Processors, and Sink Groups, along with their configuration options. This allows for customization of Flume to meet specific needs. Additionally, it offers insights into writing custom implementations, enhancing your understanding and ability to apply them. By the end of the book, readers will be equipped to construct a series of Flume agents that transport streaming data and logs from their systems into Hadoop in near real time.

Acquisto del libro

Apache Flume, Subas D'Souza

Lingua
Pubblicato
2013
product-detail.submit-box.info.binding
(In brossura)
Ti avviseremo via email non appena lo rintracceremo.

Metodi di pagamento

Titolo
Apache Flume
Sottotitolo
Distributed Log Collection for Hadoop
Lingua
Inglese
Pubblicato
2013
Formato
In brossura
Pagine
108
ISBN10
1782167919
ISBN13
9781782167914
Serie
Descrizione
Apache Flume is a distributed service designed for efficiently collecting, aggregating, and moving large volumes of log data, primarily aimed at delivering data to Apache Hadoop's HDFS. Its architecture is simple and flexible, focusing on streaming data flows while ensuring robustness and fault tolerance through various failover and recovery mechanisms. This resource addresses issues related to HDFS and streaming data/logs, demonstrating how Flume can effectively resolve these challenges. The book begins with an architectural overview of Flume, detailing each component and guiding readers through the installation and compilation processes. It covers the use of channels and channel selectors, providing in-depth explanations of architectural components such as Sources, Channels, Sinks, Channel Processors, and Sink Groups, along with their configuration options. This allows for customization of Flume to meet specific needs. Additionally, it offers insights into writing custom implementations, enhancing your understanding and ability to apply them. By the end of the book, readers will be equipped to construct a series of Flume agents that transport streaming data and logs from their systems into Hadoop in near real time.