hadoop - strange behavior of flume-ng -


i trying aggregate apache web server logs hdfs using flume-ng..but strangely getting first few rows hdfs..more strangely every time start agent 2 files getting created , second file smaller first one. agent conf file looks this:

agent1.sources = tail agent1.channels = memorychannel-2 agent1.sinks = hdfs  agent1.sources.tail.type = exec agent1.sources.tail.command = tail -f /var/log/apache2/access.log.1 agent1.sources.tail.channels = memorychannel-2  agent1.sinks.hdfs.channel = memorychannel-2 agent1.sinks.hdfs.type = hdfs agent1.sinks.hdfs.hdfs.path = hdfs://localhost:9000/flume agent1.sinks.hdfs.hdfs.file.type = datastream  agent1.channels.memorychannel-2.type = memory 

also not getting error message on terminal..is normal or mistake part??


Comments

Popular posts from this blog

How do you change vbulletin's home page to the forums instead of the default (CMS or Activity Stream)? -

c++ - Troubles when compiling phash program -