log4j - Logstash-Kafka integration not working -

-

we want logs using logstash , pass them kafka.

we have written following conf file logstash 1.5.0 beta 1 , kafka 2.9.2_0.8.1.1

**

input {              file {              type => "apache"              path => ["/var/log/apache2/access.log", "/var/log/apache2/error.log"]          } }     output {         kafka {             codec => plain {                 format => "%{message}"             }     topic_id => "example1"         }     }

**

after running following command : bin/logstash agent -f test.conf --log ex.log

test.conf our conf file. ex.log blank file have created logs stored.

we getting following output

sending logstash logs ex.log. using milestone 2 input plugin 'file'. plugin should stable, if see strange behavior, please let know! more information on plugin milestones, see http://logstash.net/docs/1.5.0.beta1/plugin-milestones {:level=>:warn} using milestone 1 output plugin 'kafka'. plugin should work, benefit use folks you. please let know if find bugs or have suggestions on how improve plugin. more information on plugin milestones, see http://logstash.net/docs/1.5.0.beta1/plugin-milestones {:level=>:warn} log4j:warn no appenders found logger (kafka.utils.verifiableproperties). log4j:warn please initialize log4j system properly. log4j:warn see http: //logging.apache.org/log4j/1.2/faq.html#noconfig more info. slf4j: failed load class "org.slf4j.impl.staticloggerbinder". slf4j: defaulting no-operation (nop) logger implementation slf4j: see http:/ /www.slf4j.org/codes.html#staticloggerbinder further details.

we tried setting classpath in bashrc. did not work. please tell going wrong. thankyou in advance!

some things can check: topic example1 available? if not did use auto create in kafka? check existing topics this:

bin/kafka-topics.sh --list --zookeeper localhost:2181

example1 should between returned items, if not can create topic manually well.

bin/kafktopics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic example1

to see if kafka receives message start consumer:

bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic example1

i started simple logstash instance listens standard in , using consumer see if message arrives in kafka. logstash configuration:

input {         stdin { } }  output {     kafka {         codec => plain {             format => "%{message}"         }         topic_id => "example1"     } }

hope helps


Comments

Post a Comment

Popular posts from this blog

java - Plugin org.apache.maven.plugins:maven-install-plugin:2.4 or one of its dependencies could not be resolved -

-
i getting error message , further 1 here: failed read artifact descriptor org.apache.maven.plugins:maven-install-plugin:jar:2.4: even though when go .m2 repository path c:\users\a591024.m2\repository\org\apache\maven\plugins\maven-resources-plugin\2.4 the maven-resources-plugin-2.4.jar file there , maven-resources-plugin-2.4.pom there. have tried delete .m2 repository no luck. far maven not build project desperately need to. any ideas? it seems proxy issue please aad following in setting.xml grabbing lan setting , proxy information. <proxies> <proxy> <id>proxy</id> <active>true</active> <protocol>http</protocol> <host>hostname</host> <port>port</port> </proxy> </proxies> this frequent issue, please see below link well. plugin org.apache.maven.plugins:maven-clean-plugin:2.5 or 1 of dependencies not resolved maven: failed ret...
Read more

Round ImageView Android -

-
Image
i working on android application in doing rounded image view. working fine images, images 160x120 resolution shows oval shaped. code custom imageview given below, please me out here: public class roundimage extends drawable { private final bitmap mbitmap; private final paint mpaint; private final rectf mrectf; private final int mbitmapwidth; private final int mbitmapheight; public roundimage(bitmap bitmap) { mbitmap = bitmap; mrectf = new rectf(); mpaint = new paint(); mpaint.setantialias(true); mpaint.setdither(true); final bitmapshader shader = new bitmapshader(bitmap, shader.tilemode.clamp, shader.tilemode.clamp); mpaint.setshader(shader); mbitmapwidth = mbitmap.getwidth(); mbitmapheight = mbitmap.getheight(); } @override public void draw(canvas canvas) { canvas.drawoval(mrectf, mpaint); } @override protected void onboundschange(rect bound...
Read more

How can I utilize Yahoo Weather API in android -

-
Image
i want develop app using yahoo weather api android. want current , forecast weather details. i have tried different sources (e.g.: https://github.com/survivingwithandroid/weatherlib , getting error weatherlib api android , unable execute activity in android weatherlib ) , getting different errors m unable resplve. there can proper tutorial or guide! error: -17 08:50:48.961 3168-3168/com.survivingwithandroid.weather e/androidruntime﹕ fatal exception: main process: com.survivingwithandroid.weather, pid: 3168 java.lang.runtimeexception: unable start activity componentinfo{com.survivingwithandroid.weather/com.survivingwithandroid.weather.mainactivity}: java.lang.nullpointerexception: attempt invoke interface method 'boolean java.util.list.isempty()' on null object reference @ android.app.activitythread.performlaunchactivity(activitythread.java:2298) @ android.app.activitythread.handlelaunchactivity(activitythread.java:2360) @ android.app.activi...
Read more