language agnostic - Does there exist an open-source distributed logging library? -

-

i'm talking library allow me log events different machines , align these events on "global" time axis sufficiently high precision.

actually, i'm asking because i've written such thing myself in course of cluster computing project, found terrifically useful, , surprised couldn't find analogues.

therefore, point whether exists (and better contribute it) or nothing exists (and better write open-source analogue of solution).

here features i'd expect such library:

  • independence on clock offset between different machines
  • timing precision on order of @ least milliseconds, preferably microseconds
  • scalability thousands of concurrent logging processes, @ least several megabytes of aggregated logs per second
  • soft real-time operation (t.i. don't want collect 200 big logs 200 machines , compute clock offsets , merge them - want see happens "live", perhaps small lag 10s)

facebook's contribution in matter called 'scribe'.

excerpt:

scribe server aggregating streaming log data. designed scale large number of nodes , robust network , node failures. there scribe server running on every node in system, configured aggregate messages , send them central scribe server (or servers) in larger groups.

...

scribe implemented thrift service using non-blocking c++ server. installation @ facebook runs on thousands of machines , reliably delivers tens of billions of messages day.

the api thrift-based, have platform coverage, in case you're looking simple integration java may want have @ digg's log4j appender scribe.


Comments

Post a Comment

Popular posts from this blog

android - Spacing between the stars of a rating bar? -

-
ho can set spacing beween stars? thats ratingbar: ratingbar = (ratingbar) inflater.inflate(r.layout.ratingbar, null); ratingbar.setlayoutparams(new layoutparams(layoutparams.wrap_content, layoutparams.wrap_content)); the layout: <?xml version="1.0" encoding="utf-8"?> <ratingbar xmlns:android="http://schemas.android.com/apk/res/android" style="@style/mystyle" android:layout_alignparentright="true" android:layout_height="19dp" android:layout_width="wrap_content" android:numstars="5"> </ratingbar> the style: <style name="mystyle" parent="@android:style/widget.ratingbar"> <item name="android:progressdrawable">@drawable/android_r2_ratingstar_yellow</item> <item name="android:indeterminatedrawable">@drawable/android_r2_ratingstar_grey</item> </style> thanks, cheers you have ...
Read more

html - Instapaper-like algorithm -

-
does of algorithm extracts contents webpage? instapaper ? there 2 steps instapaper does: find main content block on page (excluding headers, footers, menus etc) from content block extract , format text to find content block (typically html block element, div containing key page text content) instapaper uses algorithm 1 used readability . can @ source of readability.js see what's going on, @ core tries find area on page highest text/link ratio, although has other simple scoring metrics (e.g. off top of head, things ratio of text commas, para elements etc) go heuristics. once have identified root node element, relevant content, you'll need format it, if want can pull node element containing text out of source document , insert yours, in reality you'll want remove existing styles , apply own, standard , feel. if want output nice text-only can use jericho's renderer . update1 : should mention else instapaper - follow 'pagination' links (...
Read more

c# - How to execute a particular part of code asynchronously in a class -

-
i creating speech recognition engine that's going respond user commands.i have created button enable , disable speech recognition per user convenience.i have used dispose() of speech engine disable speech recoginition.here code private void button1_click(object sender, routedeventargs e) { engineon = !engineon; if (engineon) { speechengine = speech.createspeechengine(); //speech class creates , returns new speech engine. speechengine.audiolevelupdated += new eventhandler<audiolevelupdatedeventargs>(speechengine_audiolevelupdated); // use system's default microphone speechengine.setinputtodefaultaudiodevice(); speechengine.loadgrammar(new dictationgrammar()); // start listening speechengine.recognizeasync(recognizemode.multiple); } else { speechclass.myengine.dispose(); } } but disposal of speech obj...
Read more