Hadoop MapReduce - Pig/Cassandra - Unable to create input splits -

-

i'm trying run mapreduce job pig , cassandra , error: error 2118: unable create input splits for: cassandra://constellation/logs

[solved] there environment variables missed set:

pig_rpc_port, pig_initial_address, pig_partitioner

/opt/cassandra-0.7.0-beta3/contrib/pig$ bin/pig_cassandra example-script.pig 10/11/15 17:38:26 info pig.main: logging error messages to: /opt/cassandra-0.7.0-beta3/contrib/pig/pig_1289839106859.log 2010-11-15 17:38:27,809 [main] info org.apache.pig.backend.hadoop.executionengine.hexecutionengine - connecting hadoop file system at: hdfs://hadoop-master-1.dkd.lan:8020 2010-11-15 17:38:29,756 [main] info org.apache.pig.backend.hadoop.executionengine.hexecutionengine - connecting map-reduce job tracker at: hadoop-master-1.dkd.lan:8021 2010-11-15 17:38:32,753 [main] info org.apache.pig.backend.hadoop.executionengine.hexecutionengine - (name: store(hdfs://hadoop-master-1.dkd.lan/tmp/temp657556636/tmp-375431593:org.apache.pig.builtin.binstorage) - 1-82 operator key: 1-82) 2010-11-15 17:38:32,960 [main] info org.apache.pig.backend.hadoop.executionengine.mapreducelayer.combineroptimizer - choosing move algebraic foreach combiner 2010-11-15 17:38:33,100 [main] info org.apache.pig.backend.hadoop.executionengine.mapreducelayer.multiqueryoptimizer - mr plan size before optimization: 3 2010-11-15 17:38:33,100 [main] info org.apache.pig.backend.hadoop.executionengine.mapreducelayer.multiqueryoptimizer - mr plan size after optimization: 3 2010-11-15 17:38:33,364 [main] info org.apache.pig.backend.hadoop.executionengine.mapreducelayer.jobcontrolcompiler - mapred.job.reduce.markreset.buffer.percent not set, set default 0.3 2010-11-15 17:38:38,771 [main] info org.apache.pig.backend.hadoop.executionengine.mapreducelayer.jobcontrolcompiler - setting single store job 2010-11-15 17:38:38,999 [main] info org.apache.pig.backend.hadoop.executionengine.mapreducelayer.mapreducelauncher - 1 map-reduce job(s) waiting submission. 2010-11-15 17:38:39,055 [thread-4] warn org.apache.hadoop.mapred.jobclient - use genericoptionsparser parsing arguments. applications should implement tool same. 2010-11-15 17:38:39,500 [main] info org.apache.pig.backend.hadoop.executionengine.mapreducelayer.mapreducelauncher - 0% complete 2010-11-15 17:38:40,340 [thread-4] info org.apache.hadoop.mapred.jobclient - cleaning staging area hdfs://hadoop-master-1.dkd.lan/var/lib/hadoop-0.20/cache/mapred/mapred/staging/dkd-sprenger/.staging/job_201011101636_0011 2010-11-15 17:38:40,356 [main] info org.apache.pig.backend.hadoop.executionengine.mapreducelayer.mapreducelauncher - 100% complete 2010-11-15 17:38:40,357 [main] error org.apache.pig.backend.hadoop.executionengine.mapreducelayer.mapreducelauncher - 1 map reduce job(s) failed! 2010-11-15 17:38:40,402 [main] info org.apache.pig.backend.hadoop.executionengine.mapreducelayer.mapreducelauncher - failed! 2010-11-15 17:38:40,517 [main] error org.apache.pig.tools.grunt.grunt - error 2997: unable recreate exception backend error: org.apache.pig.backend.executionengine.execexception: error 2118: unable create input splits for: cassandra://constellation/logs details @ logfile: /opt/cassandra-0.7.0-beta3/contrib/pig/pig_1289839106859.log

anyone has idea -> solved there environment variables missed set them.

enviroment: ubuntu server 10.4

versions: hadoop: 0.20 pig: 0.7 cassandra: 0.7.0 beta3

the asker updated question include answer:

[solved] there environment variables missed set:

pig_rpc_port, pig_initial_address, pig_partitioner


Comments

Post a Comment

Popular posts from this blog

android - Spacing between the stars of a rating bar? -

-
ho can set spacing beween stars? thats ratingbar: ratingbar = (ratingbar) inflater.inflate(r.layout.ratingbar, null); ratingbar.setlayoutparams(new layoutparams(layoutparams.wrap_content, layoutparams.wrap_content)); the layout: <?xml version="1.0" encoding="utf-8"?> <ratingbar xmlns:android="http://schemas.android.com/apk/res/android" style="@style/mystyle" android:layout_alignparentright="true" android:layout_height="19dp" android:layout_width="wrap_content" android:numstars="5"> </ratingbar> the style: <style name="mystyle" parent="@android:style/widget.ratingbar"> <item name="android:progressdrawable">@drawable/android_r2_ratingstar_yellow</item> <item name="android:indeterminatedrawable">@drawable/android_r2_ratingstar_grey</item> </style> thanks, cheers you have ...
Read more

html - Instapaper-like algorithm -

-
does of algorithm extracts contents webpage? instapaper ? there 2 steps instapaper does: find main content block on page (excluding headers, footers, menus etc) from content block extract , format text to find content block (typically html block element, div containing key page text content) instapaper uses algorithm 1 used readability . can @ source of readability.js see what's going on, @ core tries find area on page highest text/link ratio, although has other simple scoring metrics (e.g. off top of head, things ratio of text commas, para elements etc) go heuristics. once have identified root node element, relevant content, you'll need format it, if want can pull node element containing text out of source document , insert yours, in reality you'll want remove existing styles , apply own, standard , feel. if want output nice text-only can use jericho's renderer . update1 : should mention else instapaper - follow 'pagination' links (...
Read more

c# - How to execute a particular part of code asynchronously in a class -

-
i creating speech recognition engine that's going respond user commands.i have created button enable , disable speech recognition per user convenience.i have used dispose() of speech engine disable speech recoginition.here code private void button1_click(object sender, routedeventargs e) { engineon = !engineon; if (engineon) { speechengine = speech.createspeechengine(); //speech class creates , returns new speech engine. speechengine.audiolevelupdated += new eventhandler<audiolevelupdatedeventargs>(speechengine_audiolevelupdated); // use system's default microphone speechengine.setinputtodefaultaudiodevice(); speechengine.loadgrammar(new dictationgrammar()); // start listening speechengine.recognizeasync(recognizemode.multiple); } else { speechclass.myengine.dispose(); } } but disposal of speech obj...
Read more