OSError: [Errno 24] Too many open files with Google App Engine Task Queues in Dev Environment -

-

i'm testing google app engine application i've started using task queues process batch job. have local job seem number of tasks in task queue seems create number of objects in file system. clear: i'm not creating files, app server seems doing so.

i've noticed when creating large numbers of tasks (2000+) in development environment @ point jobs start failing following error:

<body bgcolor="#f0f0f8"><font color="#f0f0f8" size="-5"> --> <body bgcolor="#f0f0f8"><font color="#f0f0f8" size="-5"> --> --> </font> </font> </font> </script> </object> </blockquote> </pre> </table> </table> </table> </table> </table> </font> </font> </font><pre>traceback (most recent call last):   file "/applications/googleappenginelauncher.app/contents/resources/googleappengine-default.bundle/contents/resources/google_appengine/google/appengine/tools/dev_appserver.py", line 3211, in _handlerequest     self._dispatch(dispatcher, self.rfile, outfile, env_dict)   file "/applications/googleappenginelauncher.app/contents/resources/googleappengine-default.bundle/contents/resources/google_appengine/google/appengine/tools/dev_appserver.py", line 3135, in _dispatch     'request.')   file "/system/library/frameworks/python.framework/versions/2.5/lib/python2.5/tempfile.py", line 302, in mkstemp   file "/system/library/frameworks/python.framework/versions/2.5/lib/python2.5/tempfile.py", line 236, in _mkstemp_inner oserror: [errno 24] many open files: '/var/folders/rm/rm1n57bdhncyqut2mqrtx++++ti/-tmp-/request.qky1gf.tmp' </pre>

i'm on os x 10.6.5 , i'm guessing it's os - though can't quite wrap head around why dev_appserver.py open many file descriptors. if it's creating 1 per task won't rate limiting prevent problem occurring?

i assume problem i'll see in dev, wanted ask if else has seen it.

david correct. can't create files in local file system.

but error getting caused a bug involving tasks in dev_appserver. once error, try running lsof, you'll see dev server has bunch of handles datastore file.

switch using sqlite backend problem go away. not forget, when switch need clear datastore first time.

dev_appserver.py --use_sqlite --clear_datastore .

Comments

Post a Comment

Popular posts from this blog

android - Spacing between the stars of a rating bar? -

-
ho can set spacing beween stars? thats ratingbar: ratingbar = (ratingbar) inflater.inflate(r.layout.ratingbar, null); ratingbar.setlayoutparams(new layoutparams(layoutparams.wrap_content, layoutparams.wrap_content)); the layout: <?xml version="1.0" encoding="utf-8"?> <ratingbar xmlns:android="http://schemas.android.com/apk/res/android" style="@style/mystyle" android:layout_alignparentright="true" android:layout_height="19dp" android:layout_width="wrap_content" android:numstars="5"> </ratingbar> the style: <style name="mystyle" parent="@android:style/widget.ratingbar"> <item name="android:progressdrawable">@drawable/android_r2_ratingstar_yellow</item> <item name="android:indeterminatedrawable">@drawable/android_r2_ratingstar_grey</item> </style> thanks, cheers you have ...
Read more

html - Instapaper-like algorithm -

-
does of algorithm extracts contents webpage? instapaper ? there 2 steps instapaper does: find main content block on page (excluding headers, footers, menus etc) from content block extract , format text to find content block (typically html block element, div containing key page text content) instapaper uses algorithm 1 used readability . can @ source of readability.js see what's going on, @ core tries find area on page highest text/link ratio, although has other simple scoring metrics (e.g. off top of head, things ratio of text commas, para elements etc) go heuristics. once have identified root node element, relevant content, you'll need format it, if want can pull node element containing text out of source document , insert yours, in reality you'll want remove existing styles , apply own, standard , feel. if want output nice text-only can use jericho's renderer . update1 : should mention else instapaper - follow 'pagination' links (...
Read more

c# - How to execute a particular part of code asynchronously in a class -

-
i creating speech recognition engine that's going respond user commands.i have created button enable , disable speech recognition per user convenience.i have used dispose() of speech engine disable speech recoginition.here code private void button1_click(object sender, routedeventargs e) { engineon = !engineon; if (engineon) { speechengine = speech.createspeechengine(); //speech class creates , returns new speech engine. speechengine.audiolevelupdated += new eventhandler<audiolevelupdatedeventargs>(speechengine_audiolevelupdated); // use system's default microphone speechengine.setinputtodefaultaudiodevice(); speechengine.loadgrammar(new dictationgrammar()); // start listening speechengine.recognizeasync(recognizemode.multiple); } else { speechclass.myengine.dispose(); } } but disposal of speech obj...
Read more