python - Avoiding reading out the blob -

-

i trying use data blob process data , send via email. of receiving following error - guess relates size of blob read memory, since happens bigger blobs:

traceback (most recent call last):  file "/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py", line 1535, in __call__ rv = self.handle_exception(request, response, e)  file "/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py", line 1529, in __call__ rv = self.router.dispatch(request, response)  file "/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py", line 1278, in default_dispatcher   return route.handler_adapter(request, response)  file "/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py", line 1102, in __call__ return handler.dispatch()  file "/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py", line 572, in dispatch return self.handle_exception(e, self.app.debug)  file "/python27_runtime/python27_lib/versions/third_party/webapp2-2.5.2/webapp2.py", line 570, in dispatch return method(*args, **kwargs)  file "/base/data/home/apps/xxxx/main.py", line 154, in post db.run_in_transaction(filtering)  file "/python27_runtime/python27_lib/versions/1/google/appengine/api/datastore.py", line 2461, in runintransaction return runintransactionoptions(none, function, *args, **kwargs)  file "/python27_runtime/python27_lib/versions/1/google/appengine/api/datastore.py", line 2599, in runintransactionoptions ok, result = _doonetry(new_connection, function, args, kwargs)  file "/python27_runtime/python27_lib/versions/1/google/appengine/api/datastore.py", line 2621, in _doonetry result = function(*args, **kwargs)  file "/base/data/home/apps/xxxx/main.py", line 128, in filtering k in liwkws:  file "/python27_runtime/python27_lib/versions/1/google/appengine/ext/db/__init__.py", line 2326, in next return self.__model_class.from_entity(self.__iterator.next())  file "/python27_runtime/python27_lib/versions/1/google/appengine/datastore/datastore_query.py", line 2892, in next next_batch = self.__batcher.next()  file "/python27_runtime/python27_lib/versions/1/google/appengine/datastore/datastore_query.py", line 2754, in next return self.next_batch(self.at_least_one)  file "/python27_runtime/python27_lib/versions/1/google/appengine/datastore/datastore_query.py", line 2791, in next_batch batch = self.__next_batch.get_result()  file "/python27_runtime/python27_lib/versions/1/google/appengine/api/apiproxy_stub_map.py", line 604, in get_result return self.__get_result_hook(self)  file "/python27_runtime/python27_lib/versions/1/google/appengine/datastore/datastore_query.py", line 2528, in __query_result_hook self._batch_shared.conn.check_rpc_success(rpc)  file "/python27_runtime/python27_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 1224, in check_rpc_success raise _todatastoreerror(err) badrequesterror: invalid handle: 16023202376614806719

this code:

    #reads in variables former process      filter_name = self.request.get('filter_name')     user = self.request.get('user')     lowkey = self.request.get('lowkey')      def filtering():              # read blob memory          low = blobstore.blobreader(lowkey).read()         liwkws = db.gqlquery("select * filterlist ancestor :1", filter_key(filter_name))              # preparing data processing              low = unicode(low, 'utf8').encode('utf-8').replace('\r', '').split('\n')          j in range(len(low)):             k in liwkws:                 if k.newkey.encode('utf-8').lower() in low[j].lower():                      low[j] = 'delete'          cuent = low.count('delete')          in range(cuent):             low.remove('delete')          output_buffer = stringio.stringio()         csv_output = csv.writer(output_buffer, delimiter=",")         in low:             csv_output.writerow([i])         result = output_buffer.getvalue()

any ideas? size of blob in case not large (3mb), , if don't read in directly have save list same size.


Popular posts from this blog

How to calculate SNR of signals in MATLAB? -

-
i've encountered simple, yet fundamental problem on calculating snr: there several signals : s1 = original , pure clean signal without noise. n1 = white gaussian noise going added s1. s2 = s1 + n1 (the noisy signal before performing noise-reduction algorithm) s3 = noise-reduced signal (after performing noise reduction algorithm) n2 = s3 - s1 (the amount of noise after performing noise-reduction algorithm) now want compare snr before , after performing noise-reduction algorithm. which signals should consider snr_before!? s1/n1 or s2/n1 ? which signals should consider snr_after!? s3/n1 or s3/n2 ? which commands or functions should use in matlab in order compute snr_before , snr_after? thanks billion putting time on helping me. what know calculating snr before : snrbeforenoise = mean( signal .^ 2 ) / mean( noise .^ 2 ); and snr after : residual_noise = signal - noise_reduced_signal; snr_after = mean( signal .^ 2 ) / mean( residual_noise .^ 2
Read more

c# - Attempting to upload to FTP: System.Net.WebException: System error -

-
i have api takes in xml , uploads files based on information in xml. uploads on schedule (also xml), , have tested surrounding , know works. i getting error 40% of time on first file attempt upload in each time cycle (time cycle = 45 minutes files, 30 minutes others). here code upload: try { loggerftp.log("uploading file: " + filename, false); // create request. ftpwebrequest request = (ftpwebrequest)webrequest.create(appsettingsftp.ftpurl + @"/" + filename); request.method = webrequestmethods.ftp.uploadfile; request.timeout = 6000000; //set 100 minutes //request.timeout = -1; //set infinite // add login credentials. request.credentials = new networkcredential(appsettingsftp.ftplogin, appsettingsftp.ftppassword); // grab file contents. streamreader sourcestream = new streamreader(appsettingsftp.uploadfiledirectory + filename); byte[] filecontents = encoding.utf8.getbytes(sourcestream.readtoend()); sourcest
Read more

ios - UISlider customization: how to properly add shadow to custom knob image -

-
Image
i need place custom knob image shadow uislider. far have image of 38x38, of there region defines shadow of knob. now while using image, when slide knob extreme ends actual knob not able cover end points, hence end points visible under transparent region of knob image this code using customize uislider uiimage *slidebtimg = [uiimage imagenamed:sliderknobimg]; [self.ratingslider setthumbimage:slidebtimg forstate:uicontrolstatenormal]; [self.ratingslider setthumbimage:slidebtimg forstate:uicontrolstatehighlighted]; how can implement custom knob shadow beneath it, covering end points?? look inside uislider.h , there methods let customize slider knob , track needed. (ios 2.0 , above) // lets subclass lay out track , thumb needed - (cgrect)minimumvalueimagerectforbounds:(cgrect)bounds; - (cgrect)maximumvalueimagerectforbounds:(cgrect)bounds; - (cgrect)trackrectforbounds:(cgrect)bounds; - (cgrect)thumbrectforbounds:(cgrect)bounds trackrect:(cgrect)rect value:
Read more