So the context is this; a zip file is uploaded into a web service and Python then needs extract that and analyze and deal with each file within. In this particular application what it does is that it looks at the file's individual name and size, compares that to what has already been uploaded in AWS S3 and if the file is believed to be different or new, it gets uploaded to AWS S3.
The challenge is that these zip files that come in are huuuge. The average is 560MB but...
Read the entire article at the source link...
http://codango.com/fastest-way-to-unzip-a-zip-file-in-python/
I am happy to share this resource that we found. The content displayed on this page is property of its original author or their organization.
No comments:
Post a Comment