You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I've been trying to get ~40GB of government reports into the Archive, as detailed in unitedstates/inspectors-general#63. It's a Python 3 project, so I've been running up against some hurdles.
Annoying, but not a dealbreaker, is that I can't use the [speedups] tag in my requirements.txt, because gevent is not compatible with Python 3. I see you're working on a refactor to use asyncio, which I 👍'd in Use trollius (asyncio) instead of gevent. #75 (comment) and would be very helpful.
A bigger problem is that the uploader and request object do some unicode encoding/decoding stuff that doesn't exist in Python 3 (because all strings are unicode strings) and is depending on __iter__not being defined on str (in Python 3, it is).
I resoved 2. with a surgical but ugly hack, which you can see in this branch compare, and so now I'm working off of my fork for the time being.
To make the uploader work under Python 3 and still work under Python 2 will require a bit more work than my hack, but it should be possible.
The text was updated successfully, but these errors were encountered:
konklone
added a commit
to unitedstates/inspectors-general
that referenced
this issue
Nov 2, 2014
I've been trying to get ~40GB of government reports into the Archive, as detailed in unitedstates/inspectors-general#63. It's a Python 3 project, so I've been running up against some hurdles.
[speedups]
tag in myrequirements.txt
, becausegevent
is not compatible with Python 3. I see you're working on a refactor to use asyncio, which I 👍'd in Use trollius (asyncio) instead of gevent. #75 (comment) and would be very helpful.__iter__
not being defined onstr
(in Python 3, it is).I resoved
2.
with a surgical but ugly hack, which you can see in this branch compare, and so now I'm working off of my fork for the time being.To make the uploader work under Python 3 and still work under Python 2 will require a bit more work than my hack, but it should be possible.
The text was updated successfully, but these errors were encountered: