x80\x02]q\x00(c__main__\nDocument\nq\x01)\x81q\x02}q\x03(U\x04dateq\x04U\x051/1/1q\x05U\x04textq\x06U\x0bfoo is goodq\x07U\x05titleq\x08U\x03fooq\tubh\x01)\x81q\n}q\x0b(h\x04U\x052/2/2q\x0ch\x06U\rbar is betterq\rh\x08U\x03barq\x0eubh\x01)\x81q\x0f}q\x10(h\x04U\x053/3/3q\x11h\x06U\x13no one likes baz :(q\x12h\x08U\x03bazq\x13ube.' What I did is that I started up a big instance with enough memory in cloud hosting provider (price is not much if started only for small amount of time like few hours), uploaded that file over SSH (SCP) to that server and simply loaded it on that instance to analyze it there + re-write it into more suitable format. OK, so we need to stream the file until we hit a '\81' bytes ( NEWOBJ). Then, we need to scan forward until we hit a '(' ( MARK) character. Then, until we hit a 'u' ( SETITEMS), we read pairs of key/value strings - there should be 3 pairs total, one for each field. Anyways, for this answer I'm assuming your Document class looks a bit like this. If not, comment with your actual Document class: class Document(object): # <-- object part is very important! If it's not there, the format is different! Anyways, I made some simple test data with this class: d = [Document(title='foo', text='foo is good', date='1/1/1'), Document(title='bar', text='bar is better', date='2/2/2'), Document(title='baz', text='no one likes baz :(', date='3/3/3')]

Big Pickle: Pickleball… | Friends of the Children - Austin The Big Pickle: Pickleball… | Friends of the Children - Austin

A little morning rain gave way to sunshine and beautiful warm weather at Dreamland, and our team was eager to welcome guests for a fun afternoon. You could feel the enthusiasm and positive energy on and off the courts. DJ David Garza kept us all in the groove. Everyone enjoyed delicious food from Taco Deli, Little Ola's Biscuits, Snarf's Sandwiches, Easy Tiger and GoodPop. Drinks were flowing from Rambler Sparking Water, Sap's Clubby Seltzers, Austin Beerworks, Progress Coffee, Ranch Rider Spirits, and BOXT. Supergoop saved us from sunburns. The space looked so festive thanks to Pop & Drop, The Essential Market, Whim Hospitality, and Panacea. American Sweets has been one of the UK's largest suppliers of American Sweets, Soda and Groceries for the last 10 years and continues to offer the very best range of products at the lowest prices. Also, another complication! There's more than just SHORT_BINSTRING - there's normal BINSTRING for strings > 256 bytes, and also some fun unicode variants as well. I'll just assume that you're using Python 2 with all ASCII strings. Again, comment if this isn't a correct assumption. When whole grain is the first ingredient you know you're in for a bowl full of tasty goodness. Naturally flavoured with real cocoa and cinnamon this Chocolate Toast Crunch Cereal will get anyone out o... The aim is to expand to 40 courts by spring and to enclose some of the courts in time for winter so that the courts can be enjoyed whatever the weather.Re-crawl the original data, this time actually incrementally storing the data, or storing it in a database. Document {'date': '2/2/2', 'text': 'bar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is betterbar is better', 'title': 'bar'}