Python College

Problem I have a large (> 500e6 rows) dataset that I've put into a pytables database. Lets … Read more Finding A Duplicate In A Hdf5 Pytable With 500e6 Rows

I am storing a pandas dataframe as a pytable which contains a MultiIndex. The first level of the M… Read more Pandas Pytable: How To Specify Min_itemsize Of The Elements Of A Multiindex

I have following data (18,619,211 rows) stored as a pandas dataframe object in hdf5 file: … Read more Query Hdf5 In Pandas

In many DataFrame.to_foo functions I can specify that I don't want to write the index >>&… Read more Store Pandas Dataframe In Pytables Table Without Storing Index

I have a DataFrame in Pandas: In [7]: my_df Out[7]: Int64Index: 34 entries, 0 to 0 Columns: 2661 … Read more Unable To Save Dataframe To Hdf5 ("object Header Message Is Too Large")

I'm trying to install PyTables 2.3.1 on Windows XP with Python 2.5. I'm getting the followi… Read more Pytables 2.3.1 With Python 2.5 On Windows: Error - Could Not Find A Local Hdf5 Installation

I have a large HDFStore with a multi-index. How can I get a hold of one of the index levels? I see … Read more How To Access Index In A Pandas Hdstore (pytables)

I have a very large csv data. It looks like this. [Date, Firm name, value 1, value 2, ..., value 60… Read more I Want To Convert Very Large Csv Data To Hdf5 In Python