Skip to content Skip to sidebar Skip to footer
Showing posts with the label Hdf5
Finding A Duplicate In A Hdf5 Pytable With 500e6 Rows

Finding A Duplicate In A Hdf5 Pytable With 500e6 Rows

Post a Comment
Problem I have a large (> 500e6 rows) dataset that I've put into a pytables database. Lets … Read more Finding A Duplicate In A Hdf5 Pytable With 500e6 Rows
Creating Hdf5 Compound Attributes Using H5py

Creating Hdf5 Compound Attributes Using H5py

Post a Comment
I'm trying to create some simple HDF5 datasets that contain attributes with a compound datatype… Read more Creating Hdf5 Compound Attributes Using H5py
Query Hdf5 In Pandas

Query Hdf5 In Pandas

Post a Comment
I have following data (18,619,211 rows) stored as a pandas dataframe object in hdf5 file: … Read more Query Hdf5 In Pandas
Inexplicable Behavior When Using Vlen With H5py

Inexplicable Behavior When Using Vlen With H5py

Post a Comment
I am using h5py to build a dataset. Since I want to store arrays with different #of rows dimension,… Read more Inexplicable Behavior When Using Vlen With H5py
How To Store An Array In Hdf5 File Which Is Too Big To Load In Memory?

How To Store An Array In Hdf5 File Which Is Too Big To Load In Memory?

Post a Comment
Is there any way to store an array in an hdf5 file, which is too big to load in memory? if I do som… Read more How To Store An Array In Hdf5 File Which Is Too Big To Load In Memory?
Hdf5 Core Driver (h5fd_core): Loading Selected Dataset(s)

Hdf5 Core Driver (h5fd_core): Loading Selected Dataset(s)

Post a Comment
Currently, I load HDF5 data in python via h5py and read a dataset into memory. f = h5py.File('m… Read more Hdf5 Core Driver (h5fd_core): Loading Selected Dataset(s)