[pytables-users] Attributes on rows and columns?

[Joshua Orvis]

I'm not sure if this is a good fit for HDF5, but we have data this is a
large matrix (50,000 columns by 100,000 rows) and have metadata associated
with each row and column. I see how to store metadata on the table as a
whole, and even on individual matrix cells (if they are named types), but
can't find examples of how to store metadata/attributes on columns or rows.
Is this possible?

Thanks -

[Francesc Alted]

Hi Joshua,

Trying to fit a large matrix into a Table is not a good idea. For a matrix
I'd use a CArray (for immutable dimensions) or a EArray (the array can be
expanded in one dimension). The Table is more meant for hosting objects
with columns with heterogeneous types, while keeping the length of the
columns relatively low (say, < 10,000).

And no, you cannot store attributes on neither columns or rows, but rather
in the matrix as a whole. But you can always create a sibling array with
the metadata that you want to store.

Francesc

Post by Joshua Orvis
I'm not sure if this is a good fit for HDF5, but we have data this is a
large matrix (50,000 columns by 100,000 rows) and have metadata associated
with each row and column. I see how to store metadata on the table as a
whole, and even on individual matrix cells (if they are named types), but
can't find examples of how to store metadata/attributes on columns or
rows. Is this possible?
Thanks -
--
You received this message because you are subscribed to the Google Groups
"pytables-users" group.
To unsubscribe from this group and stop receiving emails from it, send an
For more options, visit https://groups.google.com/d/optout.

[Joshua Orvis]

Thank you for that response, which saves me from chasing down blind paths
and directs me where to look instead. I'll save any further follow up
until I've tried working through the CArray version.

Post by Francesc Alted
Hi Joshua,
Trying to fit a large matrix into a Table is not a good idea. For a
matrix I'd use a CArray (for immutable dimensions) or a EArray (the array
can be expanded in one dimension). The Table is more meant for hosting
objects with columns with heterogeneous types, while keeping the length of
the columns relatively low (say, < 10,000).
And no, you cannot store attributes on neither columns or rows, but rather
in the matrix as a whole. But you can always create a sibling array with
the metadata that you want to store.
Francesc

Post by Joshua Orvis
I'm not sure if this is a good fit for HDF5, but we have data this is a
large matrix (50,000 columns by 100,000 rows) and have metadata associated
with each row and column. I see how to store metadata on the table as a
whole, and even on individual matrix cells (if they are named types), but
can't find examples of how to store metadata/attributes on columns or
rows. Is this possible?
Thanks -
--
You received this message because you are subscribed to the Google Groups
"pytables-users" group.
To unsubscribe from this group and stop receiving emails from it, send an
For more options, visit https://groups.google.com/d/optout.

--
Francesc Alted
--
You received this message because you are subscribed to a topic in the
Google Groups "pytables-users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/
topic/pytables-users/s_Bcs_QFqD8/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
For more options, visit https://groups.google.com/d/optout.