One big friend of Big data is the HDF5 format.

It is perfect for handling a huge amount of data.

Pandas library has a method that will help you read HDF5 format.

Using Pandas read_hdf() method you can read HDF5 files like so:

# Import the Pandas library
import pandas as pd

# We read the dataframe from a hdf5 format
pd.read_hdf("my_df.h5")

Here you are! You now know how to read a DataFrame in HDF5 format!

More on DataFrames

If you want to know more about DataFrame and Pandas. Check out the other articles I wrote on the topic, just here :

Pandas - The Python You Need

We gathered the only Python essentials that you will probably ever need.

The Python You Need