This will make it possible to process the streams more incrementally, avoiding having to process large chunks at once.