Add pagination, do not load everything into memory

[denisovlev]

I was looking at the code and it seems that all the records from the file are loaded into memory. Some files can be quite large.
Perhaps adding pagination and not loading everything into memory would be better?

[Eugene-Mark]

@denisovlev Yes for sure, it's in the to-do list. It's welcomed if you're interested to contribute on it.

[Eugene-Mark]

Close it since it's over years, will reopen it if the feature is in the roadmap.