How to deal with a massive feeder file?

Is it possible to have a really large CSV file (500 megs), and not have to read the whole thing into RAM at once?

You have to write your own Feeder, but how course, you won’t be able to have a “random” strategy, and “circular” would require some trick.

You can start with something based on java.io.FileReader with some appropriate buffering. Then, if you experience some hiccups when reaching the end of a buffer, you might want to consider some read ahead background loading strategy.

Cheers,