How to parse large text-files

Question

Hi,

I am writing an application where I need to
- read data from one textfile
- do some processing
- write processed data to a new textfile.

I am using a streamreader for reading the whole textfile at once, then performing the processing in one step, and then writing all data to the new textfile.

This works fine until I try to process files bigger then about 100MB. Then, with bigger files, the prog. crashes and throws an "Out of memory exception".

Anyone who know how to get around this problem?


Thanks in advance,

Jorn