[Ilugc] Opening huge files

kish realmailer at gmail.com
Sat Oct 30 01:39:55 IST 2010


On Sat, 2010-10-30 at 01:06 +0530, Shrinivasan T wrote:
> Friends.
> 
> I have to work on some huge text files that are around 2GB - 10GB.
> Are there any other ways?
 
Until someone more knowledgeable answers here goes, 
I've had experience with ETL tools that can handle such data with 
amazing ingenuity. Though some prior knowledge of the structure in data
is expected. 

>From the top of my head I can think of splitting the file and doing
manual inspection.

What kind of data are you working with?




More information about the ilugc mailing list