« Event Driven Architectures in the wild | Main | Total lockdown »

June 13, 2006

Flat file parsing

Ok, I love flat files. I love them because I need to love them. Everywhere you go, you run into flat files. To be an XML purist is a painful plight. For such a dominant technology I am amazed that there isn't a java "best practices framework" for doing this. The number of times I've heard of people just writing "a little parser" for this simple flat file which turns into a monster java class that deals will all sorts of flat file vageries, is uncountable. In fact, there's a project right now at one of our client companies that is doing a full edi integration with java code and xslt.. the horror! the horror!

Anyhow, I've found a nice little engine that can. ServingXML seems to have created a generalised flat file processing engine. If you look at the example configurations you'll be amazed what it can do. Edifact no less!

ServingXML does a whole lot more, but the flat file bits are the bits that thrill me.




tags:

TrackBack

TrackBack URL for this entry:
http://www.typepad.com/services/trackback/6a00d834599a5f69e200d8349ab6a253ef

Listed below are links to weblogs that reference Flat file parsing:

Comments

I just discovered ServingXML and looking into it now. I am processing large flat data files from our customers and need to get them into a common format so we can run our validations on them. I've been able to do it with XSLT but with larger and more complicated files the memory requirements get rediculous (my processing requires more than 1 GB of RAM in this approach). So I was hoping ServingXML might be a solution but I havn't had any luck with finding reviews on people using it for large input files. I want to know what kind of memory requirements and speed ServingXML can do over the 'standard' XSLT transformation that I had been doing.

Anyone have experience in this area?

Verify your Comment

Previewing your Comment

This is only a preview. Your comment has not yet been posted.

Working...
Your comment could not be posted. Error type:
Your comment has been posted. Post another comment

The letters and numbers you entered did not match the image. Please try again.

As a final step before posting your comment, enter the letters and numbers you see in the image below. This prevents automated programs from posting comments.

Having trouble reading this image? View an alternate.

Working...

Post a comment