Visual LANSA Forum

HI again,

I need to write a functionality that

• reads a XML file in an IFS folder
  detects possible erros in the single lines
  corrects these errors and
  writes back the corrected XML file into the original IFS folder.

I plan to realize this with TRANSFORM_FILE, read the list data, correct them, write the correct data into a second list and at last create anew XML using TRANSFORM_LIST.

My question is:
The XML file can contain up to 30 million lines.
Documentation says: The special value ENTRIES(*MAX) is provided to represent 2,147,483,647. Using this value on some operating systems, like 32-bit Microsoft Windows versions, will overflow available memory in a process if an attempt is made to add the maximum number of entries.

Is this also valid when using a Reusable Part (RDMLX) on IBMi?
Or is there a better / other way to handle such big files?

Best regards,
Jörg

Hi Joerg

Not sure about the 30 million records but using the filestream, streamreader, streamwriter is faster.

viewtopic.php?f=3&t=2902&p=8888&hilit=Prim_file#p8888

Kind regards

Hi Dino,

thank you, I genrally got it running with StreamWriter.

Now I have another problem:

original file contains German umlauts like ä,ö,ü
when I read the lines and write it into my new file these signs are gone

Original xml - read by StreamReader
Define_Com Class(#PRIM_IOC.FileStream) Name(#InFileStream)
Define_Com Class(#PRIM_IOC.StreamReader) Name(#StreamReader) Stream(#InFileStream)
<LBez2>geraute Schlagfläche magn. Nagelhalter</LBez2>
<LBez1_ph>Picard Latthammer</LBez1_ph>
<LBez2_ph>geraut,Vergütungsstahl,magn. Nagelhalter</LBez2_ph>

New xml -written using StreamWriter
Define_Com Class(#PRIM_IOC.FileStream) Name(#FileStream)
Define_Com Class(#PRIM_IOC.StreamWriter) Name(#StreamWriter) Stream(#FileStream)
<LBez2>geraute Schlagflche magn. Nagelhalter</LBez2>
<LBez1_ph>Picard Latthammer</LBez1_ph>
<LBez2_ph>geraut,Vergtungsstahl,magn. Nagelhalter</LBez2_p

Can this be solved?

Best regards,
Joerg

Check the CCSID and/or change it using the chgatr command

At the moment I am still testing it on my Windows 10 PC. Can anything be done using utf8 or something like this?