I have a 2GB .ebc file that I need to pull in for transformation. The file has COMP-3 packing set for multiple (but not all) fields.
I've tried pulling this file in as a raw text file with default encoding, which results in one extremely long string record that crashes Inspector due to lack of memory.
When I try pulling it in via the included EBCDIC US (ibm037) encoding, it sees 100,000+ records but I again run into memory issues on the first record so I cannot see if the reader was truly successful.
Is there some trick to reading EBCDIC COMP-3 packed data that I'm missing? Or is this something that requires extra external processing work prior to ingesting the data into FME?