I have few huge csv files (each has nearly 10 millions rows) that I wanted to process in FME. However, FME can't read them properly. For most of the rows, one of the column's values appear to be "Null". Hence I am not able to read the values and join the values with other files.
I have tried FME 2020 and FME 2021 but none of them can read the csv properly.
Has anyone ever encounter this issue?
Sounds like this problem?
Are there any warnings in the log?
Also, I agree with @nielsgerrits that it might be that the reader schema is too restrictive. Perhaps consider defining all the CSV reader columns as text, that should let everything through.
Hi All,
Yes that's exactly the same issue as the topic in the link.
I had to change the field type to string so that FME can read them all. By default, FME assigned the field type to Unit8 which was too restrictive.
Thanks for your help.