Question

FME doesn't read csv file properly. Most of the attribute values appear as "Null"


I have few huge csv files (each has nearly 10 millions rows) that I wanted to process in FME. However, FME can't read them properly. For most of the rows, one of the column's values appear to be "Null". Hence I am not able to read the values and join the values with other files.

 

I have tried FME 2020 and FME 2021 but none of them can read the csv properly.

 

Has anyone ever encounter this issue?


3 replies

Userlevel 6
Badge +32

Sounds like this problem?

Userlevel 4

Are there any warnings in the log?

Also, I agree with @nielsgerrits​  that it might be that the reader schema is too restrictive. Perhaps consider defining all the CSV reader columns as text, that should let everything through.

Hi All,

Yes that's exactly the same issue as the topic in the link.

I had to change the field type to string so that FME can read them all. By default, FME assigned the field type to Unit8 which was too restrictive.

Thanks for your help.

Reply