Solved

CSV Error!

  • 12 July 2019
  • 2 replies
  • 36 views

Badge

Can anyone tell me what kind of error this is?

CSV reader: Detected excess data and/or delimiters in addition to the defined schema in line 3523 with value '3.53,0,3.53,0,0,0,0,3.53,0,0,0,130299203063,258,201903,0,0,0,0,0,0,0,0,0,0,0,0,0,3.5682002,2302,201903,0,0,89.33,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,42.3025,-83.40304' read from file 'P:\Office Depot\FME Workflows\Local Update Workflows\Sales by BG by Store\Workspace Runner - 7h\3. Workspace Runner\Outputs\Sales_by_Store_by_BG2.csv'.  Excess data will not be read.  This can occur if the file is not uniform in the number of fields per row or if fields have been intentionally removed from the source feature type.  In order to read the excess data, recreate the source feature type and set a larger value for the 'Maximum Rows to Scan' option to scan additional rows for fields.  If the file contains field names, ensure that the field names line represents all of the columns in data rows, or enable the 'Scan for Additional Fields' option.  This may also be caused by a misplaced field qualifier character.  In this case, ensure that field qualifiers in the row are correct, or consider changing the Field Qualifier Character value

 

icon

Best answer by hollyatsafe 12 July 2019, 22:57

View original

2 replies

Badge +2

Hi @trungn1993,

This warning occurs when you have data that does not fall under one of the Attribute Names (schema).

E.g. in my CSV file I have:

 

a,b,c

1,2,3,

4,5,6,7,8,9

 

values 7,8,9 are 'excess data' not defined in Field Names Line 1 meaning they won't be read in. If you need these values to be read in right click on your Reader under the Navigation Panel and select 'Update Reader' then, under Advanced >Schema Definition make Scan for Additional Fields = Yes.

 

Before:

After:

Userlevel 1
Badge +21

I've encountered this error when the delimiter is set to auto rather than specified rather than when there are excess fields. Setting the delimiter solved the issue

Reply