Skip to main content
Solved

CSV Error!


dataninja
Forum|alt.badge.img

Can anyone tell me what kind of error this is?

CSV reader: Detected excess data and/or delimiters in addition to the defined schema in line 3523 with value '3.53,0,3.53,0,0,0,0,3.53,0,0,0,130299203063,258,201903,0,0,0,0,0,0,0,0,0,0,0,0,0,3.5682002,2302,201903,0,0,89.33,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,42.3025,-83.40304' read from file 'P:\Office Depot\FME Workflows\Local Update Workflows\Sales by BG by Store\Workspace Runner - 7h\3. Workspace Runner\Outputs\Sales_by_Store_by_BG2.csv'.  Excess data will not be read.  This can occur if the file is not uniform in the number of fields per row or if fields have been intentionally removed from the source feature type.  In order to read the excess data, recreate the source feature type and set a larger value for the 'Maximum Rows to Scan' option to scan additional rows for fields.  If the file contains field names, ensure that the field names line represents all of the columns in data rows, or enable the 'Scan for Additional Fields' option.  This may also be caused by a misplaced field qualifier character.  In this case, ensure that field qualifiers in the row are correct, or consider changing the Field Qualifier Character value

 

Best answer by hollyatsafe

Hi @trungn1993,

This warning occurs when you have data that does not fall under one of the Attribute Names (schema).

E.g. in my CSV file I have:

 

a,b,c

1,2,3,

4,5,6,7,8,9

 

values 7,8,9 are 'excess data' not defined in Field Names Line 1 meaning they won't be read in. If you need these values to be read in right click on your Reader under the Navigation Panel and select 'Update Reader' then, under Advanced >Schema Definition make Scan for Additional Fields = Yes.

 

Before:

After:

View original
Did this help you find an answer to your question?

2 replies

Forum|alt.badge.img+2
  • Best Answer
  • July 12, 2019

Hi @trungn1993,

This warning occurs when you have data that does not fall under one of the Attribute Names (schema).

E.g. in my CSV file I have:

 

a,b,c

1,2,3,

4,5,6,7,8,9

 

values 7,8,9 are 'excess data' not defined in Field Names Line 1 meaning they won't be read in. If you need these values to be read in right click on your Reader under the Navigation Panel and select 'Update Reader' then, under Advanced >Schema Definition make Scan for Additional Fields = Yes.

 

Before:

After:


ebygomm
Influencer
Forum|alt.badge.img+33
  • Influencer
  • July 18, 2019

I've encountered this error when the delimiter is set to auto rather than specified rather than when there are excess fields. Setting the delimiter solved the issue


Reply


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings