Skip to main content
Solved

CSV Error!

  • July 12, 2019
  • 2 replies
  • 124 views
dataninja
Forum|alt.badge.img

Can anyone tell me what kind of error this is?

CSV reader: Detected excess data and/or delimiters in addition to the defined schema in line 3523 with value '3.53,0,3.53,0,0,0,0,3.53,0,0,0,130299203063,258,201903,0,0,0,0,0,0,0,0,0,0,0,0,0,3.5682002,2302,201903,0,0,89.33,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,42.3025,-83.40304' read from file 'P:\Office Depot\FME Workflows\Local Update Workflows\Sales by BG by Store\Workspace Runner - 7h\3. Workspace Runner\Outputs\Sales_by_Store_by_BG2.csv'.  Excess data will not be read.  This can occur if the file is not uniform in the number of fields per row or if fields have been intentionally removed from the source feature type.  In order to read the excess data, recreate the source feature type and set a larger value for the 'Maximum Rows to Scan' option to scan additional rows for fields.  If the file contains field names, ensure that the field names line represents all of the columns in data rows, or enable the 'Scan for Additional Fields' option.  This may also be caused by a misplaced field qualifier character.  In this case, ensure that field qualifiers in the row are correct, or consider changing the Field Qualifier Character value

 

Best answer by hollyatsafe

Hi @trungn1993,

This warning occurs when you have data that does not fall under one of the Attribute Names (schema).

E.g. in my CSV file I have:

 

a,b,c

1,2,3,

4,5,6,7,8,9

 

values 7,8,9 are 'excess data' not defined in Field Names Line 1 meaning they won't be read in. If you need these values to be read in right click on your Reader under the Navigation Panel and select 'Update Reader' then, under Advanced >Schema Definition make Scan for Additional Fields = Yes.

 

Before:

After:

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

2 replies

H
Forum|alt.badge.img+2
  • hollyatsafe
  • Best Answer
  • July 12, 2019

Hi @trungn1993,

This warning occurs when you have data that does not fall under one of the Attribute Names (schema).

E.g. in my CSV file I have:

 

a,b,c

1,2,3,

4,5,6,7,8,9

 

values 7,8,9 are 'excess data' not defined in Field Names Line 1 meaning they won't be read in. If you need these values to be read in right click on your Reader under the Navigation Panel and select 'Update Reader' then, under Advanced >Schema Definition make Scan for Additional Fields = Yes.

 

Before:

After:

christian_dan
ebygomm
Influencer
Forum|alt.badge.img+45
  • ebygommInfluencer
  • Influencer
  • July 18, 2019

I've encountered this error when the delimiter is set to auto rather than specified rather than when there are excess fields. Setting the delimiter solved the issue

Community Stats

32,120
Posts
121,954
Replies
39,772
Members

Latest FME

Terms & ConditionsCookie settingsAccessibility statement
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.