Skip to main content
Released

CSV reader to guess delimiter

Related products:FME Form
  • March 27, 2017
  • 5 replies
  • 80 views

todd_davis
Influencer
Forum|alt.badge.img+23

While the csv reader can have a delimiter specified, it would be great if a setting was introduced that would allow the CSV Reader to guess the delimiter of the supplied file (just in the same way generic reader can guess a format).

This way the similar files using different delimiters could be read without the CSV delimiter needing to be pasted by early processing to guess the delimiter.

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

5 replies

tim_wood
Contributor
Forum|alt.badge.img+8
  • Contributor
  • March 27, 2017

What are valid delimiters? As per Excel (comma, tab, semi-colon, space)?

If FME is guessing the delimiter it increases the risk of mistaking a value for a delimiter so it would be more important to encapsulate values in quotes.


todd_davis
Influencer
Forum|alt.badge.img+23
  • Author
  • Influencer
  • March 27, 2017
Yeah, initially, just the ones that FME list in the drop-down as default. But if you wanted to take it further, in most situation it should be possible, because the number of delimiters should be the same on each row (like you mention, you would need to exclude encapsulated values in quotes).

 

 


debbiatsafe
Safer
Forum|alt.badge.img+22

This idea was implemented in FME 2019--the CSV reader now has an 'Auto' option in the Delimiter Character reader parameter! FME will automatically guess the delimited character if Auto is selected and this option is also the default value for the Delimiter Character parameter.

Should this feature or its implementation not address your concerns, please let us know by leaving a comment.


helmoet
Forum|alt.badge.img+8
  • July 7, 2020

Hi compliments for this nice idea. Wanted to upvote.


tomf
Supporter
Forum|alt.badge.img+23
  • Supporter
  • February 3, 2021

This still needs work — adding the Crime csv from the Basic training course into a 2020.1 CSV reader still requires the delimiter to be set to <comma>. <Auto> does NOT separate the columns:

<edited for correct screenshot!>

'>