Add the functionality so that fme can read a csv with quote (or other character) escaped fields that contain linebreaks.
Released
Add ability to read csv with linebreaks
This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.
This has been completed and you can test the change in FME 2017 betas with the updated CSV reader. You'll have to add a new CSV reader to your workspace to access the new functionality. So, if you have a CSV record something like:
abc, 123, "string value <lf> more text",pqr
FME 2017 will treat this as a single line. In FME 2016 and earlier, the CSV reader would interpret the <lf>, linefeed, as a new line and return two records:
abc, 123, "string value
more text",pqr
If you still have to use FME 2016 or earlier, there is a a workspace,FixCSVPython.fmw, you can use to pre-process your CSV files to remove the embedded linefeed available in this article
fixcsvpython.fmw
+1This has been released as part of FME 2017.0 . Visit http://www.safe.com/downloads to download it and give it a spin.
+8- Contributor
Excellent! My source (BOEM) changed from .MDB (encapsulated cell for narratives) to comma delimited ASCII......and refused to remove carriage returns. Asked me to open in Excel as intermediate. Hah. Was just about to ask you guys for this, but found it here on this lazy Sunday. Thank you, Safe!
Login to the community
No account yet? Create an account
An FME Account is required to contribute
LoginEnter your E-mail address. We'll send you an e-mail with instructions to reset your password.