Skip to main content
Question

The CSV file generated from an FME workbench when loaded to an SQL Server table has unwanted characters attached to the first row first column value, 


File Encoding is Unicode 8-bit.

Tried changing the Write Byte Order Mark for Unicode to 'NO'. Still facing the same issue.

Cannot make any changes to the receiver of this file. Can you please suggest how to get rid of these characters?

 

Thanks

sresree

7 replies

redgeographics
Celebrity
Forum|alt.badge.img+49

Can you check the source data going in to the workspace, are those characters present there as well?


  • Author
  • August 31, 2022

No they are not present in the source data. If a header is added, these characters are added to the first header. It is always added to the first row first column value.


redgeographics
Celebrity
Forum|alt.badge.img+49
sresree wrote:

No they are not present in the source data. If a header is added, these characters are added to the first header. It is always added to the first row first column value.

Can you share screenshots of what it looks like in Visual Preview in FME Workbench as well as in Notepad or some other text editor?


  • Author
  • August 31, 2022

Hi,

 

Thank you for looking into this.

 

I can confirm that these characters are not visible when viewing the data in FME workbench or when opening the file in Notepad/Excel.

 

If the CSV is imported to Excel and then saved as CSV and loaded to the SQL server table, these characters are not found in the first row, first column.

 

Thanks

sresree


redgeographics
Celebrity
Forum|alt.badge.img+49
sresree wrote:

Hi,

 

Thank you for looking into this.

 

I can confirm that these characters are not visible when viewing the data in FME workbench or when opening the file in Notepad/Excel.

 

If the CSV is imported to Excel and then saved as CSV and loaded to the SQL server table, these characters are not found in the first row, first column.

 

Thanks

sresree

Hmmm... I wonder if it's maybe a SQL Server issue then.


  • Author
  • August 31, 2022

Hi,

 

If the CSV generated by FME workbench is imported to Excel and then saved as CSV and loaded to the SQL server table, these characters are not found in the first row, first column. What does that suggest?

 

Thanks

sresree


Forum|alt.badge.img+2
  • August 31, 2022

@sresree​ FME is adding a BOM (Byte Order Mark) that your SQL Server doesn't recognize. Try changing the Character Encoding on the CSV writer parameters

image


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings