Skip to main content
Question

Generic reader/Workspace Resource not working in FME Cloud

R
Forum|alt.badge.img

Hi all

I've got a simple workspace that's using a generic reader to read an input shapefile or csv file. I've added a csv reader as a workspace resource so that I can set the csv reader parameters and apply them to the generic reader when the input file is csv.

Works fine when tested in Desktop. The column names come through as attributes as expected. When I publish the workspace to Cloud and run using the same data, it looks like the workspace resource is ignored, the csv reader parameter settings are not applied and the attribute names come through as col0, col1, col2, etc.

My FME versions are:

Desktop: FME(R) 2016.1.0.0 (20160419 - Byuild 16492 - WIN32)

Cloud: FME Server 2017.0.1.1 - Build 17291 - linux-x64

I've attached my test workspace and data.

Hopefully someone can test it to either confirm the issue or let me know if I'm doing something wrong.

Cheers

Rob

4 replies

lars_de_vries
Forum|alt.badge.img+10

In the screendump it looks like the CSV-file always have the same structure. There is an option 'Field names follow header' that is turned of. It might be the solution to turn it on.

I know that the Excel reader has an option to 'Apply current settings to additional files', but one is not available for CSV files. Also the CSV Reader has significantly changed in 2017, maybe that will solve your problem as well.

R
Forum|alt.badge.img
  • rkay
  • Author
  • July 6, 2017
lars_de_vries wrote:

In the screendump it looks like the CSV-file always have the same structure. There is an option 'Field names follow header' that is turned of. It might be the solution to turn it on.

I know that the Excel reader has an option to 'Apply current settings to additional files', but one is not available for CSV files. Also the CSV Reader has significantly changed in 2017, maybe that will solve your problem as well.

I've tested with the "Field names follow header' selected too and it made no difference. Also played with the Header Lines to Skip parameter and that didn't help either. It seems like the CSV Workspace Resource is completely ignored by the Generic reader.

 

 

G
Forum|alt.badge.img

Hi @rkay,

we were able to reproduce this issue and it looks like FME 2017 does not handle the Workspace resources, that were created in FME 2016, correctly. I filed a report to fix this and will let you know as soon as we have an update on this.

A possible workaround, for now, would be to open the workspace in FME Desktop 2017, remove the Workspace Resource and add the CSV Workspace Resource again. Now the workspace should work as expected once you publish it to FME Cloud.

Thanks for reporting this!

UPDATE:

This is currently not planned to be fixed, but here is another possible workaround:

Use 2016 to change the GENERIC reader's input format to CSV. Then, even when run with 2017 or later, the reader format and the workspace resource format will match.

R
Forum|alt.badge.img
  • rkay
  • Author
  • July 17, 2017
gerhardatsafe wrote:

Hi @rkay,

we were able to reproduce this issue and it looks like FME 2017 does not handle the Workspace resources, that were created in FME 2016, correctly. I filed a report to fix this and will let you know as soon as we have an update on this.

A possible workaround, for now, would be to open the workspace in FME Desktop 2017, remove the Workspace Resource and add the CSV Workspace Resource again. Now the workspace should work as expected once you publish it to FME Cloud.

Thanks for reporting this!

UPDATE:

This is currently not planned to be fixed, but here is another possible workaround:

Use 2016 to change the GENERIC reader's input format to CSV. Then, even when run with 2017 or later, the reader format and the workspace resource format will match.

Thanks @GerhardAtSafe

 

Reply


Helpful Members This Week

Community Stats

31,286
Posts
118,660
Replies
38,874
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.