Skip to main content

Hello "Safers"

 

Migrated from latest 2022 build to 2023 2 days ago.

Noticed that some of my scheduled Automations failed and the issue is linked to the Excel Writer (The Writer itself or FeatureWriter)

 

These workspaces have, obviously, worked prior to the upgrade for some time now.

The Server log outputs the following for one of the workspace (Same error for the other workspace):

-----------------------------------------------------------------------------------------------

59 2023-6-19 10:01:01 | Emptying factory pipeline

60 2023-6-19 10:01:02 | OneDriveConnector: Downloading file "MO-Emails.json" to specified folder "E:\\FME Workbench\\Planning Support\\LetterOfRepresentations\\JSON-Input"

61 2023-6-19 10:01:02 | Creating reader for format: JSON (JavaScript Object Notation)

62 2023-6-19 10:01:02 | Trying to find a DYNAMIC plugin for reader named `JSON'

63 2023-6-19 10:01:02 | Loaded module 'JSON' from file 'E:\\FMEFlow\\Server\\fme\\plugins/JSON.dll'

64 2023-6-19 10:01:02 | FME API version of module 'JSON' matches current internal version (4.0 20230418)

65 2023-6-19 10:01:02 | Performing query against JSON dataset `E:\\FME Workbench\\Planning Support\\LetterOfRepresentations\\JSON-Input\\MO-Emails.json'

66 2023-6-19 10:01:02 | Creating reader for format: JSON (JavaScript Object Notation)

67 2023-6-19 10:01:02 | Trying to find a DYNAMIC plugin for reader named `JSON'

68 2023-6-19 10:01:02 | Opening the JSON reader with source dataset 'E:\\FME Workbench\\Planning Support\\LetterOfRepresentations\\JSON-Input\\MO-Emails.json'

69 2023-6-19 10:01:02 | Creating writer for format:

70 2023-6-19 10:01:02 | Using MultiWriter with keyword `FeatureWriter' to output data (ID_ATTRIBUTE is `multi_writer_id')

71 2023-6-19 10:01:02 | Creating writer for format: Microsoft Excel

72 2023-6-19 10:01:02 | Trying to find a DYNAMIC plugin for writer named `XLSXW'

73 2023-6-19 10:01:02 | Loaded module 'XLSXW' from file 'E:\\FMEFlow\\Server\\fme\\plugins/xlsx.dll'

74 2023-6-19 10:01:02 | FME API version of module 'xlsx' matches current internal version (4.0 20230418)

75 2023-6-19 10:01:02 | FME Configuration: No destination coordinate system set

76 2023-6-19 10:01:02 | Writer `FeatureWriter_0' of type `XLSXW' using group definition keyword `FeatureWriter_0_DEF'

77 2023-6-19 10:01:02 | Excel Writer: Use Attribute Names As Column Positions is set to 'no' for sheet 'Output' in dataset '\\\\...\\shared\\Planning\\Letters of Representation\\Letters_Of_Rep.xlsx'

78 2023-6-19 10:01:02 | Excel Writer: Deleted existing destination file '\\\\...\\shared\\Planning\\Letters of Representation\\Letters_Of_Rep.xlsx'

79 2023-6-19 10:01:02 | Excel Writer: Opening dataset '\\\\...\\shared\\Planning\\Letters of Representation\\Letters_Of_Rep.xlsx'...

80 2023-6-19 10:01:02 | Excel Writer: Failed to open the dataset '\\\\...\\shared\\Planning\\Letters of Representation\\Letters_Of_Rep.xlsx'. Error message was 'No such file or directory.'

81 2023-6-19 10:01:02 | XLSXW writer: An error has occurred. Check the logfile above for details

82 2023-6-19 10:01:02 | Closing the JSON reader

83 2023-6-19 10:01:02 | PythonFactory output feature was rejected downstream. Check the logfile above for details

84 2023-6-19 10:01:02 | An error has occurred. Check the logfile above for details

85 2023-6-19 10:01:02 | Error encountered while calling method `input'

86 2023-6-19 10:01:02 | OneDriveConnector_CALLER (PythonFactory): PythonFactory failed to process feature

87 2023-6-19 10:01:02 | Excel Writer: Saving changes to dataset '\\\\...\\shared\\Planning\\Letters of Representation\\Letters_Of_Rep.xlsx'

88 2023-6-19 10:01:02 | Excel Writer: Workbook contains 5 fonts and 21 cell formats after writing

89 2023-6-19 10:01:02 | Excel Writer: Dataset '\\\\...\\shared\\Planning\\Letters of Representation\\Letters_Of_Rep.xlsx' contains no data and is therefore not a valid Excel file. No file will be created

90 2023-6-19 10:01:02 | XLSXW writer: An error has occurred. Check the logfile above for details

91 2023-6-19 10:01:02 | Translation FAILED with 8 error(s) and 0 warning(s) (0 feature(s) output)

92 2023-6-19 10:01:02 | FME Session Duration: 1.8 seconds. (CPU: 0.3s user, 0.4s system)

93 2023-6-19 10:01:02 | END - ProcessID: 11224, peak process memory usage: 106188 kB, current process memory usage: 86616 kB

-----------------------------------------------------------------------------------------------

The Excel Writer is set to "Overwrite". It is deleting the file then not finding it again I think. Same rule applied to the worksheet.

 

Workspace:

imageFeatureWriter setting:

image

The following screenshot shows that the workspace worked then failed which is somewhat confusing.

It is scheduled to run every hour between 08:00 and 16:00 / Mon-Fri

 

image 

If I set Overwrite to "No" then it seems to work.

image


The following screenshot shows that the workspace worked then failed which is somewhat confusing.

It is scheduled to run every hour between 08:00 and 16:00 / Mon-Fri

 

image 

If I set Overwrite to "No" then it seems to work.

image

Hello @sameer​, thanks for posting! Unfortunately this is a known issue in FME Form (FMEENGINE-78316). To workaround this issue for the time being, is it possible to disable 'overwrite existing file' on the Excel Writer, writing a new spreadsheet each time? Otherwise, you can roll back to FME 2022.2.5, where the issue was not present (Downloads Page). I'll make sure to update this thread when a fix is available! Happy to help, Kailin.


Hello @sameer​, thanks for posting! Unfortunately this is a known issue in FME Form (FMEENGINE-78316). To workaround this issue for the time being, is it possible to disable 'overwrite existing file' on the Excel Writer, writing a new spreadsheet each time? Otherwise, you can roll back to FME 2022.2.5, where the issue was not present (Downloads Page). I'll make sure to update this thread when a fix is available! Happy to help, Kailin.

Hello @kailinatsafe​ , thanks for the update.

That's what I've done in the end as well. Set Overwrite to No. In some cases I had to remove / add the Writer and reconfigure.

PS: On a different note but still related, the hyperlink "Workarounds to Known Issues" points to "https://community.safe.com/s/article/Known-Issues-in-FME-2022-x" and not 2023.

I replaced the "2" in 2022 within the URL to "3" and ended in the 2023 page but did not find FMEENGINE-78316.

Do you mind looking into this please? That page is an excellent point of reference overall.


Hello @sameer​, thanks for posting! Unfortunately this is a known issue in FME Form (FMEENGINE-78316). To workaround this issue for the time being, is it possible to disable 'overwrite existing file' on the Excel Writer, writing a new spreadsheet each time? Otherwise, you can roll back to FME 2022.2.5, where the issue was not present (Downloads Page). I'll make sure to update this thread when a fix is available! Happy to help, Kailin.

Hello @sameer​, I'm glad you were able to workaround it for the time being! I've just updated the Known Issues in FME 2022-x article to include FMENGINE-78316, but here is the 2023-x article as well! Best, Kailin.


Reply