I have a problem with CSV reader with FTP path in FME Desktop / FME server 2015.1.
My goal is to watch an FTP server for new files, when a new file comes in, test the name for today’s date and the extension for .csv, do some manipulation to that file and put the data in a database. Once it is done, I want to trigger a job on the database.
As for now, I have a watcher on my FTP server which triggers a workbench that tests the name of the file and launch another workbench with an fmeServer_JobSubmitter. This workbench has a csv reader that takes the FTP path of the file and reads the file. It does the manipulations and put the result in the database. Then, the original workbench triggers the job on the database.
I have around 150 files to load every morning and it works for around 140-145 of them every time, but there are a few files that don’t work for a mysterious reason.
For the files that didn’t work, I tried the use the same JSON received by the watcher in the “test topic” section and it works. I compared the log files of the job that I ran with the “test topic” and the one that failed initially and in the job that works, I see this info:
CSV Reader: Opening CSV files in folder `C:\\Windows\\TEMP\\fmeengines\\VL-MH-GIS102_Engine1\\__swizzled_url_1443705296930_21796/\\'
But in the job that fails, I see the following warning instead:
CSV Reader: Failed to read the specified file(s) in the folder 'ftp://<user>:<password>@<IP>/%2F<relative path> /<filename>\\'
Do you have any idea what could cause my problem? Or do you have any suggestions on how I could achieve my goal differently?
Thank you very much for your time!
