Question

SFTP File download "Failed Initialisation"

  • 19 September 2018
  • 9 replies
  • 30 views

Badge +3

Hi,

I know this has been partially answered here but it doesn't quite answer my exact issue.

I'm trying to use FTPCaller to download a file from an SFTP site but get the error 'Failed Initialisation'. FME will create the target file fine but with no data in it, and with the above error.

I have tested FTPCaller on other SFTP sites and it works fine.

I can download the file using Filezilla and I can also get the file download to work using the SystemCaller transformer to run a batch file which runs PuTTY (using a PSCP comand line). All with the same credentials.

All file permissions appear to be setup fine and I've tried changing every parameter in the FTPCaller with the exception of SSH-agent/Pageant authentication. Having already got it to run with PuTTY I didn't see any advantage to going down this route.

I'd really like to be able to do this directly with FME and not involve a third party package such as Pageant or PuTTY. Is this possible?

Thanks in advance,

Jake


9 replies

Userlevel 4
Badge +25
Is the message "Failed Initialisation" exactly, or is it slightly different like "Failed Initialization" with a "z", or the other way around as "Initialisation Failed"?

 

I can search our systems for information on that error, but "Failed Initialisation" doesn't return anything, so I wanted to make sure it is correct.

 

Badge +3

Hi Mark,

It's with a 'z' (I used the British spelling in the post). Sorry for the confusion.

Jake

Userlevel 4
Badge +25

Hi Jake

Can you turn on extra debugging (Tools > FME Options > Translation > Log Debug) and run that again? I think this may give extra information about what the exact cause is. I can see what error is being thrown but there are multiple causes (92) and I think (hope) that the additional logging will show up an extra message that tells us which of these it is.

So give that a try and if you can then post that section of log here, we might be able to figure it out.

Badge +3

Hi Jake

Can you turn on extra debugging (Tools > FME Options > Translation > Log Debug) and run that again? I think this may give extra information about what the exact cause is. I can see what error is being thrown but there are multiple causes (92) and I think (hope) that the additional logging will show up an extra message that tells us which of these it is.

So give that a try and if you can then post that section of log here, we might be able to figure it out.

Hi Mark,

 

I'm WFH so having to run through the our FME Server. Please see the log below:

 

 

oaded module 'FTPFactory' from file 'C:\\Program Files\\FMEServer\\Server\\fme\\plugins/FTPFactory.dll'FME API version of module 'FTPFactory' matches current internal version (3.8 20180604)Emptying factory pipelineFTPCaller(FTPFactory): FTP info: Trying ???.???.???.???...FTPCaller(FTPFactory): FTP info: TCP_NODELAY setFTPCaller(FTPFactory): FTP info: Connected to ???.???.???.???(???.???.???.???) port 22 (#0)FTPCaller(FTPFactory): FTP info: Failure establishing ssh sessionFTPCaller(FTPFactory): FTP info: Closing connection 0FTPCaller(FTPFactory): HTTP/FTP transfer error: 'Failed initialization'Creator_XML_Creator(CreationFactory): Created 1 features

 

I've replaced the sft address with "???.???.???.???"

 

 

From what little I know about these things I'm guessing this points to the need to use something like Pageant in order to do the SSH thing?

 

 

 

Jake

 

 

Userlevel 4
Badge +25
Hi Mark,

 

I'm WFH so having to run through the our FME Server. Please see the log below:

 

 

oaded module 'FTPFactory' from file 'C:\\Program Files\\FMEServer\\Server\\fme\\plugins/FTPFactory.dll'FME API version of module 'FTPFactory' matches current internal version (3.8 20180604)Emptying factory pipelineFTPCaller(FTPFactory): FTP info: Trying ???.???.???.???...FTPCaller(FTPFactory): FTP info: TCP_NODELAY setFTPCaller(FTPFactory): FTP info: Connected to ???.???.???.???(???.???.???.???) port 22 (#0)FTPCaller(FTPFactory): FTP info: Failure establishing ssh sessionFTPCaller(FTPFactory): FTP info: Closing connection 0FTPCaller(FTPFactory): HTTP/FTP transfer error: 'Failed initialization'Creator_XML_Creator(CreationFactory): Created 1 features

 

I've replaced the sft address with "???.???.???.???"

 

 

From what little I know about these things I'm guessing this points to the need to use something like Pageant in order to do the SSH thing?

 

 

 

Jake

 

 

Did you manage to turn on log debug on Server? I'm not sure how you'd do that and I think that really would provide more info. If that is with log debug on then, apologies, but I think you're going to have to file this with our support team and get a web services expert to look at the issue. I've looked a bit more and I just can't figure out what the cause is.

 

For support, see this page: https://www.safe.com/support/ - you can either file an issue or try LiveChat. I would file an issue since I doubt someone will be able to figure it out without some degree of investigation. Again, apologies that I couldn't solve the issue for you, but I'm sure one of our support team will be able to.

 

Badge +3
Did you manage to turn on log debug on Server? I'm not sure how you'd do that and I think that really would provide more info. If that is with log debug on then, apologies, but I think you're going to have to file this with our support team and get a web services expert to look at the issue. I've looked a bit more and I just can't figure out what the cause is.

 

For support, see this page: https://www.safe.com/support/ - you can either file an issue or try LiveChat. I would file an issue since I doubt someone will be able to figure it out without some degree of investigation. Again, apologies that I couldn't solve the issue for you, but I'm sure one of our support team will be able to.

 

 

Hi Mark,

 

 

Thanks for looking into this. I'll double check it all tomorrow in the office when I'm next in. The workspace, when running on desktop, didn't offer anything else up and it had the log debug on.

 

 

Cheers,

 

 

Jake

 

Badge +3

Hi Mark,

I'll log a support call anyhow, but here's the FTPCaller part of the log, run from my desktop, error logging enabled:

2018-09-25 08:22:32| 1.6| 0.1|INFORM|FTPCaller(FTPFactory): FTP info: Trying

???.???.???.???

...

2018-09-25 08:22:32| 1.6| 0.0|INFORM|FTPCaller(FTPFactory): FTP info: TCP_NODELAY set

2018-09-25 08:22:32| 1.6| 0.0|INFORM|FTPCaller(FTPFactory): FTP info: Connected to

???.???.???.??? (???.???.???.???) port 22 (#0)

2018-09-25 08:22:32| 1.6| 0.0|INFORM|FTPCaller(FTPFactory): FTP info: Failure establishing ssh session

2018-09-25 08:22:32| 1.6| 0.0|INFORM|FTPCaller(FTPFactory): FTP info: Closing connection 0

2018-09-25 08:22:32| 1.6| 0.0|ERROR |FTPCaller(FTPFactory): HTTP/FTP transfer error: 'Failed initialization'

2018-09-25 08:22:32| 1.6| 0.0|STATS |Storing feature(s) to FME feature store file `C:\\Users\\Jake\\AppData\\Local\\Temp\\wb-cache-InsightFTP-QN5164\\Main_FTPCaller -1 2 fo 1 _lt_REJECTED_gt_ 0 36ec0cac74035dffa6db55dd9ae52639cecff81c.ffsupdating'

2018-09-25 08:22:32| 1.6| 0.0|STATS |Creator_XML_Creator(CreationFactory): Created 1 features

2018-09-25 08:22:32| 1.6| 0.0|STATS |Creator_Cloner(TeeFactory): Cloned 1 input feature(s) into 1 output feature(s)

2018-09-25 08:22:32| 1.6| 0.0|INFORM|Creator_CREATED Feature Recorder -1 2147549188(RecorderFactory): Recorded 1 feature(s) to file `C:\\Users\\Jake\\AppData\\Local\\Temp\\wb-cache-InsightFTP-QN5164\\Main_Creator -1 4 fo 0 CREATED 0 d1ffccac7453c33da36733d97d56aa556e10e2f2.ffsupdating'

2018-09-25 08:22:32| 1.6| 0.0|STATS |Creator_CREATED Feature Counter -1 9(TeeFactory): Cloned 1 input feature(s) into 1 output feature(s)

2018-09-25 08:22:32| 1.6| 0.0|STATS |Creator_CREATED Brancher -1 9(BranchingFactory): Branched 1 input feature -- 1 feature routed to the target factory, and 0 features routed to the fallback factory.

2018-09-25 08:22:32| 1.6| 0.0|STATS |_CREATOR_BRANCH_TARGET(TeeFactory): Cloned 1 input feature(s) into 1 output feature(s)

2018-09-25 08:22:32| 1.7| 0.0|INFORM|FTPCaller_OUTPUT Feature Recorder -1 2147614722(RecorderFactory): Recorded 0 feature(s) to file `C:\\Users\\Jake\\AppData\\Local\\Temp\\wb-cache-InsightFTP-QN5164\\Main_FTPCaller -1 2 fo 0 OUTPUT 0 bf828f53e13fa154458202693f3a1460a918dc00.ffsupdating'

2018-09-25 08:22:32| 1.7| 0.0|STATS |Stored 1 feature(s) to FME feature store file `C:\\Users\\Jake\\AppData\\Local\\Temp\\wb-cache-InsightFTP-QN5164\\Main_FTPCaller -1 2 fo 1 _lt_REJECTED_gt_ 0 36ec0cac74035dffa6db55dd9ae52639cecff81c.ffsupdating'

2018-09-25 08:22:32| 1.7| 0.0|INFORM|Saving spatial index into file 'C:\\Users\\Jake\\AppData\\Local\\Temp\\wb-cache-InsightFTP-QN5164\\Main_FTPCaller -1 2 fo 1 _lt_REJECTED_gt_ 0 36ec0cac74035dffa6db55dd9ae52639cecff81c.fsi'

2018-09-25 08:22:32| 1.7| 0.0|INFORM|Finished saving spatial index into file 'C:\\Users\\Jake\\AppData\\Local\\Temp\\wb-cache-InsightFTP-QN5164\\Main_FTPCaller -1 2 fo 1 _lt_REJECTED_gt_ 0 36ec0cac74035dffa6db55dd9ae52639cecff81c.fsi'

2018-09-25 08:22:32| 1.7| 0.0|STATS |Stored 1 feature(s) to FME feature store file `C:\\Users\\Jake\\AppData\\Local\\Temp\\wb-cache-InsightFTP-QN5164\\Main_Creator -1 4 fo 0 CREATED 0 d1ffccac7453c33da36733d97d56aa556e10e2f2.ffsupdating'

2018-09-25 08:22:32| 1.7| 0.0|INFORM|Saving spatial index into file 'C:\\Users\\Jake\\AppData\\Local\\Temp\\wb-cache-InsightFTP-QN5164\\Main_Creator -1 4 fo 0 CREATED 0 d1ffccac7453c33da36733d97d56aa556e10e2f2.fsi'

2018-09-25 08:22:32| 1.7| 0.0|INFORM|Finished saving spatial index into file 'C:\\Users\\Jake\\AppData\\Local\\Temp\\wb-cache-InsightFTP-QN5164\\Main_Creator -1 4 fo 0 CREATED 0 d1ffccac7453c33da36733d97d56aa556e10e2f2.fsi'

2018-09-25 08:22:32| 1.7| 0.0|INFORM|FTPCaller_<REJECTED> Feature Recorder -1 2147680258(RecorderFactory): Recorded 1 feature(s) to file `C:\\Users\\Jake\\AppData\\Local\\Temp\\wb-cache-InsightFTP-QN5164\\Main_FTPCaller -1 2 fo 1 _lt_REJECTED_gt_ 0 36ec0cac74035dffa6db55dd9ae52639cecff81c.ffsupdating'

2018-09-25 08:22:32| 1.7| 0.0|STATS |FTPCaller_OUTPUT Feature Counter -1 2147614722(TeeFactory): Cloned 0 input feature(s) into 0 output feature(s)

2018-09-25 08:22:32| 1.7| 0.0|STATS |FTPCaller_<REJECTED> Feature Counter -1 2147680258(TeeFactory): Cloned 1 input feature(s) into 0 output feature(s)

2018-09-25 08:22:32| 1.7| 0.0|STATS |Destination Feature Type Routing Correlator(RoutingFactory): Tested 0 input feature(s), wrote 0 output feature(s): 0 matched merge filters, 0 were routed to output, 0 could not be routed.

2018-09-25 08:22:32| 1.7| 0.0|STATS |Final Output Nuker(TeeFactory): Cloned 0 input feature(s) into 0 output feature(s)

Hi Jake

Can you turn on extra debugging (Tools > FME Options > Translation > Log Debug) and run that again? I think this may give extra information about what the exact cause is. I can see what error is being thrown but there are multiple causes (92) and I think (hope) that the additional logging will show up an extra message that tells us which of these it is.

So give that a try and if you can then post that section of log here, we might be able to figure it out.

sftp download, I have got the same problem with error message "FTP/FTPS/SFTP transfer error: Failed initialization"

 

Any quick fix för this

Userlevel 1
Badge +15

sftp download, I have got the same problem with error message "FTP/FTPS/SFTP transfer error: Failed initialization"

 

Any quick fix för this

Hi @miesatsbeha​ since each ftp/ftps/sftp connection is different in how it might be set up, you might want to create a new thread on the community with additional information about your specific setup. Or if this is urgent then submit a support case with us :) happy to help!

Reply