Question

Using HTTP Caller to download from CDE


Badge +1

I am attempting to download a number of files using the HTTP caller request.

I currently have a large quantity of URLs in tabular form, each with an identical URL apart from the end part which follows this structure: "fileID=xxxxxxx&attach=true", where the xxxxxxx signifies the document UID (i.e. 1234567).

When I run this request through the HTTP Caller (Get request as a file), the file returns the following error code:

2020-04-28 09:28:43| 0.6| 0.0|ERROR |HTTPCaller (HTTPFactory): HTTP/FTP transfer error: 'URL using bad/illegal format or missing URL'

2020-04-28 09:28:43| 0.6| 0.0|ERROR |HTTPCaller (HTTPFactory): Please ensure that your network connection is properly set up

 

I am trying to identify a solution for this as the HTTP Caller clearly, as I believe, does not identify my request as a standard URL format.

If I copy and paste this URL into a browser, the file automatically downloads.


2 replies

Userlevel 4
Badge +25

Could you share the URL itself with us so we can have a closer look?

Badge +1

Hi, thanks for your response.

Redacted URL (due to confidentiality) is below:

https://xxxxxxxxxx//Framework/Endpoint/DownloadFile.ashx?s=PENvbm5lY3Rpb24%2bPE9sYXBTZXJ2ZXI%2bZWIuaHMyLm9yZy51azwvT2xhcFNlcnZlcj48T2x0cFNlcnZlcj5lYi5oczIub3JnLnVrPC9PbHRwU2VydmVyPjxPbGFwU2Vzc2lvbj5aVzlyTnpKRGVqUndablUxYjJoUWN6SlBNa1pCTVcxc1JGazJZa3REVGtKek5HVnBkMmxtWmtoT1R6Um5ablJ5V21jMVkzRnBOblp2UkRGVkszcG9hRGR3V2xSYUsyRnJha0ZKUW04NVduQTJkM2hPTnl0TmRXVTVkblJHYUdWb0tuczJOMEk0TUVNME9TMDVNRGM0TFRRd1FqWXRRVFF3UVMwMk9EZ3lRVVU0UkVSQ1FrSjlLalk1TWpRNU56SXFhSE15TFdWaUxXUmlMWEJ5YjJRcU1UY3lOVFlxS2pFcVpXSXVhSE15TG05eVp5NTFhdz09PC9PbGFwU2Vzc2lvbj48T2x0cFNlc3Npb24%2bWlc5ck56SkRlalJ3Wm5VMWIyaFFjekpQTWtaQk1XMXNSRmsyWWt0RFRrSnpOR1ZwZDJsbVpraE9UelJuWm5SeVdtYzFZM0ZwTm5adlJERlZLM3BvYURkd1dsUmFLMkZyYWtGSlFtODVXbkEyZDNoT055dE5kV1U1ZG5SR2FHVm9LbnMyTjBJNE1FTTBPUzA1TURjNExUUXdRall0UVRRd1FTMDJPRGd5UVVVNFJFUkNRa0o5S2pZNU1qUTVOeklxYUhNeUxXVmlMV1JpTFhCeWIyUXFNVGN5TlRZcUtqRXFaV0l1YUhNeUxtOXlaeTUxYXc9PTwvT2x0cFNlc3Npb24%2bPFNpbGVudD5UcnVlPC9TaWxlbnQ%2bPERpc2Nvbm5lY3RPbkRpc3Bvc2U%2bRmFsc2U8L0Rpc2Nvbm5lY3RPbkRpc3Bvc2U%2bPC9Db25uZWN0aW9uPg%3d%3d&fileID=1234567&attach=true

 

I have spoken to one of my team who has said "Using it via this URL might require running it as “headless browser” code to emulate a browser, could be tricky but possible".

Would querying this through FME be possible?

Reply