Skip to main content
Solved

How to read csv from a URL?

  • November 30, 2018
  • 4 replies
  • 118 views
nicholas
Contributor
Forum|alt.badge.img+14

I want to read a csv from a URL, but I am failing to connect.

I add a Reader

Format: CSV (Comma Separated Value)

Dataset: http://www.bom.gov.au/fwo/IDQ60801/IDQ60801.94418.axf

under Parameters

Delimiter Character: ,

Field Names Line: 20

Data Start Line: 21

 

but I get the error

CSV reader: Failed to open file 'http://www.bom.gov.au/fwo/IDQ60801/IDQ60801.94418.axf' for reading. Please ensure that the file exists and you have sufficient privileges to read it

When I use chrome to visit the URL I succeed. The URL and resulting csv file definitely exist.

What I want is to read (and process) the csv file using FME

Best answer by nicholas

Solved it.

I had to set up the network proxy in Tools | FME Options | Network Proxy

I chose "Use system proxy settings"

I ticked "Proxy Server Requires Authentication"

and entered my internet logon and password

Authentication Method was basic.

This got me through my organisation's proxy server

Obviously may be different for other users

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

4 replies

fmelizard
Safer
Forum|alt.badge.img+21
  • fmelizardSafer
  • Safer
  • November 30, 2018

Hi @nicholas It works for me. Can you attach your workspace here or else send it to https://www.safe.com/support/report-a-problem/ ? Thanks!

nicholas
Contributor
Forum|alt.badge.img+14
  • nicholasContributor
  • Author
  • Contributor
  • December 3, 2018

Hi DanAtSafe

I cannot attach a workspace as I cannot even create a workspace.

When I attempt to insert a reader into the blank workspace, it fails to insert the reader.

The final error line is Workspace generation failed.

nicholas
Contributor
Forum|alt.badge.img+14
  • nicholasContributor
  • Author
  • Contributor
  • December 3, 2018

I work in a government department.

Do I have to configure my internet connection for a proxy server?

I assumed that as I can access the file via an internet browser, that my internet connection was fine. But maybe there is some more configuration I should be doing?

nicholas
Contributor
Forum|alt.badge.img+14
  • nicholasContributor
  • Author
  • Contributor
  • Best Answer
  • December 3, 2018

Solved it.

I had to set up the network proxy in Tools | FME Options | Network Proxy

I chose "Use system proxy settings"

I ticked "Proxy Server Requires Authentication"

and entered my internet logon and password

Authentication Method was basic.

This got me through my organisation's proxy server

Obviously may be different for other users

Community Stats

32,154
Posts
122,043
Replies
39,812
Members

Latest FME

Terms & ConditionsCookie settingsAccessibility statement
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.