Skip to main content
Released

Read files on the fly (without complete download) from web file systems (e.g. S3

Related products:FME Form
  • November 11, 2017
  • 1 reply
  • 24 views
fmelizard
Safer
Forum|alt.badge.img+22

***Note from Migration:***

Original Title was: Read files on the fly (without complete download) from web file systems (e.g. S3)


It would be great if FME began reading in files as they were downloaded rather than waiting for the entire file to download and then reading them. Especially for big files on S3.

    This post is closed to further activity.
    It may be an old question, an answered question, an implemented idea, or a notification-only post.
    Please check post dates before relying on any information in a question or answer.
    For follow-up or related questions, please post a new question or idea.
    If there is a genuine update to be made, please contact us and request that the post is reopened.

    1 reply

    rylanatsafe
    Safer
    Forum|alt.badge.img+14
    • rylanatsafeSafer
    • Safer
    • November 14, 2017

    What a cool idea, @FMELizard! What file formats would benefit from this? I could see Text File and CSV as two file types that might support this (more easily?) – but for a lot of others I would expect that the entire file needs to be cached locally first.

    I think it would be very helpful to learn of other applications that allow for this type of "streaming" read.

    Community Stats

    32,724
    Posts
    124,149
    Replies
    41,216
    Members
    Terms & ConditionsAccessibility statement
    A product of
    Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.