Solved

How to see which features have invalid source datasets when using a FeatureWrite?

Forum|Forum|4 months ago
July 15, 2025
6 replies
92 views

simonlr
Contributor

Hi, i am copying files using the FeatureWriter with FileCopy and but some of them are missing but i dont get an attribute telling me which files are missing. All i get is this in the log:
File Copy Writer: Skipped 401 features that contained invalid source datasets
But what i would like is to route those with invalid source data set and have them write to an excel ark or similar so i know which files cant be found.
But right now the features all come out of the same port with no distinction of wheter or not the copy was actually succesful. Which is not very useful for me.

Any help is very much appriciated :)

Best answer by nielsgerrits

Ah correct, sorry my bad. Then use good old Python. A PythonCaller with the following code works.

import fme
import fmeobjects
import os

class FeatureProcessor(object):

def __init__(self):
pass

def input(self, feature: fmeobjects.FMEFeature):
if os.path.exists(feature.getAttribute('FilePath')):
feature.setAttribute("FileCheck","true")
else:
feature.setAttribute("FileCheck","false")
self.pyoutput(feature)

def close(self):
pass

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

+61

nielsgerrits
Forum|Forum|4 months ago
July 15, 2025

One way to solve this is to use the Directory and File Pathnames reader to confirm if the file does exist or not, and only send the confirmed file features to the File Copy writer.

Buckle your seatbelt Dorothy, cause Kansas is going bye-bye...

Upvote

simonlr
Author
Contributor
Forum|Forum|4 months ago
July 15, 2025

One way to solve this is to use the Directory and File Pathnames reader to confirm if the file does exist or not, and only send the confirmed file features to the File Copy writer.

Thank you for your answer.

How i wish this worked, that you could just set the source file as the data set for Directory and File Pathnames, but i seems it only reads folders not individual files.
Is there a way to do this without having a Directory and File Pathnames reader read everything? It takes a very very long time.
I have a 4TB harddrive with millions of files and i really only need to copy a few specific files over every time, but i do need to know if some files were not succesfully copied and which files they are.