how to write to many formats in optimized way ?

In your PythonCaller, I would replace the function by a class and instead of creating six attributes, I would create a copy of the feature with the attribute "FORMAT" set to the required format for each format requested by the user.

Then only one AttributeFilter (on the FORMAT attribute) is required to filter features based on the format requested.

Python code:

import fme
import fmeobjects

class FeatureProcessor(object):
	def __init__(self):
		pass

	def input(self,feature):
		my_list = feature.getAttribute('_list{}')
		for item in my_list:
			if item=="ESRISHAPE":
				outputFeature = feature.clone()
				outputFeature.setAttribute("FORMAT", "ESRISHAPE")
				self.pyoutput(outputFeature)
			if item=="FILEGDB":
				outputFeature = feature.clone()
				outputFeature.setAttribute("FORMAT", "FILEGDB")
				self.pyoutput(outputFeature)
			if item=="XLSXW":
				outputFeature = feature.clone()
				outputFeature.setAttribute("FORMAT", "XLSXW")
				self.pyoutput(outputFeature)
			if item=="CSV":
				outputFeature = feature.clone()
				outputFeature.setAttribute("FORMAT", "CSV")
				self.pyoutput(outputFeature)
			if item=="AUTOCAD_OD":
				outputFeature = feature.clone()
				outputFeature.setAttribute("FORMAT", "AUTOCAD_OD")
				self.pyoutput(outputFeature)
			if item=="DWF":
				outputFeature = feature.clone()
				outputFeature.setAttribute("FORMAT", "AUTOCAD_DWF")
				self.pyoutput(outputFeature)

	def close(self):
		pass

So you are essentially cloning the features 6 times, regardless of how many formats are chosen.

What about simply exploding the format list, and using a featureWriter set to generic format? In the parameters you can set to Output Format to an attribute. All you need to do is ensure that your format names exactly match those used by fme.

Does it look like this?

Notice both Passed/Failed are connected to the next Tester, but only one of them should ever occur.

I think if you do this then you will have only one extra copy. Yes, the data goes to each Tester, but it passes through because the Tester is not group-based. You don't get a copy of the data at every Tester, a copy occurs only when that test is true. So if the number of formats is n, then you'll get n+1 copies at most (and maybe not even that since the final tester has no failed output connected).

I think what might be more important is to be using a FeatureWriter transformer, instead of a writer. Then things will happen in parallel and the data won't be cached at each writer. eg - see Dale's answer to a previous question.

If you really want to make sure you only get n copies of the data, then make a count of the chosen formats and use a Cloner to create that many copies. Then you can use a single TestFilter to separate each cloned set and point it to the correct writer (you'd need to be able to map the clone number to a particular format, but that shouldn't be too hard).

Hope this helps.

@Mark2AtSafe

Hi Mark,

I used testfilter in this way. is this costlier than tester ?

@Mark2atsafe

@Larry

cloner is faster? or python ( Larry's code ) is Faster ?

which one will execute fast?