+11Hi Team,
I have 7 million records coming out from source and i need to write to two databases simultaneously.
why simultaneous:
if i write one writer and the second writer will be waiting first one to complete. And in between memory issue comes and fme hangs or stops abruptly.
so I need to write to two databases at a time. need serial connection to the writers.
not parallel.
can anyone please help me.
Best answer by f.kemminje
@erik_jan
I like the final option,
But if the writers are two different databases, can i send all the attributes after writing to featurewriter1 thru summary port?
+18If memory is an issue, writing to two databases, could you write to one database? Then use a second workspace to read from the first database and copy to the second?
I know this seems too much work, but sometimes the amount of data limits the options.
Another option, that I have used before, is writing to FFS file as an intermediate step and then write that data to the database(s).
The final option (if you want to do it in one workspace) is using two FeatureWriter transformers. They allow streaming, where actual writers will store data in memory.
+11@erik_jan
I like the final option,
But if the writers are two different databases, can i send all the attributes after writing to featurewriter1 thru summary port?
+18@erik_jan
I like the final option,
But if the writers are two different databases, can i send all the attributes after writing to featurewriter1 thru summary port?
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
