Skip to main content
Question

Bulk insert error

  • November 22, 2023
  • 2 replies
  • 245 views
I

Using FME workbench 2023.0, I am trying to make updates to some rows in a PostgreSQL table by using the FeatureWriter transformer that takes a csv as the updated dataset as input. However, I am unable to fully run the workbench as it takes an incredible amount of time to run, with the warning message:

"POSTGRES Writer: Bulk Insert is set to Yes, but a conflicting Feature Operation has been detected. Feature type 'ela_master.lim_watr_chem_anal_arbi' has a Feature Operation of 'Update'. Bulk Insert is now being set to No, which can cause insert operations to be much slower"

 

I have made updates to the exact same table using the exact same FeatureWriter transformer parameters before with no problem... and this is a new issue I'm encountering, and quite frankly I have no idea how to solve it. Can someone please tell me how I can fix this? Thanks.

2 replies

takashi
Influencer
  • takashiInfluencer
  • November 23, 2023

Hi @iyaktubay​ ,

​I think Bulk Insert can be applied only if you have set Insert to the Feature Operation parameter in the PostgreSQL writer feature type.

The message is not an error, is a warning saying FME won't perform Bulk Insert for Update operation, even if you set Yes to the Bulk Insert parameter.

I
  • iyaktubay
  • Author
  • November 23, 2023

Hi @takashi, thank you for your answer. I am aware that it is not an error, but the reason I called it an "issue" is because it takes an impossibly long time to make updates (I'm trying to update about 12k rows). Do you know of a way to speed the process up? I have tried adding indices to the Match On columns on the Postgres table, but this made no difference.

Reply


Helpful Members This Week

Community Stats

31,106
Posts
117,933
Replies
38,859
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.