Skip to main content
Question

Why does the duration of a transaction increase in the initial phase of writing millions of point features to a file geodatabase?

  • October 12, 2020
  • 1 reply
  • 25 views

Forum|alt.badge.img

Hello!

Having to write millions of homogenous point features to a file geodatabase (default Esri File Geodatabase Writer 3D, Vector), I noticed that the duration for a completed writing transaction/commit increases as the writing to the FGDB progresses. While the first transaction takes 0.4 seconds for 1000 features, the duration increases up to 1.5 seconds per 1000 features where it seems to level until the end of the writing process (there are no other process running):

0.0|INFORM|Transaction #1 was successfully committed
0.4|INFORM|MULTI_WRITER: multi_writer_id `1': Writing feature 1000
0.0|INFORM|Transaction #2 was successfully committed
0.5|INFORM|MULTI_WRITER: multi_writer_id `1': Writing feature 2000
...
0.0|INFORM|Transaction #328 was successfully committed
1.0|INFORM|MULTI_WRITER: multi_writer_id `1': Writing feature 328000
...
0.0|INFORM|Transaction #503 was successfully committed
1.4|INFORM|MULTI_WRITER: multi_writer_id `1': Writing feature 503000
...
0.0|INFORM|Transaction #2289 was successfully committed
1.5|INFORM|MULTI_WRITER: multi_writer_id `1': Writing feature 2289000 
...

I know about the possibility to increase transaction size (https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/geodatabase/Improving_Speed_Writer.htm). However, I was wondering what might cause this kind of regression? I'm thankful for your hints...

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

1 reply

david_r
Celebrity
  • October 13, 2020