Skip to main content
Released

Speed up data retrieval from running workspace run with full inspection

Related products:FME Form
  • November 18, 2016
  • 3 replies
  • 35 views

lifalin2016
Influencer
Forum|alt.badge.img+40

Hi,

Running a workspace with full inspection is a great tool, but it comes with a heavy price.

If - which is often the case - a huge dataset is among the inputs, the "inspection cache" is swamped with unnecessary data. This makes inspection of even minute datasets generated later in the workflow a tedious and slow task.

Would it not be possible to somehow index the cached inspection datasets, so retrieval becomes as fast as the individual dataset size determines, i.e. very fast for small amounts ?

The performance is currently just as bad in the 2017 beta as in 2016 release.

Cheers

Lars I.

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

3 replies

fmelizard
Safer
Forum|alt.badge.img+22
  • Safer
  • November 18, 2016

Good suggestion. We'll look at how we might partition things better.


fmelizard
Safer
Forum|alt.badge.img+22
  • Safer
  • November 18, 2016
We've got a plan and it is tracked in PR 72445 (in case this comes up again)

 

 


mark2atsafe
Safer
Forum|alt.badge.img+59

Fixed in 2017.1 (the DI will not be slow to inspect one piece of data if the dataset is very large)