I have to sample a large area with high resolution: A country with a resolution of 1 Meter. I will use points for this which eventually will be written to a database.
I will have to split up the calculation, e.g. 50 by 50 km which would result in 2.5 billion points per run.
Can FME handle this? Or would it be better to split the calculations to smaller parts?
The computer has 64 GB of RAM.
Just a quick, very general answer: It totally depends on the size (memory footprint) of those features, and whether you can process them in one go or if FME has to hold on to them for some reason (blocking transformers).
Make sure you use 64-bit FME!
Still, it might be easier to work with smaller batches of features...
+12
As an addition, it also depends on what format your source data is in.
If this is CSV, I would not hesitate using the 50 by 50 km.
For most other formats, I would suggest smaller samples.
Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.
