Question

Limit on LAS files that can be converted

M

Dear All.

I have made an absolut simple workbench with LAS reader to a Recap writer. Nothing fancy.

But it seems to have a limit of an amount of files that I can read and write. right now the limit is about 70 files in write.

I have searched and asked around at the office, but cant get an answer.

I have 100gb available space and plenty of memory, so that is not the issue.

Attached is the script.

Hope there is a solution, since there are about 1.000 files that needs to be converted which will result in about 10.000 files written.

 

4 replies

kailinatsafe
Rank
Userlevel 3
Badge +13

Hello @mrmlaursen​ , there should be no limit on number of files on reading or writing. Took a look at your workspace, nothing obviously alarming there. I decided to see if I could repro this and I got the following error: "ReCap Writer: Failed to convert LAS files to RCS scan files. The following error occurred: ..." . If you would want to try by dividing up your translation in some way?

 

I think one potential solution would be to change the writer to use Dataset Fanout instead of Feature Type Fanout. Right now you are setting Feature Type Fanout to:

@Value(fme_basename)-@Value(_split_value)

If you instead set Dataset Fanout to:

@Value(fme_basename)

 and Feature Type Fanout to:

@Value(_split_value)

the translation may work, but would have a different directory structure than you do now.

 

Let me know if this works for you! Here to help, Kailin.

M

Hi, yes I started that way with the simplest of LAS reader and Recap writer but is also have the limit at about 70-100 files.

See attached. But still issues.

 

ebygomm
Rank
Userlevel 1
Badge +21

Can you write a parent workspace and run one file through at a time with a workspace runner?

kailinatsafe
Rank
Userlevel 3
Badge +13

Can you write a parent workspace and run one file through at a time with a workspace runner?

@ebygomm​ I feel like that may work, with Wait For Job To Complete parameter set to Yes maybe.

Reply


Community Stats

28,721
Posts
109,502
Replies
36,560
Members
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.