Skip to main content
Question

Deleting uploaded files from FME server immediately after use


Forum|alt.badge.img

I am using FME Server to move very large files into an Azure data store. The mechanism of this works fine but I would like to delete the files from FME servers temporary file store after the files are used to avoid filling up the memory of the server.

I know that the temporary uploaded files end up in the following location but not how to delete them:

FME_SHAREDRESOURCE_SYSTEM/filesys/temp/upload/Project1/AzureUpload.fmw/Username/*filename*

 

Thanks!

5 replies

warrendev
Enthusiast
Forum|alt.badge.img+23
  • Enthusiast
  • April 6, 2020

Hi @jw4554,

 

 

You can create scheduled cleanup tasks to remove files. There are the default tasks, as well as an option to create new scheduled tasks.

 

 


itay
Supporter
Forum|alt.badge.img+17
  • Supporter
  • April 7, 2020

Hi @jw4554,

You could also create a separate workspace that runs after the processing workspace is done to delete the file. By using automations you can make sure that it runs after successfully completing the processing task.

I often use a SystemCaller at the end of the processing workspace to delete the input file. I prefer this option since it is visible on the canvas as opposite to a 'hidden' shutdown script.

Hope this helps.

 


Forum|alt.badge.img
  • Author
  • April 8, 2020
warrendev wrote:

Hi @jw4554,

 

 

You can create scheduled cleanup tasks to remove files. There are the default tasks, as well as an option to create new scheduled tasks.

 

 

great to know this is there - thank you! In this case I don't know how long the process will take to run but it will be useful for the future.

Forum|alt.badge.img
  • Author
  • April 8, 2020
itay wrote:

Hi @jw4554,

You could also create a separate workspace that runs after the processing workspace is done to delete the file. By using automations you can make sure that it runs after successfully completing the processing task.

I often use a SystemCaller at the end of the processing workspace to delete the input file. I prefer this option since it is visible on the canvas as opposite to a 'hidden' shutdown script.

Hope this helps.

 

Yes I agree - it is good to make the tasks obvious. I've not used a System Caller on FME server before - do I save a .bat file and trigger it?


itay
Supporter
Forum|alt.badge.img+17
  • Supporter
  • April 8, 2020
jw4554 wrote:

Yes I agree - it is good to make the tasks obvious. I've not used a System Caller on FME server before - do I save a .bat file and trigger it?

You could do that or just place the command directly in the systemcaller


Reply


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings