Skip to main content
Question

Deleting uploaded files from FME server immediately after use

  • April 6, 2020
  • 5 replies
  • 202 views

jw4554
Participant
Forum|alt.badge.img+4

I am using FME Server to move very large files into an Azure data store. The mechanism of this works fine but I would like to delete the files from FME servers temporary file store after the files are used to avoid filling up the memory of the server.

I know that the temporary uploaded files end up in the following location but not how to delete them:

FME_SHAREDRESOURCE_SYSTEM/filesys/temp/upload/Project1/AzureUpload.fmw/Username/*filename*

 

Thanks!

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

5 replies

warrendev
Enthusiast
Forum|alt.badge.img+26
  • Enthusiast
  • 121 replies
  • April 6, 2020

Hi @jw4554,

 

 

You can create scheduled cleanup tasks to remove files. There are the default tasks, as well as an option to create new scheduled tasks.

 

 


itay
Supporter
Forum|alt.badge.img+18
  • Supporter
  • 1442 replies
  • April 7, 2020

Hi @jw4554,

You could also create a separate workspace that runs after the processing workspace is done to delete the file. By using automations you can make sure that it runs after successfully completing the processing task.

I often use a SystemCaller at the end of the processing workspace to delete the input file. I prefer this option since it is visible on the canvas as opposite to a 'hidden' shutdown script.

Hope this helps.

 


jw4554
Participant
Forum|alt.badge.img+4
  • Author
  • Participant
  • 10 replies
  • April 8, 2020

Hi @jw4554,

 

 

You can create scheduled cleanup tasks to remove files. There are the default tasks, as well as an option to create new scheduled tasks.

 

 

great to know this is there - thank you! In this case I don't know how long the process will take to run but it will be useful for the future.

jw4554
Participant
Forum|alt.badge.img+4
  • Author
  • Participant
  • 10 replies
  • April 8, 2020

Hi @jw4554,

You could also create a separate workspace that runs after the processing workspace is done to delete the file. By using automations you can make sure that it runs after successfully completing the processing task.

I often use a SystemCaller at the end of the processing workspace to delete the input file. I prefer this option since it is visible on the canvas as opposite to a 'hidden' shutdown script.

Hope this helps.

 

Yes I agree - it is good to make the tasks obvious. I've not used a System Caller on FME server before - do I save a .bat file and trigger it?


itay
Supporter
Forum|alt.badge.img+18
  • Supporter
  • 1442 replies
  • April 8, 2020

Yes I agree - it is good to make the tasks obvious. I've not used a System Caller on FME server before - do I save a .bat file and trigger it?

You could do that or just place the command directly in the systemcaller