Does anyone know if there is a way to get the amount of free disk space using the FME Server API? I presume I could use a SystemCaller transformer and write out the information somewhere and access it that way, but wondering if there is an easier way. Just looking to get the same disk space details that are logged when a job runs (see screenshot). Thanks
Solved
Get available disk space programmatically using FME Server API?
- Contributor
- 7 replies
Best answer by virtualcitymatt
You can use python to get that info easy enough:
modified from https://stackoverflow.com/questions/48929553/get-hard-disk-size-in-python
import fme
import fmeobjects
import shutil
def GetSize(object):
total, used, free = shutil.disk_usage("/")
object.setAttribute("Total",(total // (2**30)))
object.setAttribute("Used",(used // (2**30)))
object.setAttribute("Free",(free // (2**30)))
This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.
+8- Safer
- 63 replies
Hi @jorma ,
There isn't an endpoint available for pulling information about the host machine resources, that I'm aware of. The SystemCaller might be the best bet here, or something like low disk alerts on Windows: https://docs.microsoft.com/en-us/troubleshoot/windows-server/backup-and-storage/configure-low-disk-space-alert-performance-logs
We can set up FME to trigger clean-up events, based on disk space: https://docs.safe.com/fme/html/FME_Server_Documentation/WebUI/Configuring-System-Cleanup-Settings.htm
To find the disk space as recorded on each job, I'd recommend using the Retrieve parsed job log request, GET /transformations/jobs/id/< jobid >/log, then parsing those highlighted lines.
For FME Cloud, it's all much simpler: https://docs.safe.com/fme_cloud/FME_Cloud/Content/About_Instances/Instance-Monitoring.htm
Lastly, not entirely what you're looking for, but we can monitor job statistics in FME Server 2021.0+: https://community.safe.com/s/article/Monitoring-FME-Server-Job-Activity-using-the-REST-API
Hope that helps!
Sanae
+47- Celebrity
- 2000 replies
- Best Answer
You can use python to get that info easy enough:
modified from https://stackoverflow.com/questions/48929553/get-hard-disk-size-in-python
import fme
import fmeobjects
import shutil
def GetSize(object):
total, used, free = shutil.disk_usage("/")
object.setAttribute("Total",(total // (2**30)))
object.setAttribute("Used",(used // (2**30)))
object.setAttribute("Free",(free // (2**30)))
- Contributor
- 7 replies
Hi @jorma ,
There isn't an endpoint available for pulling information about the host machine resources, that I'm aware of. The SystemCaller might be the best bet here, or something like low disk alerts on Windows: https://docs.microsoft.com/en-us/troubleshoot/windows-server/backup-and-storage/configure-low-disk-space-alert-performance-logs
We can set up FME to trigger clean-up events, based on disk space: https://docs.safe.com/fme/html/FME_Server_Documentation/WebUI/Configuring-System-Cleanup-Settings.htm
To find the disk space as recorded on each job, I'd recommend using the Retrieve parsed job log request, GET /transformations/jobs/id/< jobid >/log, then parsing those highlighted lines.
For FME Cloud, it's all much simpler: https://docs.safe.com/fme_cloud/FME_Cloud/Content/About_Instances/Instance-Monitoring.htm
Lastly, not entirely what you're looking for, but we can monitor job statistics in FME Server 2021.0+: https://community.safe.com/s/article/Monitoring-FME-Server-Job-Activity-using-the-REST-API
Hope that helps!
Sanae
Thanks @sanaeatsafe , appreciate all the info. The solution provided below works pretty good, so I think I am all set.
- Contributor
- 7 replies
You can use python to get that info easy enough:
modified from https://stackoverflow.com/questions/48929553/get-hard-disk-size-in-python
import fme
import fmeobjects
import shutil
def GetSize(object):
total, used, free = shutil.disk_usage("/")
object.setAttribute("Total",(total // (2**30)))
object.setAttribute("Used",(used // (2**30)))
object.setAttribute("Free",(free // (2**30)))
Works perfect. Thanks @virtualcitymatt !