Automation

Hi everyone,I would be happy if somebody can give a thought to address the issue on automating FME. Presently, I am processing .csv files in FME to create some spatial data (points/lines). Problem is the .csv files are located inside Azure Blob storage containers along with several datasets. I am manually finding out the latest containers to download the csv file to local directory and then processing the same using FME workbenches. I have already added a AzureBlobStorage Container in FME and connection parameters successfully, but not getting a sense how to download all the csv files automatically from all containers and store it to a local or temp directory to process further. My Flow is --Creator > AzureBlobStorageConnector Additionally trying to find out any possible way to create a mail or other alert system, so that, whenever new data would be uploaded/downloaded/deleted to Azure, it will show up in fme.

I have a workspace which goes off to the www to download a file for processing further along the workbench. Once the task has completed how can i automate deleting all contents of the specified folder. I am aware of directory watch to do something when a folder is modified or deleted, but i just want to delete the contents.....

I am trying to set up an FME Server Automation, which runs a model every first day of the month. I bump into 2 issues: 1) To set up the schedule trigger, i can not choose "every first day of the month". Apperently the monthly option only lets you choose a montly run from the day it is today (in this case every first monday of the month). How to go about? 2) I want to let the input parameters change for each monthly run. In this case the model does a calculation from a start date until an end date, and the start date needs to be the first day of the previous month and the end date the first day of the month it runs. How can I make these input parameters a variable? All suggestions welcome!

I would like to know if there is anyway I could export an ESRI FGDB to XML Document within FME and not through the manual process in Arc Catalog?

We have a script in FME Engine Linux FME Server 2021.0.1 Build 21313 - linux-x64 Why we can't transfer file via sftp using planned actions. And why we can transfer manually using the same script.

I understand that FFS is an internal file format to FME, and presumably it gets updated with each new version of FME. Will the FFS Reader handle an FFS file that was created by an older (a decade old) version of FME?

I'm trying to use the built-in SMTP of an FME Server running on EC2 but I can't seem to get it to work. I've opened port 25 in the EC2 security group and there's, as far as I can tell, nothing else using that port. Any ideas?

Hi,Is there any way to control the ID when uploading I3S files via ArcGISOnlineconnector? Does not seem to have a replace action. Delete and uploads works fine but its kind of useless when the apps no longer can identify the scene layerscheers Henrik

HelloI managed to create an automation in FME server and successfully linked the webhook of FME to the Azure Event Grid as shown in the attached snapshot. Currently I just read the event as JSON to the logger. The output is like this:{  "data": {    "storageDiagnostics": {      "batchId": "c10819b2-b006-00a8-00f0-187e50000000"    },    "clientRequestId": "3f49ecb9-a829-406c-948e-d57c85c4104f",    "requestId": "a4247e74-601e-005f-0cf0-1854c2000000",    "eTag": "0x8D9E70737425603",    "contentLength": 17600,    "api": "PutBlob",    "blobType": "BlockBlob",    "contentType": "image/png",    "url": "https://fmeserverin.blob.core.windows.net/in-files/augmented-reality.png",    "sequencer": "00000000000000000000000000014D700000000001f44698"  },

I have a question that is indirectly related to FME.In short, we have a series of ETL scripts that process data that eventually gets used for FME transformations. These scripts populate a Postgresql database and are scheduled to run on a periodic basis.Occasionally, a script will fail in its processing, leading to some database table to remain locked, for example. Currently we are using the pgadmin tool dashboard to manually detect such events and to resolve them.I was wondering if you are aware of any tool that could be used to automate the monitoring of database sessions, like sending alerts if a query takes longer then "n minutes" to complete. Thanks!Bruno

Hello,I have set up a IMAP publisher to poll one of our inboxes. The idea is for it to trigger a workbench to download and process data when our supplier informs us of an update. When I send a test email which is either blank for in plain text it works, but the supplier emails are HTML and the JSON in the Topic is invalid. The part of the JSON that is invalid is in the imap_publisher_content{0} section. This is the HTML message which I think it treats and JSON so fails when it’s expecting a : or }. Please can you help? Thanks, David

I wanted to centralize assignment of Database Connections in my FME Server automations. I currently have a published user parameter on each of my workspaces, connected to the transformers in each workspace, that I can set in each workspace action individually in an automation to switch between databases to load. Each time I want to switch the location I have to change the user parameter on each workspace action in the automation which feels a bit clunky and prone to error if you have many workspace's in an automation. I was wondering is there a way to centralize assignment of Database Connections in the FME Server Automation? I thought perhaps creating a Global Key for the database connection might work but that doesn't look like it's possible. Is there a better way to do this?

This workbench is run on the server and uses the FME Server email generator. We want it to generate a text which includes the original total records read from 2 separate tables used as input eg 2913 from table 1 and 7429 from table 2the total number of records in the output file geodatabase.We have got it to the point that it automatically fills in the total records from input table 2 but not the other 2 numbers. What could we be doing wrong?

Hi. I have a folder name PLAN. In the folder PLAN i have a lot of subfolders (B53, B54, B89, etc..). More then 500. In each subfolder (b55 for example) i have a subfolder name TERRITOIRE (PLAN/B54/TERRITOIRE, PLAN/B109/TERRITOIRE), and also other folders with other name. I want copy TERRITOIRE subfolder from each subfolder in a new folder with the name of subfolder.NEWFOLDER/B56/ TERRITOIRENEWFOLDER/B55/TERRITOIRE. Thank for help.    

The result of my workspace is several geojson files. For usability purposes, I want to include a fixed template .qgz file which is already on the server in the zip, so end users can immediately open it in QGis.However, I can't find a way to get this to work with the Data Download service.​As a proof of concept, I created a minimal example that just loads a binary file, and writes it again. However, the AttributeFileWriter can't be selected as a Writer output for the Data Download service. Is there another way to include arbitrary binary files with data download?

Hi! I created a workbench in FME Desktop 2019.1 (build 19608) that uses `RasterObjectDetectFactory'. Everything works fine in desktop, but when I try to run it in FME Server I get the following message. FME server is running the same version and build as desktop."Library 'D:\\FMEServer\\Server\\fme\\plugins/opencv/rasterobjectdetectfactory.dll' was found but could not be loaded. Ensure that all the dependent modules exist for this library"This FME edition does not recognize the `RasterObjectDetectFactory' factory. Please ensure that the current platform supports this factory, the factory name is spelled correctly, and that you have installed all required plug-ins What's wrong?

I have a directory watch which triggers a workspace. This Workspace should be executed only once. But unfortunately with every detected file/folder a job starts. Is it possible to avoid this behavior? I use FME Server 2020.1 Thank you for your help! Sorry in advance if this topic has been discussed here before! I've couldn't find anything.

Hello FME users. Is FME capable of automating other software? I am processing photogrammetry and Lidar with a complicated software that requires a lot of repetitive steps which are more or less the same every time. Thank you!

Hi all, I'm getting this statusmessage (Parameter 'DestDataset_ORACLE_NONSPATIAL_7' must be given a value) when running a FME Workbench script as a scheduled FME Server job once a day. Can't figure out, what it means.The connections are embedded in the FME script. However, when I run it under my own user, or the FME Server admin user, it works fine, so I can't do any error searching or further testing.Any ideas on how to understand and resoive this problem will be appreciated??

I am struggling to ouput rasters correctly when using the GeospatialPDF writer. My source file is a PDF that has text, image, vector and raster data. It's the raster that is giving me the trouble. When isolating the raster and sending to the GeospatialPDF Writer, some of it comes comes out ok, but the rest has a black background. Interestingly, the colors are switched when viewed from Google Drive! What is going on here??? Viewing the raster directly from the GeoSpatialPDF Reader, it looks more or less normal (should just be a straight white background for everything). My workspace is literally a Reader and a Writer, that's it.

It's quite often that FeatureReaders get 'stuck' at reading features, everything is loaded fast through the <Generic> port but the <Schema> is loading almost 1features/second. How can this be improved?I'm attaching my options 

Hello everyone! I have a really serious problem, which could ruin my show to an important client early next week, and I would really love to help. I have an automation that is operated by watch directoery. I use a file that comes to the folder in the next operation in automation, by filepath.The problem is that the next workbench, reads the filepath badly. (All files are on the server). Here is an example of the log files: The 1609, is from automation which I used {file.path}.as you can see,The system stops as soon as it does not recognize the dwg file.And in work 1610, I put the same file, but set it up manually.Then it worked wellI looked closely, and I think I know what the problem was,​When it reads the file in 1609, it reads it like this:​file_dwg: $(TiuomMaarhot) Petah_Tikva \\ kb-2021-5 \\ Received Files \\ tb400031528.dwg​But in 1610 he reads it like this:​

I have an automation in FME Server 2020.1. I changed the workbench being triggered advanced setting from run until cancelled so that it is no longer checked but this change is being ignored and the log shows that it is still using that setting. Perhaps this is being cached? Anything I can do to force the change to be applied?

I've been able to create a Workspace that gathers PDF's -> ZIP them -> Attaches files -> to Emailer Transformer. The file only needs to be temporary until the Workspace is complete.I'm trying to understand FME Server Resources and using [FME_SHAREDRESOURCE_TEMP] or [FME_SHAREDRESOURCE_DATA] within a Workspace but no success. Are these the wrong location or not accessibleORDo I need to follow and create a new location "Example 4: Using a Resource Folder Within a Workspace" in https://community.safe.com/s/article/fme-server-resources-uploading-referencing-and-con-1

FME Server Automations, I see External Action Parameter for "Email Cc (optional)" I'm wondering if there is an incoming Trigger->Otuput Keys->Event Keys for CC (Carbon Copy) for emails?