Automation

I have a working Automation that is triggered by either a Schedule block or a Webhook block. It includes a number of "run workspace" actions in series, the first of which currently includes user parameters with values that are fixed in the Automation, one of which is a datetime parameter. I would like to pass a datetime value in the body of the webhook POST, but it appears the first workspace block does not show the "Use a value from upstream keys" for the datetime user parameter, presumably because it is not an ordinary string. Is there a way to accomplish this without changing the user parameter in the workspace to an ordinary string?

I have a directory watch on a network folder and I can successfully trigger the subscription by adding a file to that folder. I can see that the workspace is triggered as well. However, what I'm still trying to figure out is how to pass the path and file name of the zip file placed in it to the workspace. What would the input parameter need to be set as in the workspace? Currently I have it set to a published user parameter with no default value. In the subscription configuration, the "Source Zip File" parameter is set to "Get Value from Topic Message". However, that parameter evaluations to the path of the JSON file created with the topic is published to, not the zip file path. From the log: FME Configuration: Command line arguments are `fme' `Test\\LaTaxTableImportForDirectoryWatcherWBR\\LaTaxTableImportForDirectoryWatcherWBR.fmw' `--SourceZip' `$(FME_SHAREDRESOURCE_SYSTEM)temp/subscriptions/c2177f37ebd94805bd9717d51d228e46.json' `--FME_TOPIC_MESSAGE' `$(FME_SHAREDRESOURCE_SYSTEM)tem

I am trying to setup a workspace automation but when i point it to the workspace i want to run it says there are "No Parameters Available" for me to establish. However, when i navigate to the Workspace itself (outside of an automation) I see all of the parameters. I recently upgraded to FME Server 2021.2 and am using Workbench 2021.2 as well. It is an existing Workspace that was authored in a previous release. I opened it in 2021.2 and published it. I copied the contents into an entirely new workspace and published that with the same issue. I authored a simple workspace (XLS->FFS) and the Parameters showed up as expected so I think it may be something to do with the Workspace. It is rather large and I dont want to have to redo the entire thing. Any help would be much appreciated.

In my automation I want to include the server name in my success / fail emails. That way from the email you can determine if the emails is coming from the dev / test / production server. Can not find the server name as one of the keys available.

Hi All, Running an automation to pull data from an external SFTP site to be post processed with multiple other workspaces. I've set the time per my server at 4:15 am (and tried 4:30am, now trying 5am), have checked my server, it is set to EST (UTC - 4 since we are in DST now). Schedule trigger states that it uses the local time on the FME server). Looking at the SFTP thin client website, the data says that it was uploaded at 4am today. When looking at the same SFTP site via WinSCP, it says that it was uploaded at 12am today. My automation appears to be working as it should by processing all of the data. However, it is consistently having the previous week's data (it is only uploaded to the SFTP site once a week and I process only once a week). What time should I really be using for getting this data? When I trigger the automation after 8am EST it picks up the currently shown data (although it is dropping it on the server with the 12am timestamp). I would have thought that if I had a ti

Suppose I have two workspaces A, and B that run sequentially in a scheduled job. I want to start B if A actually runs through and writes something to the writer. If nothing writes in A, I don't want B to start at all. I could think of a few ways to do it, but all require writing intermediate status data to an external file or database. Should there be a simpler way to do this in the FME server automation (I am at 2021.1.2)? Is it possible to do this in the startup python script - if a condition is not met, terminate the workspace?

I would like to automate the following processes by a batch job or equivalent. Please advise if you have any idea. Here are the steps what I am working now. Firstly, load the CityGML to a FME workbranch by the "Reader". Secondly, select fme_basename and fme_feature_type in the "Reader" setting. Thirdly, I will select excel file in the writer and link up the "Reader" and "Writer". Finally, go to "Run" > "Run Entire Workspace" to export the result and the following is the result sample.

I used rets-connecter runner to download the source data(CSV file) from vendor , and after that fme will read this file for further process. But My System Caller running forever, it's not coming out, executing continuously.. But in command line , it executes immediately and come to the Drive prompt(i mean E:\temp>) fmw file attached. Can Anyone pls help Command line to run this workspace: "E:\Program Files\FME2021\fme.exe" E:\FME_TEMP\wb-xlate-1647675806459_11696 --FME_LAUNCH_VIEWER_APP "YES" Starting translation...Current FME version: FME 2021.2.1.0 (20211203 - Build 21797 - WIN64)FME_HOME is 'E:\Program Files\FME2021\'FME Database Edition (node locked-crc)Serial Number: Z6XB-SJY8-15LXPermanent License.Machine host name is: PXLLTPRD276Locale: en_INSystem Encoding: windows-1252FME Configuration: FME_BASE is 'no'FME Configuration: FME_MF_DIR is 'E:\FME_TEMP/'FME Configuration: FME_MF_NAME is 'wb-xlate-1647675806459_11696'FME Configuration: FME_PRODUCT_NAME is 'FME(R) 2021.2.1.0'Operatin

PROBLEM 1 if in column TYP the value is PL than do nothing (keep the cell G1, H1, I1 empty) ******************************************** PROBLEM 2 if in column TYP the value is PE than calculate value in "x1 in (m)" check condition "F is W" or "F is E" or F is S" here the condition is "F is W" so fill in default value from "Y in (m)" to "y1 in (mm)" and from "Z in (m)" to "z1 in (m)" FORMULA to calculate/obtain value in "x1 in (m)" i.e. 1960.85 from the DIM in (mm) always select the first value before "x" for i.e. 600 and convert it from millimeter (mm) into meter (m) i.e. 600/1000 = 0.6 now add the result i.e. "X in (m)" + "0.6" ******************************************** PROBLEM 3 if in column TYP the value is HO than calculate value in "y1 in (m)" check condition "F is W" or "F is E" or F is S" here the condition is "F is E" so fill in default value from "X in (m)" to "x1 in (mm)" and from "Z in (m)" to "z1 in (m)" FORMULA to calculate/ obtain value in "y1 in (m)" i.e. 5988.27 from

Hello I have an automation action that generates some files inside the FME Server 2021 Data folder, I need to zip the output folder after the action is complete. Can some one please advise? e.g. after the action is complete, all results will be populated in $(FME_SHAREDRESOURCE_DATA)/ALIM3263/destination/Extraction/ I want to compress whatever files in the extraction folder as one single zip file and save it to: $(FME_SHAREDRESOURCE_DATA)/ALIM3263/destination/Compression/

Hi everyone, I would be happy if somebody can give a thought to address the issue on automating FME. Presently, I am processing .csv files in FME to create some spatial data (points/lines). Problem is the .csv files are located inside Azure Blob storage containers along with several datasets. I am manually finding out the latest containers to download the csv file to local directory and then processing the same using FME workbenches. I have already added a AzureBlobStorage Container in FME and connection parameters successfully, but not getting a sense how to download all the csv files automatically from all containers and store it to a local or temp directory to process further. My Flow is -- Creator > AzureBlobStorageConnector Additionally trying to find out any possible way to create a mail or other alert system, so that, whenever new data would be uploaded/downloaded/deleted to Azure, it will show up in fme.

I have a workspace which goes off to the www to download a file for processing further along the workbench. Once the task has completed how can i automate deleting all contents of the specified folder. I am aware of directory watch to do something when a folder is modified or deleted, but i just want to delete the contents.....

I am trying to set up an FME Server Automation, which runs a model every first day of the month. I bump into 2 issues: 1) To set up the schedule trigger, i can not choose "every first day of the month". Apperently the monthly option only lets you choose a montly run from the day it is today (in this case every first monday of the month). How to go about? 2) I want to let the input parameters change for each monthly run. In this case the model does a calculation from a start date until an end date, and the start date needs to be the first day of the previous month and the end date the first day of the month it runs. How can I make these input parameters a variable? All suggestions welcome!

I would like to know if there is anyway I could export an ESRI FGDB to XML Document within FME and not through the manual process in Arc Catalog?

We have a script in FME Engine Linux FME Server 2021.0.1 Build 21313 - linux-x64 Why we can't transfer file via sftp using planned actions. And why we can transfer manually using the same script.

I understand that FFS is an internal file format to FME, and presumably it gets updated with each new version of FME. Will the FFS Reader handle an FFS file that was created by an older (a decade old) version of FME?

I'm trying to use the built-in SMTP of an FME Server running on EC2 but I can't seem to get it to work. I've opened port 25 in the EC2 security group and there's, as far as I can tell, nothing else using that port. Any ideas?

Hi, Is there any way to control the ID when uploading I3S files via ArcGISOnlineconnector? Does not seem to have a replace action. Delete and uploads works fine but its kind of useless when the apps no longer can identify the scene layers cheers Henrik

Hello I managed to create an automation in FME server and successfully linked the webhook of FME to the Azure Event Grid as shown in the attached snapshot. Currently I just read the event as JSON to the logger. The output is like this: { "data": { "storageDiagnostics": { "batchId": "c10819b2-b006-00a8-00f0-187e50000000" }, "clientRequestId": "3f49ecb9-a829-406c-948e-d57c85c4104f", "requestId": "a4247e74-601e-005f-0cf0-1854c2000000", "eTag": "0x8D9E70737425603", "contentLength": 17600, "api": "PutBlob", "blobType": "BlockBlob", "contentType": "image/png", "url": "https://fmeserverin.blob.core.windows.net/in-files/augmented-reality.png", "sequencer": "00000000000000000000000000014D700000000001f44698" }, "dataVersion": "", "subject": "/blobServices/default/containers/in-files/blobs/augmented-reality.png", "eventTime": "2022-02-03T11:20:42.751Z", "topic": "/subscriptions/acc9023a-4f9b-447c-b394-8da2c7b9d1f5/resourceGroups/CDEMVP-APP-DEV-RG/providers/Microsoft.Storage/storageAccounts/fmeser

I have a question that is indirectly related to FME. In short, we have a series of ETL scripts that process data that eventually gets used for FME transformations. These scripts populate a Postgresql database and are scheduled to run on a periodic basis. Occasionally, a script will fail in its processing, leading to some database table to remain locked, for example. Currently we are using the pgadmin tool dashboard to manually detect such events and to resolve them. I was wondering if you are aware of any tool that could be used to automate the monitoring of database sessions, like sending alerts if a query takes longer then "n minutes" to complete. Thanks! Bruno

Hello, I have set up a IMAP publisher to poll one of our inboxes. The idea is for it to trigger a workbench to download and process data when our supplier informs us of an update. When I send a test email which is either blank for in plain text it works, but the supplier emails are HTML and the JSON in the Topic is invalid. The part of the JSON that is invalid is in the imap_publisher_content{0} section. This is the HTML message which I think it treats and JSON so fails when it’s expecting a : or }. Please can you help? Thanks, David

I wanted to centralize assignment of Database Connections in my FME Server automations. I currently have a published user parameter on each of my workspaces, connected to the transformers in each workspace, that I can set in each workspace action individually in an automation to switch between databases to load. Each time I want to switch the location I have to change the user parameter on each workspace action in the automation which feels a bit clunky and prone to error if you have many workspace's in an automation. I was wondering is there a way to centralize assignment of Database Connections in the FME Server Automation? I thought perhaps creating a Global Key for the database connection might work but that doesn't look like it's possible. Is there a better way to do this?

This workbench is run on the server and uses the FME Server email generator. We want it to generate a text which includes the original total records read from 2 separate tables used as input eg 2913 from table 1 and 7429 from table 2 the total number of records in the output file geodatabase. We have got it to the point that it automatically fills in the total records from input table 2 but not the other 2 numbers. What could we be doing wrong?

Hi. I have a folder name PLAN. In the folder PLAN i have a lot of subfolders (B53, B54, B89, etc..). More then 500. In each subfolder (b55 for example) i have a subfolder name TERRITOIRE (PLAN/B54/TERRITOIRE, PLAN/B109/TERRITOIRE), and also other folders with other name. I want copy TERRITOIRE subfolder from each subfolder in a new folder with the name of subfolder. NEWFOLDER/B56/ TERRITOIRE NEWFOLDER/B55/TERRITOIRE. Thank for help.

The result of my workspace is several geojson files. For usability purposes, I want to include a fixed template .qgz file which is already on the server in the zip, so end users can immediately open it in QGis. However, I can't find a way to get this to work with the Data Download service. ​ As a proof of concept, I created a minimal example that just loads a binary file, and writes it again. However, the AttributeFileWriter can't be selected as a Writer output for the Data Download service. Is there another way to include arbitrary binary files with data download?