Automation

Hi Everyone,I was hoping to find a definitive guide explaining how to use CI/CD automation with FME. Right now we have very few workspaces and so we use a manual process to deploy FME things in production. We use Publications, Schedules, Subscriptions, workspaces, data files (for passwords), database connections, etc. I looking for instructions to help with following:Integration with a source control like GIT so that we have versioning set upA guide/tutorial that can explain how to automate deployment of all things FME. If something cannot be deployed via automation, I would like to know that as well.Any pointers on automated testing of FME workspaces/schedules once they are deployed in an environment.

Hello FME Kings, Here is my situation: I have a script that uses HTTPCaller for geocoding in OpenStreetMap and MapGeoAdmin (retrieve coordinates from an address in an input attribute) and, sometimes, several "addresses" are located for the same input address which gives me a list of addresses (extracted with JSONFlattener). My problem is that I would like, in one script (and I've been working on this for a while), to stop the script and generate a dialog box with the possibility to choose the right address in a dropdown list like thisATTRIBUT ADDRESS ENTRY => CHOICE OF DETECTED ADDRESSES (combobox)  => "1, Chemin du Lac de Mont-d'Orge, La Muraz, Sion, Valais, 1950, Suisse"                => "1, Rue du Mont, Sion, Valais, 1950, Switzerland                => "1a, Chemin du Lac de Mont-d'Orge, La Muraz, Sion, Valais, 1950, Switzerland"... since, in an automated way, it is not possible to know which one is the right o

How we can read any specific Microsoft Outlook email and excelsheet attachment with data from email to add this excel data in FME Workbench to process ahead and generate the required output as reports.

Hi Team, Is there any limitations for size of job log. My job keep restarting if the job log reaches to 25 page. Thank you

I would like to write attributes name including data for each attribute at specific cells in excel file .how could I achieve that Fme 2021

Every week we have a field crew collect and add data to a geodatabase throughout the week. At the end of the week the Supervisor wants an excel spreadsheet of all the data collected in that week. I have a workspace that runs FME every Monday to collect the weeks worth of data. Right now, I use a tester transformer and I pre set the dates for the following week so when the workspace runs, I have the correct weeks' worth of data. We have field in the geodatabase that collects the date the asset was collected. Then I have task schedular set to run the workspace.  My question is, is there a way to pre set the dates instead of me re-setting them every week? I have tried using Datetimecalculator but I can't seem to get the parameters right. Please let me know your thoughts, thanks in advance!   

Hi ,i just upgrade FME server from 2021 to 2022.2.5 and i get this message during running job on FME server.AUTOMATIONS writer: AUTOMATIONS_2: Error, unsupported list attribute detected...is it a bug and not solved?please advise , my goal is counting records from written shapefile.also attached the log file. thanks in advance.

i just upgrade FME sever from 2021 to 2022.2.5 and i get the error:AUTOMATIONS writer: AUTOMATIONS_2: Error, unsupported list attribute detected '_feature_types{}.countis it a bug? or what can do to solve the issue.my goal is want number records from written shapefileThanks

I have an almost identical setup for a different source file type (xml) and that works perfectly, specifically the automation says it ran successfully, the jobs run as they should, and the files are moved and renamed. I can manually trigger the workbench in automations by adding the manual trigger and it performs correctly.  I tried separating that one workspace into a different automation that is triggered by a topic at the end of the first one, that doesn't work.  I can test the topic trigger and that makes the automation and workbench run, and things work correctly.  It seems I can only get it to work by triggering things manually.It works fine on desktop. The paths are all UNC. I've experimented with adding the path to resources and referring to the location using that. When things don't work, there is no error and no relevant warnings.  Thanks for any ideas.  FME Server 2022.1.3Build 22630 - win64 Desktop Client is also 2022.1.3   

I was testing an email triggered workflow using FME Server Automation and in that try to attach a file from UNC path (network path) as attachment using Global Key to pass a value to 'Email Attachment ' parameter inside an Email(Send) - external trigger . However the workflow doesn't recognize the file path mentioned in my Global Key . Alternatively if I use a file from FME Shared Source Temp directory path ,the workflow runs without any issue and I was able to receive emails with attachment. So I am not sure using file UNC network path as Global Key in FME Server Automation is supported or not. Any insights appreciated.Ex: ( Using Global Key - Not Working) global.EMAIL_ATTACHMENT = \\\\kcr-fs-v\\ShrData\\Staff\\KS\\20230419_EmailAttachTestLog.txtEx : (Using FME Shared Resource Temp Directory - Working )(FME_SHAREDRESOURCE_TEMP)/test/20230419_EmailAttachTestLog.txt

I have multiple FME workflows that trigger once via my directory watch. How do I avoid a SQL deadlock since they all upload to the same SQL database table?

I would like my automation to watch a directory. If there's a update, then the rest of the automation runs, but only during the night.I could use a directory watch trigger to run the automation immediately after a change, or use the schedule-trigger to run the automation during the night, but how can I combine those triggers?Thanks, Vera

Hello all,I have an ArcGIS Portal Hosted Feature Layer that has a number of sublayers. One of the layers contains photo attachments.  I've had success when the attachments are not in a sublayer using this video as a reference: FME World Tour 2022 How Do You Get 30K Photo Attachments Out of ArcGIS Enterprise or ArcGIS Online? - YouTube However, I'm stuck trying to figure out how to download the photos given they are in a sublayer. The Esri ArcGIS Portal Feature Service doesn't seem to offer the option of sublayer access. Thanks

I've never seen these key outputs when selecting my action to filter messages.  Previously, my FME automation was set to filter through my file / directory parent folder to find the correct file needed (when triggered) and then run the respective workspace.  Would "Workspace Name" be the correct choice to use here?   

Hi all.I have two sets of automations, where all automations in set 1 needs to be all done before initaiting all automations in set 2.I'm wondering what the best practice is for this scenario ?I tried to include an active wait mechanism in the set 2 automations, but then they just got started first, blocking the set 1 automations.I'm starting all set 1 automations with a single (topic) trigger, as they may run in parallel, and I can start all set 2 automations with another single trigger. But all set 2 need to wait for all set 1 to finish, and that I can't do with triggers as far as I know.All help and suggestions are appreciated.Cheers

I have a workspace that proceses a lot of features and then writes it to a geopackage but it replaces the file with new data.I want if the file exists to append the features if it does not exists to create the file.How do i do that?

I have a workbench intended to run daily on FME Server. It does the usual data transformation stuff and then it email reports to a member of staff once per week. The report contains information relating to contractor performance over a 30 day period. I only want to send out a report if there's in new activity in the past 30 days. Currently, I have 9 x reports (one for each contractor). The reports are updated daily. I want the Emailer transformer to email only those reports containing new activity. I have gotten as far as calculating which reports are valid (i.e. within 30days) and using an Attribute Creator to fanout a new attribute, being the path & filename of the report. The Emailer then reads the fanout parameter as the Source File, picks it up and sends it. The problem is, the Emailer is sending each attachment in individual emails. I want the transformer to recognise which reports are valid and then send them together in a single email. The image I have attached shows 5

I'm having some issues with our FME Server which I don't understand. Every now and then, when running a nightly scheduled job, a FeatureReader fails to read a CSV file. The log returns:Trying to find a DYNAMIC plugin for reader named `CSV2'Library 'D:\Program Files\FMEServer\Server\fme\plugins/CSV2.dll' was found but could not be loaded. Ensure that all the dependent modules exist for this libraryModule 'CSV2' is unavailable for use with this FME editionWhen I resubmit the job, everything works fine... which is great for the data being processed, but harder to debug. The issue feels somewhat familiar and I did find similar questions but not related to CSV2.dll.I'm quite sure this is not related to desktop/server versions. Version is 2019.1.2.As far as I am aware nothing has changed in the installation, I do know the certificates were replaced recently but I doubt this has anything to do with it. Not sure where I should start looking, can anyone point me in the right direction? Update: 

Hi all.Has anyone attempted this ?I'm exploring the possibility, and although it ought to be possible, it fails to validate.One this puzzles me though: All configuration examples I've googled, mentions both an EMAIL ADDRESS and a USERNAME, which is also an email. And they're different when accessing a shared mailbox.But the automation trigger only has one "IMAP Email Account" setting.Is the IMAP trigger missing a setting ?Cheers.

I am trying to set up an automated fme workbench to run once a day. I ran the Workbench in FME Server and it ran just fine without error. All this workbench does is run a SQL Creator that sends the data to an excel writer (one for each type of permit) and then it saves the files into a folder on FME Server. That is all it does. The version is FME Server 2022.2.1.

Hi everyone, I'm trying to convert a PDF file containing geographic data into a shapefile format using FME. There is a lot of work that has been going on in the recent past on this, and even I had tried a few online tools, QGIS plugins and now playing around with FME using a few transformers.Actually, my spatial pdf file has the transmission lines network that includes transmission lines, substations and the geographic region with text information provided that represents the points and lines on the file with a descriptive legend.Since I couldn't efficiently work with that file as it is 15Mb and has around 800k entities, I am working on a sample pdf.Can someone guide me through about what concept can be applied to perform this?Thank you.Attached:wallawalla.pdf: sample fileERCOT: Practical file

Hello. Using FME Server 2022. I have an issue monitoring our FTP. I want to monitor all subdirectories for changes. I keep getting an error where "/." is being appended to the "Path to Watch Directory" an infinite number of times. I get thousands of errors from the automation. Here is the error message:When I check into our ftp client logs, here is an example of the file path that FME Server creates: /upload/Directory/./././././././././././././. Why doesn't the trigger just detect and stop at the directories that exist?     

Using my basic FME skills, I've been able to automate the download of the OS Mastermap Topographic Area, Line and Point but am struggling over how to maintain the changehistory feature collection type which FME wants to insert a single value. Being a common task amongst many GIS users, I would hope there are some models out there....?

I have succesfully set up a PostgreSQL trigger and PL/Python function to POST some JSON to a webhook using our on-prem PostgreSQL database and FME Server. It works well following the instructions here and here. However, our PostgreSQL database is moving to AWS RDS and PL/Python3u and PL/Perlu are not allowed as untrusted languages and the trusted versions won't allow the GET/PUT/POST operations. I have seen mention of using ActiveMQ, NodeJS and others and wanted to know if anyone has a working solution in AWS to share or can point me in the right direction?

Currently, I have 15 workbenches in one FME Server Automation.  I have it set up to filter through the respective workbenches to find the correct workbench to run, but now I'm struggling with figuring out how to run the second workbench once the first one is run successfully to completion.  Through testing purposes, I noticed that my automation would select the correct workbench and then immediately run the second one despite the first one not being completed. It'll run the second workbench after triggering the first one to run. SO, it isn't necessarily waiting for the first one to complete successfully.  Is there anything I could add to my FME Server Automation to pause my second workbench until my first one is finished successfully?