- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Search

Unanswered questions

149 Posts

Flow jobs failing on python script using exportToPDF

I have several automated jobs that use either a startup or shutdown python script. These scripts run fine in workbench and even in the ESRI Python interpreter on the Flow machine. The issue arises when I run them from Flow. When it gets to the script it will output expected products until the exportToPDF command at which point it fails. No errors are indicated anywhere except in the Engine Log where this is displayed: WARN localhost_Engine2 393562 : Process "localhost_Engine2" ended unexpectedly. Being restarted on attempt 1…Example of script:import arcpy, os, sys, time, shutilfrom datetime import datetimesdpFolder = r"****OBSCURED****"exportFolder = os.path.join(sdpFolder, "SiteDevPlanFiles")date = time.strftime("%Y-%m-%d")dateFolder = os.path.join(exportFolder, date) archiveFolder = os.path.join(sdpFolder, "_Archive")zipExportFolder = exportFolder + ".zip"# from zipfile import ZipFile# for file in ZipFile(zipExportFolder).namelist():# archive previous zipdestZip = os.path.

13 minutes ago

davtorghContributor

asked in Authoring

Dynamic Excel Writer loses font settings

Hi,when writing using a dynamic Excel Writer (in my case there are no columns defined at design time - see attached screenshot), the font settings get lost in the output file and also in the Feature Type Writer itselfs when I double-check it.Has anyone solved this issue?Thanks!

353

27 minutes ago

cruzhParticipant

asked in Authoring

Creating a web page based on excel data and user input from a drop down.

Hello:This is probably a simple use case to many of you, but I only have basic experience with FME Form and Flow.One of our programs has the ability to generate standard excel spreadsheets which contain reservation data (Date, Name of Room, Description of Room activity, Organizer contact info) GOAL: We would like FME to take that excel spreadsheet and post that data as a table on an html webpage.However, before that html webpage is generated, we would like the user to visit an FME Flow App (? I think) that will allow them to select from a dropdown list of rooms culled from a column in the excel spreadsheet. Once selected and submitted, the app would only show the list of active reservations Things to note:This excel spreadsheet data is updated once a day and will only show the current day’s data and will need to be uploaded to FME Flow each day. It’s being stored on a network location.I’ve managed to create a FME Desktop app that uses Excel Reader > HTMLReportGenerator > HTML Wri

2 hours ago

syedh2993Contributor

asked in Transformers

Aggregator - Geometry aggregation issue

Hi All,Need your help fix the below scenario,I have a dataset approximately 100,000 records and these records have Polygon geometryI am using "aggregator" transformer to group the records as per column attribute and it creates 100 aggregated records.My requirement is to show each aggregated record as 1 shape on the map when user clicks on it.Issue: I am facing issue with geometry aggregation. When I plot data on ArcGIS online, I see all 100 aggregated records, but see some empty spots on the map.If I plot the same data on map without aggregating it, it plots fine.looks like something is going wrong with geometry aggregation.Would really appreciate if you could provide some input on how to handle it.Below is the configuration of my Aggregator transformer, Thanks,

112

2 hours ago

kateaewContributor

asked in Data

ESRI Geodatabase domains - no ESRI licence

A client of ours is changing their spatial data format from MITAB to ESRI GDB. They use domains in their GDB and we don’t have an ESRI licence so am unable to read these in correctly with the domains exposed. I have requested the XML to go with it as per what I found in other threads.Is the best way to give it geometry to pop on a map a FeatureMerger with the XML and GDB, matching on an ID they have?I can’t help but think this is a poor way of doing it (it took forever as it’s a large dataset when I tested it), but without the ESRI licence I think I’m a bit stuck for options. Wondering if someone has a better solution.Using FME Form 2024.1Thanks!

553

3 hours ago

9valContributor

asked in Automation

Deleted automations continue to run jobs

Hi all,I removed/deleted several automations in FME Flow (Server), I stopped most of them, but probably not all. All these automations were monitoring the same folder, and for some reason they are still running and processing jobs.How can I completely delete them?I have already tried restarting FME services and restarting the server, but that didn't solve the issue.

4 hours ago

wilsonleeParticipant

asked in Transformers

ArcMap License will expired, and how to switch to ArcGIS Pro license?

Hi, our ArcMap license will expired tomrrow and will not renew after it expired. Also, I have Arcgis pro installed on my machine and the license is valid (will not expire).Currently all of my script setting is set AUTO under the “Esri ArcGIS Compatibility” . Will the AUTO setting pick to ArcGIS Pro license, after ArcMap license is expired? or do i have to manually set to ArcGIS Pro in each FMW script individually?“FME Workspace, go to Navigator --> Workspace Parameter --> Translation --> Esri ArcGIS Compatibility --> AUTO”thanks,Wilson

150

4 hours ago

juneraquelreyes

asked in Transformers

Convert Esri File GDB/Shapefiles to MBTiles

Is there anyone here already converted esri file gdb or shapefiles to mbtiles? I tried but it's giving me this errors:MBTILES writer: Failed to obtain raster from feature. Only features with raster geometry are expectedA fatal error has occurred. Check the logfile above for detailsThanks for the help.

2727

5 hours ago

n.dContributor

asked in Authoring

Coordinate systems are not available in FME Flow

Hi everyone,I have a question about the Reprojector. In the reprojector in FME Form, my desired coordintion systems are available: But when I publish it to FME Flow, some of the coordinate systems are not available to select from: Could you please help me to solve the problem? Thanks!

111

5 hours ago

ohashkiiContributor

asked in Transformers

Shortest path from all points to all other points in my dataset

I am trying to find shortest distance from all points in red to all other points in green using network connecting all of them. The point feature has only types (A,B).Is it possible to have the short path finder to search the path always staring from point A to pint B.

627

7 hours ago

bruceharoldContributor

asked in Data

Partioned parquet writing - partition attribute order

HiQuick question before I fall back on trial and error, because my dataset is quite big, but does anyone know if changing the partitioning attribute order on a partitioned parquet writer determines the partition folder hierarchy? The doc says its the schema order which determines the partition hierarchy, I’m hoping to override the reader’s attribute order. I’m hoping manually editing the writer attribute order will determine partition hierarchy. Thanks.

How to convert cog tiff to citygml TIN relief?

I want to convert a tiff to TINrelief in citygml. Is there a fmw workbench file or step by step guide for this? I’M a complete begineer to fme and citygml format.

121

9 hours ago

redgeographicsCelebrity

asked in Data

Does FME support the new ArcGIS Online data types

Quick and easy question I hope: does FME 2024.2 support the new ArcGIS Online data types (Date Only, Time Only, Timestap Offset and Big Integer) as described here: https://www.esri.com/arcgis-blog/products/arcgis-online/mapping/time-is-on-your-side-with-new-field-types-in-arcgis-online/

341

9 hours ago

p_c_20Contributor

asked in Authoring

Setting off one filecopy feature writer after another has finished?

I am building a workspace to do data prep for an AI model training process. This will involve, in this order: Copying a number of image files of type A When copying completed, creating image label .txt files for these when all image copying and label creation complete, copying an exactly equal number of images of type B (from a larger pool than that of the A’s) creating the image label files for these Terminate process when counts match1 and 2 are working fine. I’ve added a counter after stage 2, and I want stage 3 to keep running until the count of type B images copied = count of type A images copied. How might I a) kick off 3. only when 2. is finished and b) stop 3. when count of B = count of A?

110

11 hours ago

clowncutieContributor

asked in Transformers

Overlapping lines with priority

I have been checking a lot on this link but its not exactly what I want. Combine overlapping/touching lines into one long simple geometric line | CommunityI have one geopackage with lines of different types that overlap, 2 attribute types, the blue type and the red. As you can see they overlap.I want the red lines to take priority, meaning where the red lines are the underlying blue lines should be remove so I only have 1 layer of polygons with the 2 types. Note that the length of the blue line doesn’t always match the length of the red so the underlying blue line have to be cut. I have filtrered them, tried line combiner, line on line overlay which generates INVALID_POLYGON_GEOMETRY_VERTICES error. Reader polylines with attributes TestFilter, filters and splits the 2 types I want based on the type name ??? Before reader im gonna do a snapper since dataset have some gaps some of the read doesnt reach the entire way to the blue in some instances. Result example (also want snapper in t

444

11 hours ago

evoteckSupporter

asked in Authoring

It’s about this error message "No Module named GeoEncoder", how can I solve this error?

12 hours ago

eric_armitageContributor

asked in Transformers

Problem using FeatureReader with ArcGIS Portal Feature Service

I’m trying to use the FeatureReader to read 3 features from an ArcGIS portal feature service layer by reading in a spreadsheet and using a WHERE clause with an attribute in the spreadsheet. The FeatureReader will connect to the service and I can select the correct table in the “Feature Types to Read” parameter. But when I try to add the WHERE clause FME crashes before I can start creating the WHERE clause. The second image below indicated the point when it crashes.I can read the full table with no problem using the ArcGIS Portal Feature Service reader. How can I get the FeatureReader to run and read the required features?

383

13 hours ago

lifalin2016Contributor

asked in Data

GeoDatabase writer works on desktop, but fails on server ?

Y’all.I have a workspace, that exports a number of database tables to a File GeoDatabase.The workspace uses a FeatureReader and a Writer with three dynamic featuretypes (for point, line and polygon features). The writer is “Esri Geodatabase (File Geodb Open API)”.When I run it in Desktop(Form) 2020.2, it works perfectly.When I run it as a job on Server(Flow) 2022.2, all features issues a warning, e.g.FileGDB Writer: A feature with feature type `HOERSHOLM_Afløbskomponent_point' could not be written I’ve tried running it in Desktop 2022.2, and this apparently doesn’t work either.I’ve tried to upload the workspace from here, but this still fails the same way.The output path is a UNC path to a ZIP file.Does the FileGDB writer have an issue with 2022.2 or any of the above details ?

13 hours ago

bigapplerizzi19

asked in General

How to generate TINrelief of CityGML from TIN generated by TINgenerator

I generated TIN by TINgenerator.I would like to procedure to generate TINrelief of CityGML from the TIN.

984

14 hours ago

mzebrowsContributor

asked in Authoring

How to set log file as a parameter?

Hi,I need to set log file path as a parameter. So I ‘ve added User parameter LogFile and linked it to log file inNavigator-Workspace Parameters-LoggingI’m running my workflow as follows:"C:\Program Files\FME2\fme.exe" C:\FME\mz\WybranaSiecPomDgn2k.fmw --LogFile "c:\Folder1\File.log"The problem is, that “c:\Folder1” folder does not exists, and the following error appears:“Unable to open log file `c:\Folder\File.log'. The preceding error has occurred during FME logfile setupProgram Terminating”I was trying to create “c:\Folder1” folder using Scripting-Startup Python Script, but it doesn’t help, probably because FME tries to create log file before Python script execution.

435

15 hours ago

brendwalContributor

asked in Automation

Run a workspace in Automations with Data Download Service

Hello,I’m looking to trigger a workspace with a webhook which generates zipped data using the data download service which then provides that data link URL in a customized email to the user.I’ve setup an Automation to be triggered by a webhook which will run a workspace that generates the data (and outputs the information for the email with an Automation writer). I’ve got this launching another script that uses the first script’s JOBID along with an HTTPCaller to get the URL link which is then output using an Automation writer. This is finally passed through a Log and then on to an Email external action that uses the email information and the URL to generate a custom email with the download URL.However, when I trigger the automation, no URL is generated (even though the process works) as the workspace is not run with the Data Download service. I assume it defaults to Job Submitter. Is there a way to run a workspace in an Automation and make it use the data download service?If not, how c

563

22 hours ago

rongParticipant

asked in Authoring

Parameter in Filename Not working in Flow

I have a user parameter that I use when writing out the file in Form ("$(ProjectID) Report.xlsx"). This works as I want when running in Form, but not when I publish it to Flow. The parameter doesn’t get set a part of the filename (_Report.xlsx).Any ideas what I need to do differently to get the same filename in Flow that I get in Form?

22 hours ago

coryContributor

asked in Integration

FME Form drops Deployment Parameters (Password) after editing Reader/Writer

Hi team,I’ve noticed a bug within FME 2024.2.1 (Build 24801)… When I’m building out a workspace and reference a Password Deployment Parameter in a reader. If I edit that or any other Reader or Writer under the Navigator (i.e. Right Click, Update Reader, make changes and click OK), it will drop the Password Deployment Parameter, anywhere they are referenced.Text based Deployment parameters remain, but it just drops the Password based Deployment Parameters. Has anyone else seen this issue? Once they’re all set and we publish, it seems to retain them, but it’s only after we update the Reader and Feature Types.

353

1 day ago

aaronContributor

asked in Architecture

Path for FME_SHAREDRESOURCE_TEMP?

I created an FME Flow cleanup task for a folder under Resources/Temp. However, cleanup isn’t happening on my test folder because FME Flow isn't resolving to the correct path for the FME_SHAREDRESOURCE_TEMP parameter. The path on the server is D:\ProgramData\Safe Software\FMEFlow\resources\temp\, which matches the path for the FME_SHAREDRESOURCE_TEMP parameter listed in the fmeServerConfig.txt file. The error in the system cleanup log states “Path not found for system cleanup:D:\ProgramData\Safe Software\FMEFlow\resources\system\temp\AA_Test.” - same but with “system” folder added in the path. Should I be using a different parameter? I'm unclear why the path for FME_SHAREDRESOURCE_TEMP is different in the system cleanup task from what is listed in fmeServerConfig.txt file.

283

1 day ago

aaron_chaputContributor

asked in Flow Hosted

HTTPCaller Timeout after 300s Regardless of Timeout Values Set

Hi,I’m attempting to run a workspace on FME Flow Hosted from within another workspace with an HTTPCaller using a webhook URL.The child workspace will eventually return a URL link to a zip file as it uses the DataDownload service.The workspace can take some time to run (> 5mins) as the data can be quite large.My issue is that I want to run the job synchronously so I’m able to retrieve the URL within the parent script to send it within an email, but the HTTPCaller always times out if the child script takes longer than 300s to run even if I set the timeout values to anything over 300s or even 0 (wait indefinitely). It is successful if the child script runs quickly (<300s).This is a problem as most instances will take longer than 300s.I don’t understand why it times out if it goes over 300s even if I tell it to wait longer.Is this a bug? If so, is there a work around or is it on the path to being fixed?Thanks

203

1 day ago

Page 1 / 6

Badge winners

joshmonhas earned the badge Student (Grey)
angwanhas earned the badge Welcome Back
phoefflerhas earned the badge Conversationalist
cruzhhas earned the badge Community Engagement Day
cruzhhas earned the badge Student (Grey)

Show all badges

30,548: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.