Creating and organizing workspaces. How to use Workbench.
Recently active
N/A
We have a workbench that runs daily via windows task scheduler which reads data from an Oracle database and ArcGIS Online and then writes to SQL Server. The process has run for some time but the other day there were some issues with the output dataset. On viewing the log file, it appeared that only 2000 of aprximately 50,000 records were read from AGOL. However, there were no error messages to say that it han’t read the whole file. Is there an easy way to build something into the workbench to sent a notification email to check that the whole file has been read in to prevent this issue happening again? Thanks
Hello, thereI would like to prepend one dataset with other datasets and return other datasets as output. Please refer to the screenshot below, this should be done with only one workbench. Highly appreciate your thoughts.
Good morning.After an upgrade from FME 2024 to FME 2025.1, there is a workspace using the SharepointOnlineConnector that is throwing this error:176 2025-12-18 07:15:19 | Message Type: fme::internal::_v0::py::Exception 177 2025-12-18 07:15:19 | Python Exception <ValueError>: unknown locale: en-US 178 2025-12-18 07:15:19 | PythonFactory failed to load python symbol `fmepy_microsoft_sharepoint.connector.SharepointOnlineConnector'. An outdated FME packaged transformer may be in use. Please check Utilities > FME Options > FME Packages to confirm that all FME Packages are up to date Other workspaces using the same connector are working fine.I have tried to do a clean removal following these steps: https://support.safe.com/hc/en-us/articles/31697273147533-Introduction-to-FME-Packages#h_01JDX0A9AV157VR7QHVRZ7G03WBut the error persists. The package in FME Form and Flow is updated to the last version available: safe.microsoft-sharepoint [1.9.1].As the locale error happens be
Hello everyoneIn 2025.1 FME Form I can use the Civil 3d reader, to read extended data from a dwg file just fine. Within the reader I just have to make sure the option for “Civil 3D and CAD entities” is on and leave the other settings as default.The challenge comes on writing extended data. I can write ‘object data’ just fine but I cannot figure out how to write ‘extended data’. The picture below shows where I want to be able to write data to within the Civil 3D interface, from FME. Any insights would be valuable.Thank you
Hi,I have 79 single-band rasters, each a step in a time series, with Int8 values that reprepresent a risk class. I want to get the max value for each cell and use a RasterMosaicker to achieve that. Then I use a RasterToPolygonCoercer to convert to polygons for further analysis. My problem is that converting the raster from the RasterMosaicker is extremely slow and performance demanding compared to converting the individual raster I have before the mosaicker (the timesteps are converted in a matter of seconds whereas the mosaicked raster takes in the range of an hour or more). This is an example of my workspace:Why is it so much slower to convert the mosaicked raster? As far as I can see they have the same properties and dimensions. It does have more data but not by much and still most of the cells are nodata. Is there a faster way to achieve the same thing or am I missing something? Thanks!
Hello Forum, I have two polygon datasets read into a FME Form workspace: Dataset 1: Super Output Area (SOAs): This is where the entire authority area is divided into 165 SOAs. No part of our authority area is not covered by a SOA. Dataset 2: Air Quality Focus Areas (AQFAs): These are specific areas for a particular purpose. Only selected parts of the authority area are covered by an AQFA. Datasets 1 and 2 are entirely different and do not share boundaries or nest etc. If that happens anywhere it is entirely coincidental. I need to know what percentage of each SOA intersects (overlaps) with an AQFA area. Some SOAs are going to be fully outside an AQFA. Some SOAs will be partially within an AQFA. Some SOAs will be fully within an AQFA. I want to know what percentage of each SOAs is within an AQFA. The results would be added as a new attribute to the SOA dataset as a percentage value (0-100). I know that using AreaOnAreaOverlayer I can chop up the SOAs where they intersect with AQFAs. Bu
EDIT - Solved, see comment below regarding using the term “Bearer”.Hi,I am delving into the world of Flow Hosted. I am undertaking a Proof of Concept to discover the pros and cons. Concept: I’ve bult a Flow app (note: Flow, not Flow Hosted) to drop a random file into an Azure BLOb storage. I then have a workbench to monitor the BLOb, and when a new file is detected I want to start my currently “paused” Flow Hosted Instance to fire-up and inspect the newly arrived data and report back to say it has found it!It seems that my best approach is to use HTTPCaller in my workbench to use the PUT method and the details copied across from here: FME Flow Hosted API (I can launch the instance from the API page so I know it works using PUT/instances/{instance_id}/action/start) but I am struggling to get the HTTPCaller configured so that it will start the paused instance.I need some help configuring this transformer please. This is how I have it set up, the Request URL features the api.fmecloud link
With the new spatial definition option in the FeatureWriter, it appears that Attribute Definition cannot be reverted to Automatic after first setting the Spatial Definition? In my case the format is set to PostGIS. Is this expected behavior? Am currently running FME Form 2025.1.1.0, Build 25623.
Hi, has anyone encountered this issue with 2025.1? Or am I doing something wrong?
Hi There,I am using a Text-FeatureReader to process .csv for input into a geocoder. The problem is that these user-created csv contains Line Breaks and the addresses candidates cannot be read into the geocoder or even the Text-FeatureReader (please see attached grapic)... I have a StringReplacer ready to fix the issue downstream but the problem is that the TextReader can not read and pass along the Line Break data (it goes missing) and I do not see any settings within the Text-FeatureReader itself to handle the string replacement. --FYI I am using a Text-FeatureReader instead of a CSV-Reader because the data schema is always unknown. Any help would be super appreciated. Thank you!.
Reading Utility Network Data in a FeatureReader with an SDE connection with resolve domains and resolve subtypes ticked.Domains can be applied different on each field dependent on subtype, but it looks like only those fields that are set to domains on the Unknown subtype are exposed on the reader. Subtypes that have domain fields applied to other fields, have these attributes resolved but they remain unexposed. Is this a known issue?
I am trying to create a webservice to access Sharepoint. FME has been registered in Azure but when I try to set up the connection the conditional access policy blocks my connection.It looks like it has something to do with the way the http user client provides info to Azure. With the FME default http user agent you just get a blocking error, with the system default http user agent you get this: It looks like the http User agent does not provide the device ID (apparaat-id): Not available (niet beschikbaar). The conditional access policy demands a registrered device so it blocks this connection.I can make a Azure connection directly from Chrome or Edge in other apps. what is the way to a solution for this problem?
I need to assign a z-value to 2d points snapped along a 3d line.My steps anchoredsnapper to snap the 2d points to 3d lineChopper to extract the vertex of 3d line create vertex of 3d lineNeighborFinder to find the closed vetex (of 3d line) to my 2d points but now the question is how can be sure that the nearest vertex belong to the lines where my points are snapped ? In red a point without z value but if I increase the maximun distance of NeighborFinder the risk is to assign the wrong z value (I mean the z value of the other line) So at the end my goal is to assign the z value to the points starting from the line where these points are snapped (sorry for bad explanation...) thx for support Francesco
Hi everyone,I’m working with the JSONUpdater transformer in FME and need to add a key called layerDefinition to my JSON. The goal is to have:"layerDefinition": {}as an actual empty object, not:"layerDefinition": "{}" // stringor"layerDefinition": nullHere’s what I tried:Value Type = Plain Text, Value = {} → Result is "{}" (string). Value Type = JSON/XQuery, Value = {} → Result is null. Value Type = JSON/XQuery, Value = json:object() or map {} → The key doesn’t appear at all in the output.My JSON path is correct (json["operationalLayers"][0]), and the update type is Insert into Object.Question:Is there a way in FME to insert an empty JSON object using JSONUpdater without resorting to a string or null? Or is the only workaround to use AttributeCreator + JSONFragmenter or JSONTemplater?Any advice or examples would be greatly appreciated!
I’m using FME 2024 without any issues related to fanout. However, after installing the 2025 version, I’m facing a problem where the fanout is not working as expected. This seems to be a software bug.I am using a Creator to write shapefiles with folder fanout. Based on an attribute value, the data should be written into separate folders. But currently, it is writing only to one folder ("Low"), while the other two folders ("Medium" and "High") remain empty. Attached test1 fmw file.The Shapefile Writer is skipping features and showing the following warning message:“Shapefile writer: Ignoring feature with unexpected feature type 'High_priority_data'... Last line repeated 19 times ...”In FME 2024, this workflow works perfectly and writes to all the folders as expected. I believe others may also be experiencing the same issue in the 2025 version.
We have FME Form/Workbench installed on some of our Azure Virtual Desktop (AVD) machines, and it works fine overall. There is this recurring issue where the Connection Storage access is lost between each session. This is disruptive, and not always apparent, which wastes time and effort troubleshooting. In 2025.1.2.0, navigating to Web Connections under FME Options shows this each time:And navigating to the Workspace Defaults section yields:My connection storage is a Shared Database, which I thought was part of the problem, but I have more recently learned that a colleague of mine is using the default Personal Database connection storage and is also having the same failure to decrypt data between AVD sessions.I’ve searched around the Community and the web some, and am familiar with Changes to Connection Storage in FME Form 2024 – FME Support Center and the list of known issues, but was unable to find anything related to this. Has anyone else run into recurring connection decryption fail
Okay, hear me out 😄In december we’ll be doing a webinar about Best Practices, but because it’s a bit of a tradition to make the last webinar of the year a fun one we’re going to call it the Worst (Best) Practices webinar. So we’re looking for workspaces that are complex, undocumented, badly designed with renamed transformers.Way back in the day the training materials included the Chamber of Workspace Horrors Powerpoint, that’s the kind of stuff I’m looking for.Feel free to reach out to me privately, anonimity is guaranteed 😃(Normally we do our webinars in Dutch, but depending on the response we can also do this one in English, so if you’re interested in that also please let us know!!!)
Goodmorning! I want to write a dataset with the postgis writer to GeoServer, but the result gives errors. Process: A reader of municipal boundaries, and a reader with fire hydrants, the fire hydrants gets clipped on the boundaries layer, and then i want to write it to Geoserver. The postGIS writer says its succesfull, but when i inspect the layer in QGIS, there is no data, and i get the error: there is no item in geometry_colums. What have i done wrong in the postGIS writer? Can anyone help me? Thanks in advance!
HiI draw some 3d lines from point cloud but sometimes I snapped the wrong point so now I need to check if all my vertex are correct. So in the picture I need to detect the vertex encircled in yellow any suggestion ? thx Francesco
Good morning.I’ve been testing lately a FME Flow 2024 version.When writing “Date” field types using the ArcGIS Online Feature Writer, the following warning masked as an error is thrown:D:\code\fme\source\engine\plugins\python\fme-arcgisonline\src\arcgisonlinefeatures\arcgisonlinefeatures_rest_writer_helper.py:557: DeprecationWarning: datetime.datetime.utcfromtimestamp() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.fromtimestamp(timestamp, datetime.UTC).The FME 2025 Change Log shows this entry:It only mentions the Reader. Would it be possible to know if that deprecation was solved for the Writer, too?Thanks!
Hello Safe Folks,I am trying SharepointOnline Connector with a TenantID, Client ID and CLient Secret.I followed https://support.safe.com/hc/en-us/articles/25407443807117-Getting-Started-with-Microsoft-SharePoint#WebConnection https://support.safe.com/hc/en-us/articles/30678084674189-How-to-Create-a-SharePointOnlineConnector-Web-Connection-with-Application-PermissionsIn the second URL, it suggests to have but I only have Sites.Selected or Sites.ReadAll option from the ADMIN.After adding the required parameters, I do not get an error but when add sites I get an error. I am using options/parameters for DownloadSearch Query: Unable to execute query: 'Read past EOF'Please suggest and help.
I am looking at implementing something like this: https://support.safe.com/hc/en-us/articles/25407459193613-HTML-Page-with-Link-to-Download-Excel-File-FME-Flow-AppBut I don’t want to create a webhook for public access for the data streaming link, I want this restricted to the same role/group that has access to the server app - is that possible?
HiSomething strange. I just wanted to write shapefiles with a fanout based on a field in the attributes, and that no longer works. No errors, it creates the folders in the specified location but does not fill them. It selects one and ignores the rest. I don't understand. I've used it a million times and never had any problems. Has anyone else noticed this? Is it the version or is it me?
Hi,I recently moved to FME Form 2025.0.3 from FME Workbench 2021.1.2.The install is on a central windows machine. Some workbenches run as other users. ArcMap and ArcPro (3.4) are also installed on this machine.All our workbenches involve ESRI enterprise geodatabase readers or writers, so require an ESRI licence to run.Users of FME all have named user licences for ArcPro, they are able to launch Pro and obtain a licence on the central machine.When I use FME Form there is no issue accessing the ESRI licence and using the readers/writer. However when testing with other users, who have the same type of named user ESRI licence, FME reports the error: “Worker 6428 > Unable to perform any licensing related tasks. Please check your Esri ArcGIS Compatibility workspace parameter, found in Navigator -> Workspace Parameters -> Translation. This 64-bit version of FME requires ArcGIS Desktop along with 64-bit Background Geoprocessing; ArcGIS Pro; or ArcGIS Enterprise. Refer to this this art