A space to discuss FME Form
Recently active
Hi, I have a report i make where from the data i get out the following (where / separate's attributes)Field / SubField / YYYYMMDD / ValueX / ValueYFor the last date of the Subfield, i would need a line where Value X and Value Y are zero - the end date is specific to the Subfield. Is there a way to get it to reach - for Subfield - find last date - create +1M from YYYYMMDD with X and Y equal to zeroI know how i would do it in a excel macro, but i dont know how to replicate this in FME /Emma
Hey all, Currently having an issue using the ArcGIS Connector when using FME Flow (or Form without Feature Caching / Counting on), receiving the following error below. Full log posted below the error message. The outcome I am looking to produce is to update a CSV file hosted on an Enterprise Platform. This does run with form with feature caching on. Any help would be much appreciated.Thanks. Ash135 2025-11-14 17:25:19 | Message Type: fme::internal::_v0::py::Exception 136 2025-11-14 17:25:19 | Python Exception <TypeError>: Call to pyoutput() requires an output_tag argument when multiple output ports exist 137 2025-11-14 17:25:19 | Error encountered while calling method `input' 138 2025-11-14 17:25:19 | ArcGISOnlineConnector_2_CALLER (PythonFactory): PythonFactory failed to process feature 2025-11-14 17:24:59| 0.0| 0.0|INFORM|Current FME version: FME 2024.2.1.0 (20241202 - Build 24801 - WIN64)2025-11-14 17:24:59| 0.0| 0.0|INFORM|System Time: 20251114172459 UTC2025
Hi Everyone!I’m currently working on a workflow using a dwg file (water system) to convert it into a geodatabase. I was wondering if anyone has any tips on the transformers and workflow I could use to successfully do this? Right now I have my dwg reader as individual types, leading into an attribute filter, and geometry filter (3 different ones- 1 for water, drainage, and sanitary). These 3 end up writing into the geodatabase. I would like to have feature datasets separating water, drainage, and sanitary written in the geodatabase. I understand this is a big undertaking, but any tips (or perhaps links to guides) would be extremely appreciated! Thank you!
Hi, I have a list of 100+ WMS services our company is using in a plugin for QGIS. I’d like to publish these to our enterprise portal, and I thought the ArcGISOnlineConnector seemed like the right choice, due to it haven the setting:Action: UploadURL : WMS URL https://***.net/geoserver/dai/wms?service=WMS&request=GetCapabilities&version=1.3.0 URL Item Type: WMS ? My error is :ERROR |Message Type: fme::internal::_v0::py::ExceptionERROR |Python Exception <TypeError>: expected str, bytes or os.PathLike object, not NoneTypeERROR |Error encountered while calling method `input'FATAL |ArcGISOnlineConnector_CALLER (PythonFactory): PythonFactory failed to process feature What have I misunderstood ? Or is there a better option ? Thanks in advance.
Good morning.I’ve been testing lately a FME Flow 2024 version.When writing “Date” field types using the ArcGIS Online Feature Writer, the following warning masked as an error is thrown:D:\code\fme\source\engine\plugins\python\fme-arcgisonline\src\arcgisonlinefeatures\arcgisonlinefeatures_rest_writer_helper.py:557: DeprecationWarning: datetime.datetime.utcfromtimestamp() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.fromtimestamp(timestamp, datetime.UTC).The FME 2025 Change Log shows this entry:It only mentions the Reader. Would it be possible to know if that deprecation was solved for the Writer, too?Thanks!
Hello, I am attempting to copy an ArcGIS Server Feature Service from our Production portal to our Staging portal as a test migration using ArcGIS Data Interoperability (FME). The migration runs successfully, and the layer is created on the destination portal with all point features appearing correctly. However, every attribute field in the destination portal is empty for the layer.For this workflow, I used: Reader: Esri ArcGIS Server Feature Service Writer: Esri ArcGIS Portal Feature Service The strange part is that when I inspect the data immediately before the writer, all attribute values are present and correct in the Visual Preview. But once the writer publishes the layer to the portal, the attributes do not appear, only the geometry is transferred.Could you please help identify what might be causing the attribute values to be lost during the migration?
I have a job that downloads 7 text files from an FTP directory, and for the last 3 days, 6/7 files have downloaded but 1 always fails (the same one each time) with the error: Number of redirects hit maximum amountI am aware of the post below, but as no similar setting exists on the FTP caller, I’m lost. I can upload fine, and manually downloading the files by logging into the FTP site, or using a WinSCP script also works. The file that failed today was empty (0MB), but so are some of the other files it downloads, and yesterdays file had records and still failed. Empty files are not uncommon for this job, and it has never presented an issue before. This has started occurring since upgrading to 2025.1.3 from 2022, and occurs on both FME Flow and Form. This error has so far not appeared in any other workspaces that use FTP callers, even for multiple file downloads at once. I’m leaning toward this being an issue with the file, rather than the FTP, but I cannot see a problem with the file t
I'm trying to use FME 2025.0 to create a GeoPackage tiles file. It should contain a few Norwegian raster products, such as N50, N100 and N250. The idea is to mimic the properties of the Swedish product “Topografisk webbkarta Nedladdning, raster”, in the sense that the Swedish product contains a single table in the gpkg file and it shows different raster data at different scales. I am having trouble recreating this with the Norwegian products. I´m stuck at creating a separate tables for each data set or a single table that only contains a single data set. This use case is not discussed at, for example, https://support.safe.com/hc/en-us/articles/37417604217357-Creating-OGC-Compliant-GeoPackage-Files#h_01JXXGG7338W04GD0DRBY7VJCV. Any help appreciated. Norwegian products: https://www.kartverket.no/en/on-land/kart/kartbilderSwedish product: https://www.lantmateriet.se/sv/geodata/vara-produkter/produktlista/topografisk-webbkarta-nedladdning-raster/ Magnus
Hi I have spent far too many hours trying to make the change detector dynamically pick up changes. The scenario is: I have 10 datasets that need to be compared between the original and updated databases. Each dataset has only a few fields that need to be checked for changes. These fields are different for each dataset. I have a CSV which is acting as a 'config' file and contains a list of the field names to check for each datasetI have 2 workbenches; the first workbench gets all of the information from the config file, then passes through the information via user-parameters to the Change Detection workbench via workspace runner. Even though I have created a user parameter for the "Match Selected Attributes" config in the ChangeDetector, I can't pass through this information via the workspace runner. It ONLY works if I run the Change Detection workbench individually, and this isn't linked to the config file, so it's not dynamic at all. I got so frustrated
I have a workspace that is reading a table via the MS SQL JDBC reader and writing the output to an Esri File Geodatabase feature class. It works in FME Form. However, In FME Flow, it fails after the following message (not a warning or error) and shows 0 warnings/errors in the log:Writer `GEODATABASE_FILE_1' of type `GEODATABASE_FILE' using group definition keyword `GEODATABASE_FILE_1_DEFIf I read the same exact data in from a CSV file and write to the Esri File Geodatabase, it works in FME Flow. If I read from the MS SQL database and write to an Open API File Geodatabase, it also works. However, I need to use the Esri writer in production for updates due to some Esri-specific functionality. It seems that there is some sort of odd bug specifically when using the MS SQL JDBC reader and Esri File Geodatabase writer in FME Flow. Has anyone else run into this or have any suggestions?Notes: I’ve tried with the SQLCreator, SQLExecutor, and a reader. It still worked in Form but not Flow. We ha
Hello, so we regularly download the whole catalogue of polygons for England, seen here:Dataset Download - Use land and property dataI would very much want to automate this as its a tedious task to manually download them all one by one, so I’ve investigated the calls that my browser makes when calling this data and it first sends a very simple call to very simple URL’s containing the Zipped data, as seen here:https://use-land-property-data.service.gov.uk/datasets/inspire/download/Amber_Valley_Borough_Council.zipWhich in turn takes you onward to a Amazon service that just gives you 60seconds to fetch the data, as seen here:https://datapub-prd-s3-bucket.s3.amazonaws.com/inspire/Amber_Valley_Borough_Council.zip?response-content-type=application%2Fforce-download&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIASNNJI2YGUWCWQTWF%2F20250522%2Feu-west-2%2Fs3%2Faws4_request&X-Amz-Date=20250522T125638Z&X-Amz-Expires=60&X-Amz-SignedHeaders=host&X-Amz-Signature=c8a03845
Hello Safe Folks,I am trying SharepointOnline Connector with a TenantID, Client ID and CLient Secret.I followed https://support.safe.com/hc/en-us/articles/25407443807117-Getting-Started-with-Microsoft-SharePoint#WebConnection https://support.safe.com/hc/en-us/articles/30678084674189-How-to-Create-a-SharePointOnlineConnector-Web-Connection-with-Application-PermissionsIn the second URL, it suggests to have but I only have Sites.Selected or Sites.ReadAll option from the ADMIN.After adding the required parameters, I do not get an error but when add sites I get an error. I am using options/parameters for DownloadSearch Query: Unable to execute query: 'Read past EOF'Please suggest and help.
I am looking at implementing something like this: https://support.safe.com/hc/en-us/articles/25407459193613-HTML-Page-with-Link-to-Download-Excel-File-FME-Flow-AppBut I don’t want to create a webhook for public access for the data streaming link, I want this restricted to the same role/group that has access to the server app - is that possible?
Hi, sometimes the XML Driven XML Writer decides that I have not set the Application Schema when I click on FeaturePaths edit button. As you can see it is set and the XSD file behind works well in a different workspace. But for some reason I get the error you can see in the attachment and I don’t know why. Starting a workspace from scratch works again with the same settings. Thank you for advice.
I have a lot of multipage PDF documents that I need to each summarize. Does anyone have any tips/experience/recommendations with working with multipage pdfs in FME and an AI of choice?I’ve played around with Copilot a bit and have got prompts to return pretty good results, but it seems like FME doesn’t natively support Copilot, so I’ll have to probably switch AI solutions. Thanks in advance!
HiSomething strange. I just wanted to write shapefiles with a fanout based on a field in the attributes, and that no longer works. No errors, it creates the folders in the specified location but does not fill them. It selects one and ignores the rest. I don't understand. I've used it a million times and never had any problems. Has anyone else noticed this? Is it the version or is it me?
Hi,I recently moved to FME Form 2025.0.3 from FME Workbench 2021.1.2.The install is on a central windows machine. Some workbenches run as other users. ArcMap and ArcPro (3.4) are also installed on this machine.All our workbenches involve ESRI enterprise geodatabase readers or writers, so require an ESRI licence to run.Users of FME all have named user licences for ArcPro, they are able to launch Pro and obtain a licence on the central machine.When I use FME Form there is no issue accessing the ESRI licence and using the readers/writer. However when testing with other users, who have the same type of named user ESRI licence, FME reports the error: “Worker 6428 > Unable to perform any licensing related tasks. Please check your Esri ArcGIS Compatibility workspace parameter, found in Navigator -> Workspace Parameters -> Translation. This 64-bit version of FME requires ArcGIS Desktop along with 64-bit Background Geoprocessing; ArcGIS Pro; or ArcGIS Enterprise. Refer to this this art
Hi everyone,I’m working with DWG files in FME — reading them, attaching XREFs, and then writing back to DWG.I’m trying to attach an XREF to a specific layer (something other than Layer 0), but so far I haven’t had any success. I’ve tried setting both the fme_feature_type and autocad_layer attributes, but the XREF still ends up on Layer 0.It also seems that when using the DWG reader, FME always interprets XREFs as being on Layer 0, even when they’re on a different layer in the source DWG.Has anyone found a way to preserve or specify the layer assignment for XREFs when reading/writing DWG files in FME?Thanks in advance!
Looking at the new Define Read Criteria By: Custom Query option in the FeatureReader in 2025.1I feel like there should be a warning against using Define Read Criteria with Esri Geodatabase format as it uses sql and bypasses specific SDE functionality.
I’ve been trying to read a layer that has 16.1 million points and 7 fields into FME Form. After 10-12 minutes I get the following long-winded 504 error:ArcGIS Online Feature Service Reader: Could not connect to server. Check that you are connected to the internet and that no firewall is blocking outbound connections. The error was 'HTTPSConnectionPool(host='services6.arcgis.com', port=443): Max retries exceeded with url: /PZSz9p6KxGzrnOUT/arcgis/rest/services/PHH_43_FullGeo/FeatureServer/0/query?f=json&token=3NKHt6i2urmWtqOuugvr9TpluUwD-K0TsTS8M3vWY6dKMXWdi_tH3WBIMlCuSgEpXHlYlhwKYwGuuQlZCRtBPNkiJDV5CIz_E4rWysxVYMtf2LCRDhJuovK2hsyIHZ78x99hsJVaIrIbEUFTrqdJzb_qpnp_vjly88FyTaaYsMGr8ItOJpumuJhFox3VA6NXh9o64ZVluadt9ApVCcvpmElqPgAf1TPFnSerF1uG4nnxdUFYdsd3QRvQmGuNsAYYh7s2BHXFM6Rh9P7H5jTyxQ.. (Caused by ResponseError('too many 504 error responses'))' Python Exception <FMEException>: FMEException: 926856: ArcGIS Online Feature Service Reader: Could not connect to server. Check that yo
We have a polygon shapefile in which features overlap because the data is self-reported. During our analysis, we noticed that when a feature is 100% overlapped by another, it is not considered in the clip process with another dataset. However, we want all features—even those that are fully overlapped—to be taken into account when performing the clip. What configuration or procedure should we use to ensure this behavior?
Hello everyone,I’m currently facing a challenge with writing an IoT data stream directly to an ArcGIS Online (AGOL) hosted feature service using FME. While I’ve successfully configured the stream to write to a local SQLite database, I’ve been unable to achieve the same with AGOL.I’ve attempted to use the Esri ArcGIS Feature Service Writer transformer, but unfortunately, it hasn’t worked as expected in stream mode. I’m wondering if there’s an alternative transformer or method that supports continuous writing to an AGOL feature service.Here’s a brief overview of my FME workspace setup:Input Source: Reading data from an MQTT broker in stream mode using the MQTTConnector. Data Processing: Filtering incoming messages into different groups based on sensor types. Output Goal: Writing the processed data to an AGOL hosted feature service. Runtime: The workspace is designed to run continuously to handle real-time data.Any guidance or suggestions on how to achieve this would be greatly appreciate
Hello fellow FME-ers,I am working on making an xml from an Oracle database (with metadata). I am using the FME template for this in the XML Writer. Using the list builder I have generated two lists. One with the keywords and one with the attribute values. See below as an example (List_Trefwoorden and List_Attribuutinformatie):How do I make sure these lists (standard FME template for xml) are saved in my XML writer? Greetings, Wim
Hi All,I have written a workspace that downloads features (and attachments) from an AGOL Feature Service, and everything was working fine until about 2 weeks ago. Then it suddenly, and for no reason that I can see, stopped working. The error message is as below:2024-07-12 09:38:47| 5.7| 2.1|ERROR |ArcGIS Online Feature Service Reader: Could not connect to server. Check that you are connected to the internet and that no firewall is blocking outbound connections. The error was 'HTTPSConnectionPool(host='www.arcgis.com', port=443): Max retries exceeded with url: /sharing/rest/portals/self?f=json&token=3NKHt6i2urmWtqOuugvr9Xotftc2MEsOx2iLqu8k_LPVAUrx4ptneDwWq5gGHyWsx9gLJB14s-YhL9BcQ6A71ysFhsv00tTqKaTLWA9OxAioggyddpHKGcxUfwKFMnzU-m7-SshOGN98nlYOd2uB9-LSYOpHZbnxGUhNJ_3nnRQntaumsDD__7bZqpHVciIFHkLU-of9RGgQ17FdVaDRxF6HcXcbq9Sm4XmdkzD7LqM-h_2jGsOM8HOeFBSI6iINhlNJE65A50NL1eFOJ-gGgg.. (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000000001D666D10>, 'C
I have a pretty simple problem but I cound not find any solution. I tried feature joiner and added counter so that I have a field in common for bot tables but still didnt work. Attribute manager does like “what I get” which is not really what I want. Any Idea ?