A space to discuss FME Form
Recently active
I'm trying to use FME 2025.0 to create a GeoPackage tiles file. It should contain a few Norwegian raster products, such as N50, N100 and N250. The idea is to mimic the properties of the Swedish product “Topografisk webbkarta Nedladdning, raster”, in the sense that the Swedish product contains a single table in the gpkg file and it shows different raster data at different scales. I am having trouble recreating this with the Norwegian products. I´m stuck at creating a separate tables for each data set or a single table that only contains a single data set. This use case is not discussed at, for example, https://support.safe.com/hc/en-us/articles/37417604217357-Creating-OGC-Compliant-GeoPackage-Files#h_01JXXGG7338W04GD0DRBY7VJCV. Any help appreciated. Norwegian products: https://www.kartverket.no/en/on-land/kart/kartbilderSwedish product: https://www.lantmateriet.se/sv/geodata/vara-produkter/produktlista/topografisk-webbkarta-nedladdning-raster/ Magnus
Hi I have spent far too many hours trying to make the change detector dynamically pick up changes. The scenario is: I have 10 datasets that need to be compared between the original and updated databases. Each dataset has only a few fields that need to be checked for changes. These fields are different for each dataset. I have a CSV which is acting as a 'config' file and contains a list of the field names to check for each datasetI have 2 workbenches; the first workbench gets all of the information from the config file, then passes through the information via user-parameters to the Change Detection workbench via workspace runner. Even though I have created a user parameter for the "Match Selected Attributes" config in the ChangeDetector, I can't pass through this information via the workspace runner. It ONLY works if I run the Change Detection workbench individually, and this isn't linked to the config file, so it's not dynamic at all. I got so frustrated
I have a workspace that is reading a table via the MS SQL JDBC reader and writing the output to an Esri File Geodatabase feature class. It works in FME Form. However, In FME Flow, it fails after the following message (not a warning or error) and shows 0 warnings/errors in the log:Writer `GEODATABASE_FILE_1' of type `GEODATABASE_FILE' using group definition keyword `GEODATABASE_FILE_1_DEFIf I read the same exact data in from a CSV file and write to the Esri File Geodatabase, it works in FME Flow. If I read from the MS SQL database and write to an Open API File Geodatabase, it also works. However, I need to use the Esri writer in production for updates due to some Esri-specific functionality. It seems that there is some sort of odd bug specifically when using the MS SQL JDBC reader and Esri File Geodatabase writer in FME Flow. Has anyone else run into this or have any suggestions?Notes: I’ve tried with the SQLCreator, SQLExecutor, and a reader. It still worked in Form but not Flow. We ha
Hello, so we regularly download the whole catalogue of polygons for England, seen here:Dataset Download - Use land and property dataI would very much want to automate this as its a tedious task to manually download them all one by one, so I’ve investigated the calls that my browser makes when calling this data and it first sends a very simple call to very simple URL’s containing the Zipped data, as seen here:https://use-land-property-data.service.gov.uk/datasets/inspire/download/Amber_Valley_Borough_Council.zipWhich in turn takes you onward to a Amazon service that just gives you 60seconds to fetch the data, as seen here:https://datapub-prd-s3-bucket.s3.amazonaws.com/inspire/Amber_Valley_Borough_Council.zip?response-content-type=application%2Fforce-download&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIASNNJI2YGUWCWQTWF%2F20250522%2Feu-west-2%2Fs3%2Faws4_request&X-Amz-Date=20250522T125638Z&X-Amz-Expires=60&X-Amz-SignedHeaders=host&X-Amz-Signature=c8a03845
Hello Safe Folks,I am trying SharepointOnline Connector with a TenantID, Client ID and CLient Secret.I followed https://support.safe.com/hc/en-us/articles/25407443807117-Getting-Started-with-Microsoft-SharePoint#WebConnection https://support.safe.com/hc/en-us/articles/30678084674189-How-to-Create-a-SharePointOnlineConnector-Web-Connection-with-Application-PermissionsIn the second URL, it suggests to have but I only have Sites.Selected or Sites.ReadAll option from the ADMIN.After adding the required parameters, I do not get an error but when add sites I get an error. I am using options/parameters for DownloadSearch Query: Unable to execute query: 'Read past EOF'Please suggest and help.
I am looking at implementing something like this: https://support.safe.com/hc/en-us/articles/25407459193613-HTML-Page-with-Link-to-Download-Excel-File-FME-Flow-AppBut I don’t want to create a webhook for public access for the data streaming link, I want this restricted to the same role/group that has access to the server app - is that possible?
Hi, sometimes the XML Driven XML Writer decides that I have not set the Application Schema when I click on FeaturePaths edit button. As you can see it is set and the XSD file behind works well in a different workspace. But for some reason I get the error you can see in the attachment and I don’t know why. Starting a workspace from scratch works again with the same settings. Thank you for advice.
I have a lot of multipage PDF documents that I need to each summarize. Does anyone have any tips/experience/recommendations with working with multipage pdfs in FME and an AI of choice?I’ve played around with Copilot a bit and have got prompts to return pretty good results, but it seems like FME doesn’t natively support Copilot, so I’ll have to probably switch AI solutions. Thanks in advance!
HiSomething strange. I just wanted to write shapefiles with a fanout based on a field in the attributes, and that no longer works. No errors, it creates the folders in the specified location but does not fill them. It selects one and ignores the rest. I don't understand. I've used it a million times and never had any problems. Has anyone else noticed this? Is it the version or is it me?
Hi,I recently moved to FME Form 2025.0.3 from FME Workbench 2021.1.2.The install is on a central windows machine. Some workbenches run as other users. ArcMap and ArcPro (3.4) are also installed on this machine.All our workbenches involve ESRI enterprise geodatabase readers or writers, so require an ESRI licence to run.Users of FME all have named user licences for ArcPro, they are able to launch Pro and obtain a licence on the central machine.When I use FME Form there is no issue accessing the ESRI licence and using the readers/writer. However when testing with other users, who have the same type of named user ESRI licence, FME reports the error: “Worker 6428 > Unable to perform any licensing related tasks. Please check your Esri ArcGIS Compatibility workspace parameter, found in Navigator -> Workspace Parameters -> Translation. This 64-bit version of FME requires ArcGIS Desktop along with 64-bit Background Geoprocessing; ArcGIS Pro; or ArcGIS Enterprise. Refer to this this art
Hi everyone,I’m working with DWG files in FME — reading them, attaching XREFs, and then writing back to DWG.I’m trying to attach an XREF to a specific layer (something other than Layer 0), but so far I haven’t had any success. I’ve tried setting both the fme_feature_type and autocad_layer attributes, but the XREF still ends up on Layer 0.It also seems that when using the DWG reader, FME always interprets XREFs as being on Layer 0, even when they’re on a different layer in the source DWG.Has anyone found a way to preserve or specify the layer assignment for XREFs when reading/writing DWG files in FME?Thanks in advance!
Looking at the new Define Read Criteria By: Custom Query option in the FeatureReader in 2025.1I feel like there should be a warning against using Define Read Criteria with Esri Geodatabase format as it uses sql and bypasses specific SDE functionality.
I’ve been trying to read a layer that has 16.1 million points and 7 fields into FME Form. After 10-12 minutes I get the following long-winded 504 error:ArcGIS Online Feature Service Reader: Could not connect to server. Check that you are connected to the internet and that no firewall is blocking outbound connections. The error was 'HTTPSConnectionPool(host='services6.arcgis.com', port=443): Max retries exceeded with url: /PZSz9p6KxGzrnOUT/arcgis/rest/services/PHH_43_FullGeo/FeatureServer/0/query?f=json&token=3NKHt6i2urmWtqOuugvr9TpluUwD-K0TsTS8M3vWY6dKMXWdi_tH3WBIMlCuSgEpXHlYlhwKYwGuuQlZCRtBPNkiJDV5CIz_E4rWysxVYMtf2LCRDhJuovK2hsyIHZ78x99hsJVaIrIbEUFTrqdJzb_qpnp_vjly88FyTaaYsMGr8ItOJpumuJhFox3VA6NXh9o64ZVluadt9ApVCcvpmElqPgAf1TPFnSerF1uG4nnxdUFYdsd3QRvQmGuNsAYYh7s2BHXFM6Rh9P7H5jTyxQ.. (Caused by ResponseError('too many 504 error responses'))' Python Exception <FMEException>: FMEException: 926856: ArcGIS Online Feature Service Reader: Could not connect to server. Check that yo
We have a polygon shapefile in which features overlap because the data is self-reported. During our analysis, we noticed that when a feature is 100% overlapped by another, it is not considered in the clip process with another dataset. However, we want all features—even those that are fully overlapped—to be taken into account when performing the clip. What configuration or procedure should we use to ensure this behavior?
Hello everyone,I’m currently facing a challenge with writing an IoT data stream directly to an ArcGIS Online (AGOL) hosted feature service using FME. While I’ve successfully configured the stream to write to a local SQLite database, I’ve been unable to achieve the same with AGOL.I’ve attempted to use the Esri ArcGIS Feature Service Writer transformer, but unfortunately, it hasn’t worked as expected in stream mode. I’m wondering if there’s an alternative transformer or method that supports continuous writing to an AGOL feature service.Here’s a brief overview of my FME workspace setup:Input Source: Reading data from an MQTT broker in stream mode using the MQTTConnector. Data Processing: Filtering incoming messages into different groups based on sensor types. Output Goal: Writing the processed data to an AGOL hosted feature service. Runtime: The workspace is designed to run continuously to handle real-time data.Any guidance or suggestions on how to achieve this would be greatly appreciate
Hello fellow FME-ers,I am working on making an xml from an Oracle database (with metadata). I am using the FME template for this in the XML Writer. Using the list builder I have generated two lists. One with the keywords and one with the attribute values. See below as an example (List_Trefwoorden and List_Attribuutinformatie):How do I make sure these lists (standard FME template for xml) are saved in my XML writer? Greetings, Wim
Hi All,I have written a workspace that downloads features (and attachments) from an AGOL Feature Service, and everything was working fine until about 2 weeks ago. Then it suddenly, and for no reason that I can see, stopped working. The error message is as below:2024-07-12 09:38:47| 5.7| 2.1|ERROR |ArcGIS Online Feature Service Reader: Could not connect to server. Check that you are connected to the internet and that no firewall is blocking outbound connections. The error was 'HTTPSConnectionPool(host='www.arcgis.com', port=443): Max retries exceeded with url: /sharing/rest/portals/self?f=json&token=3NKHt6i2urmWtqOuugvr9Xotftc2MEsOx2iLqu8k_LPVAUrx4ptneDwWq5gGHyWsx9gLJB14s-YhL9BcQ6A71ysFhsv00tTqKaTLWA9OxAioggyddpHKGcxUfwKFMnzU-m7-SshOGN98nlYOd2uB9-LSYOpHZbnxGUhNJ_3nnRQntaumsDD__7bZqpHVciIFHkLU-of9RGgQ17FdVaDRxF6HcXcbq9Sm4XmdkzD7LqM-h_2jGsOM8HOeFBSI6iINhlNJE65A50NL1eFOJ-gGgg.. (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000000001D666D10>, 'C
I have a pretty simple problem but I cound not find any solution. I tried feature joiner and added counter so that I have a field in common for bot tables but still didnt work. Attribute manager does like “what I get” which is not really what I want. Any Idea ?
Hi,Trying to use a clipper for 3d intersections but some 3d solids getting rejected i think due to geometry errors in 3d solids. I have ran the 3d solids through geometry validator but does not fix the geometry errors. Geometry errors include - Non-Planar Surfaces, Incorrect Solid Orientation, Invalid Solid Boundaries. Any other ideas to fix? Thanks
nvm
Hi FMEers, I’m trying to create a basic map using the HtmlReportGenerator. I’ve added 2 polygon hosted feature layers from our ArcGIS Enterprise Portal, that are comma separated in that URL field. They are shared with groups that I am a member of so I have access to view them.When I send it through to an html writer, the output map is blank. I wasn’t sure if that was because it is offline so I also published to FME Flow but it’s still blank: I also tried with a layer shared to public from our portal with the same results.Is there something I’m missing from the docs?
Hi guys,how can i handle to read in Excel sheets (with other column names from time to time) and have the possibility to choose from a schema (xls) the right attribute names for the workflow…..Parameters on the reader?I’ve tried the Attributemanager and import a excel file...but the names from the excel sheet are only added to the default output attribute names a dropdown list on the Output Attribute name would be great……..any help to handle it or a link to another articleGreetz and thanksFranco
Hi,I would like to convert an image symbol from Esri CIM JSON to AutoCAD DWG format. The JSON file looks like this: { "type": "CIMPointSymbol", "symbolLayers": [ { "type": "CIMCharacterMarker", "enable": true, "anchorPoint": { "x": 0, "y": 0, "z": 0 }, "anchorPointUnits": "Relative", "dominantSizeAxis3D": "Y", "offsetX": -3.3333333333333335, "size": 5.555555555555556, "billboardMode3D": "FaceNearPlane", "characterIndex": 85, "fontFamilyName": "Tahoma", "fontStyleName": "Regular", "fontType": "TTOpenType", "scaleX": 1, "symbol": { "type": "CIMPolygonSymbol", "symbolLayers": [ { "type": "CIMSolidStroke", "enable": true, "capStyle": "Round", "joinStyle": "Round", "lineStyle3D": "Strip", "miterLimit": 4, "width": 0, "height3D": 1, "anchor3D": "Center"::], "haloSize": 1,
Hi guys,This week I created a nice model A with runs smoothly combined with a main script B which includes a workspacerunner triggering workspace A. Is there a way I can track whether all the scripts started by the Workspace Runner are ready?In my case 21 features entered the WorkspaceRunner, starting model A, which leads to creation of 18 Excel files which is perfect. I would like to create a log somehow that 21 workspaces were started and 21 workspaces were completed resulting in 18 Excel files in this case.Workspace B now states that the WorkspaceRunner is finished, however, on the background workspace(s) A is still running for some time.
I have the following table, very simple:DATE_START ID 19921101 0502010000013950 19950209 0502010000013950 20031231 0502010000013950 20040115 0502010000013950 20040120 0502010000013950 20110704 0502010000013950 20200211 0502010000013950 20251005 0502010000013950 I want to make te following result: DATE_START DATE_END ID 19921101 19950209 0502010000013950 19950209 20031231 0502010000013950 20031231 20040115 0502010000013950 20040115 20040120 0502010000013950 20040120 20110704 0502010000013950 20110704 20200211 0502010000013950 20200211 20251005 0502010000013950 20251005 null 0502010000013950 Date_end is next value of date_start to create a cycles like this. This what i did: I get to following result:U see the problem is with the last date_end, he is using for that feature the first date_start. I dont now how. Anyone a solution?