Data

Hi, I have a bunch of workbenches which routinely read layers from our AGOL environment. There are multiple readers in the same workbench, all reading different layers. Until recently everything was doing fine, but now one reader is throwing an error. See part of the log here:ArcGIS Online Feature Service Reader: Querying layer/table 8 for object IDs, where '1=1'ArcGIS Online Feature Service Reader: Got 731 results for layer/table ID 8ArcGIS Online Feature Service Reader: Splitting reading of 731 features into 1 batches of up to 1000 featuresArcGIS Online Feature Service Reader: Getting feature results 0 up to 1000 of layer/table 'tekentools polygon lopend'ArcGIS Online Feature Service Reader: Encountered an unexpected error. The error code from the server was '400' and the message was: 'Cannot perform query. Invalid query parameters.'. Details: 'Unable to perform query. Please check your parameters.' I checked the source layer in A

I have 4 classes that I read from ArcGIS Online, reformat and write out to new classes, all are small and to create each output I've set "create if needed" to yes on the writer and each class is set to "use existing". All 4 classes are created. I then set the model to "create if needed" to no and each class to truncate existing. 3 of the classes update. the 4th with 55 rows truncates existing but then the writing times out with an HTTP 504 error. I've tried setting the features per request to 1 and that times out also. If I delete the class in AGOL I can still create it from the mode but i can't update it.

Hello,I have an FME 2018.1 tool that updates an ArcGIS Online-hosted feature service (Writer Mode: INSERT, Truncate First: YES). The feature service has about 15,000 parcel polygons. Typical changes: a dozen or so new polygons per month, a dozen to a hundred attribute table changes per month.The tool/transformers all work when attempted on a local geodatabase feature class. Therefore I am able to rule out transformer problems. But when the tool runs on AGOL-hosted feature services sometimes it works. Other times it fails and returns these various errors: - The error code from the server was '504' and the message was: 'Your request has timed out.'- The app domain with specified version id (xxxx) was unloaded due to memory pressure and could not be found- Could not connect to server. Check that you are connected to the internet and that no firewall is blocking outbound connections. The error was '('Connection abo

Hello,So we have some workbenches (FME 2018.1.1; 20181203 - Build 18578 - WIN64) that either read or write to AGOL after performing a bunch of operations on the data. These workbenches were working fine up until a week ago, when all of a sudden they started throwing a very generic 503 error message and failing completely.If I understand correctly, a 503 means it's a server side error (so it's likely something with ESRI), right?We've been having issues with our organization's ArcGIS Online portal for the last couple of days (layers being randomly dropped from maps, apps refusing to load) and I'm starting to think that their December 2018 AGOL update messed some things up, including the way FME's readers/writers communicate with it. Is anyone else having trouble working with AGOL lately?Thanks! 

I’m working on a flood-affected buildings project in St. Pauli, Hamburg, using FME’s SpatialFilter transformer. I uploaded an image of my setup (see attached). Almost all buildings are being rejected, and I’m not sure why. My buildings are the "generic object"  and flooding areas are the clipped ones  

I’m hoping to use a DTM service provided by the Environment Agency to extract the height for locations I have (points or polygons I haven’t decided yet).  They provide WMS, WCS, WMTS, OGI API: LIDAR Composite Digital Terrain Model (DTM) - 1mI believe it’s the WMTS I want, it has the elevation data layer within it. https://environment.data.gov.uk/spatialdata/lidar-composite-digital-terrain-model-dtm-1m/wmts?request=GetCapabilities&service=WMTS&version=2.0.1My plan was to use a WMTS reader, and the PointOnRasterValueExtractor to get the heights for the points I suppl

Hi, I am trying to run a custom python code that uses QGIS library in PythonCreator. However when I run the code I get this error:Python Exception <ImportError>: DLL load failed while importing _core: The specified procedure could not be found.I tried everything, I followed the documentation/manual how to setup custom python interpreter, I tried to setup dependencies and environment variables but none of that worked. Can someone tell me what am I doing wrong? Thanks!

I am building a workbench that has a GeoTiff Reader, and uses the RasterPropertyExtractor and CoordinateSystemExtractor transformers to report on various qualities of the input image. The bounds, the cell sizes, etc.I am hoping for a transformer that reports on the compression method of the input image. LZW or JPEG or something else?Something similar to CoordinateSystemExtractor but instead a CompressionExtractor

Hi,I am getting this annoying warning - it seems to be with dynamic writer - Using SQL Server 2017 / 10.9.1GEODATABASE_SDE Writer: Renamed user attribute 'Shape.STArea()' to 'Shape_STArea__' based on format constraints for invalid characters, length, and caseGEODATABASE_SDE Writer: Renamed user attribute 'Shape.STLength()' to 'Shape_STLength__' based on format constraints for invalid characters, length, and caseNormal writer works fine 

Hi,I have a raster file (attached), and I would like to convert it into a 3D representation, similar to the image below. How can I do that? Thank´s

I’m using an Excel Writer in FME Workbench 2024.2.  This is a workspace that will be run yearly and I have created an excel file to write to in the format that I need so that the end user gets the same output year after year.  I would like to use FME to clear any existing data in the excel file from row 5 on down, but still keep the data and formatting that exists in the rows above.  I tried Truncate Existing Sheet/Named Range: with my Start Row set to row 5, but cleared all of the existing data from the sheet and then wrote the new data starting at row 5.  In the below images, you can see what the sheet looks like before the writer is run, the writer parameters, and what the sheet looks like after the writer is run.  Is there a setting in the Writer Parameters that I need to change to ensure that the data and formatting in rows 1- 4 doesn’t get deleted?  Or is there another way that I need to approach this?  Any help would be greatly appreciated.

Hello !I want to extract files wich have everytime a different expression but  there is some text who would be everytime in the file name :Example : [200072692_ZONE_URBA_20220412] “ZONE_URBA” will be the text present everytime in my extract file.I want the String Searcher to download the files which only contains “ZONE_URBA”The numbers in the example before and after “ZONE_URBA” will change everytime because they are the number of the EPCI (french administrative numbers)After calling ZIP file from HTTP with HTTPCaller, I use the ZipExtractor to extract the zip file.Then I use the StringSearcher but I don’t know how to configure the parameters to recover only the ZONE_URBA files … Anyone got an idea ? I think it’s not something impossible but i’m beginner.Sorry for my english, I promised I’ll improve !!Thanks a lot Here my work chain :

This is really strange—I’ve never seen this behavior before.After saving and closing my workbench, all other FMW files in the same folder disappeared automatically.At first, I thought I was imagining things, but other users have reported similar issues before. [Post link]Version: 2024.2.1 (Build 24801)OS: Windows 11 24H2 (26100.2894)The only change I can recall is that I recently uninstalled all old FME versions, but that shouldn’t somehow trigger file deletion, right?

Question:Is there a way to speedup the geocoding process or an alternative approach like a diifferent Geocoding service people got good results from?Background of question:I have a dataset of 21.000 adresses and want to geocode them using the Geocoder.Geocoding Service: OpenStreetMapMode: FowardTo run the first batch of 500 adresses took approx. 10 minute to run which is not that fast to be honest.  

Hi, I use a FeatureReader for two purposes: to clip features with a polygon, and to select some desired geodatabase layers (of several geometry types: point, line and polygon).After the “succesful translation” the new geodatabase has been created. However, this database seems to be empty.What could be possible causes? Wrong Schema/Data Features of the FeatureReader? In the Reader I have:In the Writer I have:Connectiefile is the file where the polygon for the clipping purpose can be found. Other schema sources are not available.Any ideas?

I was extracting tables from a PDF file by following the steps in  https://support.safe.com/hc/en-us/articles/25407564475277-Extracting-Text-and-Tabular-Data-from-PDF#h_01HW3Z9Z37Q33NQQ7R0XBGEVB0. However, I encountered a challenge some words are misspelled or broken when extracted, even though they appear correctly in the PDF viewer. I suspect this is because the PDF was exported from a graphic design app such as Adobe Illustrator. I realized this when I copied text from the PDF and pasted it into a Word document the same issue occurred (correct me if I’m wrong) is there a transformer can help fix or reconstruct the text? 

I need to transfer a PG table that has a geometry (line) field in below format, to another PG table on another database using FME. I know it’s already in the workable final format. If I just run queries as below and save results directly to the target database using DBeaver, it works fine.            geomfromewkt(comm_path_line_geo)::geometry as sp_geometry But somehow it’s not working on FME to transfer from one to the other. I tried SQLExecutor alone and also with GeometryReplacer.I tried queries inside SQLExecutor this way:select geomfromewkt(comm_path_line_geo)::geometry as geometry from my_table and this way:select comm_path_line_geo::text from my_table  and then to process with GeometryReplacer and also this way:select comm_path_line_geo as sp_geom

Hi, I have the following problem: a specific fmw file cannot be opened in the FME workspace. Clicking on it in the list in the FME Workbench tab “Start” gave no response at all. Hoving the mouse on the file in the list showed a popup with the contents of the file. Dragging and dropping the fmw file to the empty workspace did not work. Other files can be opened without issue. How can I restore the fmw file? I have FME Workbench 2024.0. 

Hi all, I am very much an FME rookie, so I’m hoping someone may have some insight as I’m at a loss. I’ve received a .JSON dataset of point locations with a number of attributes. It is not in a form of GeoJSON that I recognize, and so basic Esri/GIS toolsets won’t help with conversion. I’d like to use FME Form Workbench to help me clean up the data and ultimately convert it to Shapefile or Esri File Geodatabase Feature Class.Below is the format of the .json that I’m working with:[  {    "id": 1,    "address_number": "1234",    "street_name": "IMAGINARY",    "street_type": "WAY",    "unit_number": "",    "country": "CAN",    "province": "BC",    "region": "CVRD",    "locality": "Mill Bay",    "postal_code": "V8H 1B8",    "pid": "",    "administration": "",    "building_name": null,

Hi, I need to filter some ArcGIS Online Portal Readers based on a unique ID that exists also in another reader (file geodatabase). ExampleReader 1: ArcGIS Portal features w/ UID Reader 2: File Geodatabase features w/ UID Reader 1 should only load features that have a UID that match Reader 2. The UID fields are the same format. Is this possible? Please let me know if can provide further details. I am a beginner/intermediate FME user focused on GIS. Thank you!

Is there a way to read data from a PowerBI semantic model in FME Form?

I feel like I’ve seen this done before, but can’t put my finger on how to do it…..A warning, I’m working with 2020.2 so cast your mind back a few years….. Essentially I have a workspace that is taking data from MSSQL and writing it out to SQLite. In theory this is just a straight Reader to Writer.However, the SQLite file is being created fresh each time the process runs and it’s creating any number of tables based on relationships within the MSSQL database - these relationships need to be maintained. Therefore, the schema in the SQLite table is being created with an SQLExecutor and CREATE TABLE statements. Currently, I’m reading the schema from MSSQL and manually mapping each attributes data type from the MSSQL definition to SQLite using an AttributeValueMapper. Now it wouldn’t take too

Hi,I had a script that was running perfectly in FME 2024.1. I upgraded to 2025.0, encountered some issues, and my script stopped working. I then reverted to the previous version, 2024.1. However, my script still doesn't work. When I run it in PyCharm using Python 3.10, it runs perfectly, but in FME I get the following error:Message Type: fme::internal::_v0::py::ExceptionPython Exception <SyntaxError>: invalid syntax (functions.py, line 68)In the FME options, I have the same paths set as before: PYTHONHOME: C:\Users\XXXX\AppData\Local\Programs\Python\Python310 Interpreter: "C:\Users\xxxx\AppData\Local\Programs\Python\Python310\python310.dll" What could be the issue? Could you please help me? Thank´s

I have a DXF-file consisting of lines and surfaces. Is there any standard method on how I can convert such files in IFC?

I need to have a choice parameter offering all the database tables of a specific database for the user to choose from before running the workspace.I do have the Python code ready, and created a scripted parameter, returning a list of all table names.I referenced the scripted parameter as input for the choice parameter, but that only gives me a dropdownbox with the name of the parameter linked to it. Is it possible to populate a choice parameter from a Python script (scripted parameter), and if so how?