A space to discuss FME Form
Recently active
Hi FME world,I have two tables in a database (ArcGIS SDE). They are effectively a 1:1 match, linked via a common ID. Table 1 features are always present in the flow (filtered prior) and I want to read in ONLY the features from table 2, where match with the Table 1 filtered features (because there are 1m+).I’ve tried options like aggregating the Table 1 features and concatenating the ID, passing into Table 2 feature reader with a where clause. However, there is a maximum limit of queries the database can do (somewhere between 10,000-15,000 - and often I will need to read in more than this.My next thought is to create a looping transformer where I sample the T1 features into groups of 10k, aggregate, pass to FeatureReader, reads in associated 10k T2 features, then loop back to read in the next 10k, until there are no more features to be read (using a NoFeaturesTester to exit the loop.I’m a bit stuck on how to actually implement this though. Any ideas/thoughts much appreciated! Or if i’m
Hey, I have a question about the HTTP Caller. Is there a way to have the workspace it is in still continue even if one of the records fails to upload? The reason I ask is because there are some interesting errors I have ran into when uploading records to Cityworks, where something fails and then I have to re-run the entire workspace, after first deleting all of the inspections/work orders that were created. The error involves an encoded string not being compatible with FME. I would just like a way to run the entire workspace for all features and not have it cancel out on a failure. Any tips?
Hi,I had a script that was running perfectly in FME 2024.1. I upgraded to 2025.0, encountered some issues, and my script stopped working. I then reverted to the previous version, 2024.1. However, my script still doesn't work. When I run it in PyCharm using Python 3.10, it runs perfectly, but in FME I get the following error:Message Type: fme::internal::_v0::py::ExceptionPython Exception <SyntaxError>: invalid syntax (functions.py, line 68)In the FME options, I have the same paths set as before: PYTHONHOME: C:\Users\XXXX\AppData\Local\Programs\Python\Python310 Interpreter: "C:\Users\xxxx\AppData\Local\Programs\Python\Python310\python310.dll" What could be the issue? Could you please help me? Thank´s
With the CKANConnector able to list Datasets and Resources without any issue, so I know CKAN Connection is good. If I try to add and update a resource I receive the “upload error HTTP 400: "Bad request - JSON Error: Invalid request. Please use POST method for your request” I’m pulling the Dataset and Resource for the update resource from the dropdown. Acts like a permission issue but I’m connecting as an Admin on the openGov side.
This is starting to annoy me - in 2024.2, whenever I create a bookmark around something, FME automatically zooms to it. Is this a setting that can be turned off?
Does anyone have a solution to this?
Huge thanks to @mark2atsafe for granting me a shiny FME Star badge!It really gave me the push to finally share some of the custom tools I’ve built, starting with this one: the TimeSeriesGenerator. The idea came up when I needed to build a time‑series dataset to plot user activity over time. My end goal was to generate an HTML report showing how users interacted with an application. I was starting from a log file of user requests, but if no one made a request during a given period, I’d have gaps in my data and nothing to show in the report. This issue is a common one. Even FME Flow with his analytics page doesn’t handle time period with no data.This FME Flow is idling most of the time, but the Analytics page doesn’t report that. That’s where the TimeSeriesGenerator comes in ! It creates a continuous series of timestamps between a start date and an end date, at a specified interval in seconds. You can then join your actual log data to those timestamps and be sure you’ll see a value (ev
I'm working with an electrical network with feeders and branches. I'd like to add the coordinates of the intersection points with the feeders as attributes in the branches. I managed to do this in the first segment using the Intersector and SpatialFilter transformers, but I had trouble adding them to the downstream segments.I have a common field for each branch that can be obtained using networkTopology.So, my question is how to create conditional queries to add the coordinate values of the intersection points with the downstream branches (see attached diagram).Thanks in advance.
Hi, I'm trying to access the property sets within the Extended data from dwg file, the property sets are attached to block reference objects, quite similar to the case of this post.Attached below are two snapshots from how the property sets look like in Autocad and FME workbench featuring the two attributes that I was trying to expose with no successcan someone guide me through the detailed workflow, please? I'm using FME workbench 2024.2 Thanks,
I have a DXF-file consisting of lines and surfaces. Is there any standard method on how I can convert such files in IFC?
Hi everyone, quick question: how can I remove the rows from my Excel file where the ID number is duplicated, so that only one record per ID is kept?
HelloI am trying to figure out if it is possible to read Levels from a .dgn files, and rename them according to a Table given to the script. I work at a public contracting authority where we receive “As-Built” .dgn documentation from our consultants, structured according to industry standards regarding level naming, and it would be a huge help if we could rename them to a human readable name which our maintenance employees can understand.I guess I’ve found a way to “read” levels in Microstation files, but I cannot seem to find something that can write Levels. Is that possible with FME? Any help would be appreciated. CheersIoannis
Dear FME Community,I need to calculate measure PK from an object, modify them and apply to another object for cut it to elements.I try to explain all steps with this schema :I’m at the STEP 4 but I’m blocked when I want to apply my Measure PK to another objet.For that I’ve a FMWT in ZIP join to this subject.Thank you for your attention and your help.Geo-x
I need to have a choice parameter offering all the database tables of a specific database for the user to choose from before running the workspace.I do have the Python code ready, and created a scripted parameter, returning a list of all table names.I referenced the scripted parameter as input for the choice parameter, but that only gives me a dropdownbox with the name of the parameter linked to it. Is it possible to populate a choice parameter from a Python script (scripted parameter), and if so how?
Anyone come across .nt files (N-Triples) files? Their doesnt seem to be a native FME reader for it.
Something I recently learned about with FME is that each HTTPCaller seems to equate to one session - there are most likely a lot of cases where this isn’t true but I had some weird issues recently where a series of calls working intermittently. The process was creating a document container and then uploading files into it and then closing the container. I used 3 separate HTTPCallers for this. When testing from FME desktop it worked sometimes and others it didn’t work. I spent a tonne of time trying to debug what was wrong in my POST. Finally it seemed like it was working, I published to Server and directly had issues again. Looking into the Debug logs I noticed that with each new instance of the HTTPCaller there was a new connection to the service BUT that connection was going to a different IP. The host was using a load balancer to handle API requests. Turns out my container was being created on one server and my follow up requests were hitting the other server.After I fed everything
How can i extract data from this line? {"sl:stand": {"sl-bag-extract:bagObject": {"Objecten:Pand": {"Objecten:status": "Pand in gebruik", "Objecten:geometrie": {"gml:Polygon": {"@srsName": "urn:ogc:def:crs:EPSG::28992", "gml:exterior": {"gml:LinearRing": {"gml:posList": {"#text": "114062.419 542728.035 0.0 114067.343 542726.792 0.0 114067.637 542728.082 0.0 114068.445 542728.468 0.0 114069.011 542730.438 0.0 114068.36 542731.246 0.0 114068.639 542732.471 0.0 114063.762 542733.793 0.0 114064.204 542735.512 0.0 114057.619 542737.161 0.0 114055.721 542729.372 0.0 114055.572 542729.428 0.0 114053.081 542719.589 0.0 114059.937 542717.727 0.0 114062.353 542727.763 0.0 114062.419 542728.035 0.0", "@count": "16"}}}, "@srsDimension": "3"}}, "Objecten:voorkomen": {"Historie:Voorkomen": {"Historie:BeschikbaarLV": {"Historie:tijdstipRegistratieLV": "2010-11-26T12:31:16.436", "Historie:tijdstipEindRegistratieLV": "2014-10-27T12:32:20.904"}, "Historie:eindGeldigheid": "2014-09-25", "Historie:beginG
I am hoping to produce a group of points along polylines of various lengths. I’ve been trying to mimic the GeneratePointsAlongLines() method from arcpy and ArcGIS Pro which will simply build out points from the start of a polyline at a designated interval (regardless of line segment vertices). I’ve investigated Densifier, but this transformer incorporates vertices and produces points that do not conform to the designated interval. I’ve contemplated utilizing Snipper, but this seems challenging given that many of the line segments I expect to incorporate may vary in lengths for different inputs.I’d appreciate any insight that can be offered.
Hi. I'm reading dwg files with the civil 3D reader. I need to use the attributes in the propertysets. this works perfectly with exposing 'autocad_xrecord_datalist' in the reader for all geometry types, but not for the blocks. the property set attributes from the block don't seem to be present on the 'autocad_insert'. I tried exposing fme_attrib_info but they are also not there. any ideas? or is this just not possible on blocks ?i added a screenshot of the pset in the dwg
I have a workbench which is calling data back for 8 reports via 8 different httpcallers. I can add a date parameter to the URL to call back one date at a time. I have 60 dates I need to individually grab the data for.How can I get it too complete the workbench, move on a day and run it again, and again...and so forth, through a list of dates?
Hi,Does anyone know how to retrieve the information from the Settings tab of a layer published to Esri ArcGIS Online (AGOL)? I’m specifically trying to get the Data Source URL. The Request URL I’m using doesn’t return that information. Any ideas?
*Aka Data Virtualization Transformers, but with the french touchSince I’ve been publishing a bunch of Data Virtualization custom transformers lately, I figured it was time to make a post about them—what they do and how to use them.FME Flow’s recent update introduced a cool new feature: Data Virtualization.https://community.safe.com/product-updates/introducing-fme-data-virtualization-38066?tid=38066&postid=86#post86This feature lets you build your own APIs using FME workspaces.To make that work, your features need to include certain attributes required by the Data Virtualization writer, such as: response.status_code response.body.content response.body.content_type response.body.content_file_path response.headers{}.name response.headers{}.value Data Virtualization Writer After manually setting these with an AttributeCreator a few times, I thought: why not create a tool to make this easier?So I made the DataVirtualizationResponseSetter !DataVirtualizationResponseSetterThis
Up until 4/12, my workspace was writing to a SP list normally. It reads data from SQL and updates the SP list to match any changes. After someone changed the name of a SP column on the 12th, the workflow errored - but after the change was reverted, it still errored. The first line with the Python Exception was not in the original error when the column name was changed:Python Exception <TypeError>: unhashable type: 'dict'SHAREPOINT writer: A fatal error has occurred. Check the logfile above for detailsFeatureJoiner_2_JOINED_-1_35_Player (RecorderFactory): SHAREPOINT writer: A fatal error has occurred. Check the logfile above for detailsFirst photo is an overview of the workspace - everything runs fine up until the SharePoint Writer labeled "TOPS Project List". No problems with the SharePoint Reader. Second photo is settings for the Writer (which worked fine last week!).
Hello,I am trying to write 3D Geometries (Points and Linestrings) to an Oracle-Database (21c Express). In the process all z-Coordinates get lost and SDO_GTYPE is wrongly written as 2001 or 2002 (2-Dimensional Geometries) instead of 3001 and 3002.Multiple Geometries are entering the writer as an aggregate (example below). Apart from the z-Coordinate missing these are written and interpreted correctly when writing to Oracle. I have checked the “Contains Z Ordinate” Option in the Writer-Parameters.Does anyone have anymore ideas what I could try?
Sometimes when I do a transformation from dwg to shape everything is included in 1 polyline (text, pipes, arrows) and when I look at it in inspektion mode I see that the dwg is splitting the lines by color, how do i do the transformation with a separation by color or adding the color value inside the whole polyline Sorry if my vocabulary is wrong