Skip to main content
  • EN

FME Form

A space to discuss FME Form

10000 Posts
david_r
Celebrity
david_r
asked in Transformers
FME encoded text (internals)

Not really a question, but feel free to add comments or thoughts below.We are implementing pre-commit hooks and centralized Python linters in our git workflows, and for this we need to extract all Python code from workspace files pushed to git. Since we do not want to require a full FME installation for this, we’re parsing the .fmw files as text files using Python and extracting all the code blocks within, before passing them on to the linter as if they were stand-alone Python scripts.As code blocks are encoded in a somewhat non-standard way, I’m sharing a Python function to convert FME encoded strings to regular text, without resorting to any dependencies like an FME installation, (which would allow using FMESession.decodeFromFMEParsableText) or other third-party libraries.It can decode FME encoded strings on either formatimport<space>fme<lf>import<space>fmeobjects<lf>import<space>json<lf><lf&am

1082
hkingsbury
Celebrity
ssmith_ftr
Contributor
ssmith_ftrContributor
asked in Integration
Neo4J JDBC driver warning messages

I’m using FME to push and pull some data from Neo4J. For the connection I’m using the JDBC driver from Neo4J with the SQLExecutor. I’m getting various warning message in my FME logs and wondering if some configuration that can be done with the driver settings (connection property/value) to either prevent them or quiet them.To be clear, my workbench succeeds and have no issue with everything completing. It is just these popup in FME Flow for completed Job logs.  Here are the two most popular (both warnings):JDBC Reader: Unable to preload JDBC Driver Class 'Neo4j'. Error: Neo4j JDBC Reader: Skipping data in column '.errorMessages' due to error (JDBC Type = JAVA_OBJECT, Vendor Type Name = MAP, Error: Method getBytes in class org.neo4j.jdbc.Neo4jResultSet is not yet implemented.)

522
ssmith_ftr
Contributor
youssef
Contributor
youssefContributor
asked in Data
AIXM 5 geometry with XML-Templater

Hello Guys,i have an issue with bringing our geometry from a oracle 12C format in a AIXM gml format. Whatever i tried so far, the writer just refuses to write any geometry, while anything else seems to work just fine. The output was good enough to satisfy the AIXM validation but it is useless for us until i am able to write the geometry too. I am trieing to achieve that with the help from the XML-Templator and so far, this is how it looks:It looks fine to me, the coordinates are hard coded for testing and will later be replaced by a variable holding the coordinates for each object. But i would like to write any geometry in the first place before i think about that. I will provide my workspace and the gml i managed to generate with the hope that somebody can make out the issue at hand. Ty for reading this and every bit of help is appreciated!

371
nielsgerrits
VIP
axcel.fme
Contributor
axcel.fmeContributor
asked in Transformers
Conditional Group Processing

Hi there,last time, this community forum was so helpful and I hope someone can help me this time around too…I’m using the Clipper to clip polygons using the Group Processing feature. Only if the values of the attribute “att_1” are the same should the clipping occur. So far so good. However, it can be that att_1 is NULL (empty) and in this case, I would like to do Group Processing using attribute “att_2”. Is there a way to configure this in the Clipper directly?With my humble knowlegde of FME, I would filter for att_1 being NULL and have two Clippers (one for Group Processing att_1 and one for Group Processing att_2) and then merge the two data streams again. But is there a more elegant way?

703
axcel.fme
Contributor
nea
Contributor
neaContributor
asked in Data
Using dwgstyler to convert a point feature class to an autoCAD drawing with inserts

I’m trying to use the DwgStyler to convert a GIS, point feature class to an AutoCAD drawing with inserts and attributes.

242
caracadrian
Contributor
peteratqfes
Contributor
peteratqfesContributor
asked in Authoring
What is the most efficient way to find intersecting polygons for a bunch of points?

Hi I’ve got a bunch of points (1 to maybe 40+) that are changing regularly (live data), and I want to find out which polygons those points are intersecting.  They are big polygons with lots of vertices. What is the most efficient and/or fastest way to do that?Should I:Have a SQL Spatial Reader and read all those polygons and use a PointOnArea Overlayer transformer. Use a FeatureReader with a Spatial Filter Initiator OGC Intersection and use a PointOnArea Overlayer. Should I use a SQLExecutor and rely on the database?I’ve tried the first two and I’m not sure which is best.Thanks

3669
s.jager
Influencer
huundriks2
Participant
huundriks2Participant
asked in Transformers
Count by two attributes and restart when one changes

Hi, This is defeating me!Any pointers sincerely appreciated.See attached spreadsheet, Where I have features with attributes having multiple similar IDs as well as a name attribute.I have added the columns _num and _page, that is the desired output I manually added in.I can achieve the _num output easy enough with a counter set to Local and group by the two Attributes Name and ID. I set the Count to be _num and Group ID to be _page. This works fine until the Name group changes and the _page will continue counting, See screenshot. However, when the new Name starts with B I want the _page to restart at 1. How do I set it? Thanks. Nic  

563
huundriks2
Participant
syedh2993
Contributor
syedh2993Contributor
asked in Integration
Data Rollback on "ArcGIS Portal Feature Service Writer" for Multiple Layers

Hi,I am trying to write data from database to 3 different Feature Layers (Hosted) on ArcGIS Online. 3 layers have different set of feature attributes.While trying to write data, I would like entire transaction to be rolled back if publishing data to one of the layer fails.Example: If writing data to layer 1 and 2 was successful, but layer 3 fails, I would like to rollback layer 1 and 2 as well.For this scenario, I am trying to use 3 readers and 3 writers in same FME workspace. Is there any kind of Try/Catch or related mechanism that can be used to rollback the transaction ? Any help would be much appreciated, Thanks in advance. Regards,Syed 

691
todd_davis
Influencer
aguan
Contributor
aguanContributor
asked in Data
How to transform this json file to a table?

I have this json file (see the attached txt file) that I want to load into a table (shown as in the attached excel file). I have done many json conversions over the years, but this one puzzled me quite a bit and could not figure out a good way to do it. The difficult part is that for each asset Id, there could be a few years of emissions. Each emission has two emission type, n2o and co2.  How can I capture each year and its emissions into rows based on the emission type to be pivoted? {  "assets": [    {      "Id": 25494428,       "Emissions": [        {          "2021": [            {              "EmissionsFactor": 1,              "EmissionsFactorUnits": "U1",              "n2o": 10            },            {              "EmissionsFactor": 2,              "EmissionsFactorUnits": "U2",              "co2": 100            }          ]        },        {          "2022": [            {              "EmissionsFactor": 3,              "EmissionsFactorUnits": "U1",              "n2o": 11 

992
aguan
Contributor
eulniyy
Participant
eulniyyParticipant
asked in Integration
- Sketchup Studio 3d Modelling - I want to do it even if I transform the glb file into 3d tiles and go to cesium ion, is it possible in FME?

- Sketchup Studio 3d Modelling - I want to do it even if I transform the glb file into 3d tiles and go to cesium ion, is it possible in FME? 

681
saraatsafe
Safer
linmeng
Observer
linmengObserver
asked in Transformers
3Dtiles show error how to fix geometricError ?

I am a Chinese student who uses FME software to read shp files and create 3Dtiers files. There is a problem loading and displaying now. As shown in the video, there is an issue with zooming in and out.Others' 3dtiles were generated using other software and did not encounter this issue. I'm having problems using FME now, how can I solve this. Please help me. My English is not very good. Can you understand what I translated using translation software.I searched for some 3dtiles files and someone said it was a geometricError parameter setting issue.Where can i set the 3dtiles geometricError ???please help me .I am bad in English.my Emial 1985425275@qq.com   FME USE THIS .  Maxinum Number of Triangle Faces Per Tile  Trying to set 100 and 1000 times, but it doesn't work。Where can I set parameters？？？Someone told me that there is a problem with the geometricError parameter and it needs to be corrected。Hom to ???

531
saraatsafe
Safer
kanteyemaodo
Contributor
kanteyemaodoContributor
asked in Authoring
Création fichier DXF dans FME

fichier cadastre à fissionner dans FME hello ! j’ai 3 couches shapefile -bâtiments-parcelles-limites communesje veux les fusionner pour avoir un seul fichier dxf (Microstation).

385
jkr_wrk
Influencer
kanteyemaodo
Contributor
kanteyemaodoContributor
asked in Authoring
points isolés fme | Isolate Points in FME

j’ai deux couchesUne couche de points (ponctuel) et couche de lignes (linéaires).je veux vérifier les points isolés ou non connectés de ma couche ligne.solution svp.en pièce jointe les supports (points) à vérifier qui ne sont pas connectés aux lignes (tronçon). I have two layersA layer of points (point) and layer of lines (linear).I want to check isolated or unconnected points of my line layer.solution please.attached the supports (points) to check which are not connected to the lines (section). 

10020
kanteyemaodo
Contributor
joshuajames1979
Contributor
joshuajames1979Contributor
asked in Transformers
Unable to Extract Links from Webpage using HTMLExtractor

Hi there, I am trying to extract links from this page Mornington Peninsula Planning Scheme - Maps using the methods posted on this forum as well as from the official documentation HTMLExtractor (safe.com), however there is zero total features read, meaning no output. Would this be due to the way the site is structured? I am specifally trying to extract the urls for the PDF maps on the left, and output to a SQL table and link to our GIS, as these links change every so often.Regards,Josh 

532
joshuajames1979
Contributor
nath
Contributor
nathContributor
asked in Transformers
Purge tempory files

Hello, Am I the only one who is experiencing lately that if I have several models open and I do a purge tempory files in 1 of them then it then does the same in the others? The numbers remain in the other model but the green box to view is gone and I have to run the whole model again :-(I do that because sometimes I update a reader but then it won't run again without me doing that purge.  

764
redgeographics
Celebrity
joy
Enthusiast
joyEnthusiast
asked in Transformers
(GIS) When looking for neighbours, I only want neighbours that touch more than a single vertex

Hello everyone,I am currently making a script that looks for houses that have a garden. In my current script I have two datasets: 1) houses, 2) gardensI used for now the NeighborFinder transformer and I have a maximum distance of zero, since the gardens and the houses need to touch one another. So far, so good. However, now I get another problem.I have the following situation. You can see in the drawn example below that the garden and House 1 share a line, while this is not the case for House 2. However, based on my current settings in the NeighbourFinder, the garden is as well considered a neighbour for House2.How can I go about it, that House 2 is not included, since House 2 and the garden don't share a line, but only one vertex. Do I need to change  some settings in the NeighbourFinder or do I have to go differently about it.  

653
bwn
Evangelist
adam_timmons
Observer
adam_timmonsObserver
asked in Data
Bentley Microstation Reader Not Showing Referenced Files

Note: we are primarily using FME Form version 2023.2.4.0 (build 23785), but have also tested this on 2024.0.1.0 (Build 24202) with similar results.We have received DGN files that are referencing models that are both internal and external to DGNs themselves. These external DGN files are located in the same directory folder as the file being read. We are interested in having the reader (Bentley MicroStation Design (V8)) read not just the primary DGN, but also the referenced models.In the parameters for the reader, we check the box for “Read Elements from Reference Files” and set the value for “Max Depth of Reference Files to Read” to something arbitrarily large like 20.Selected parameters, but have tried a variety of combinations of values with no difference in outcomes.Because we are interested in reading data from different files, the “Single Merged Feature Type” option is selected.When the reader is run, we see data from the primary DGN, but nothing from any other DGN that it it is re

1261
saraatsafe
Safer
valentinthonen
Contributor
valentinthonenContributor
asked in Integration
Why can FME not properly position an AutoCAD drawing, while ArcGIS Pro can?

Hey all,I have a general question about how FME deals with AutoCAD files.I have an AutoCAD .dwg drawing which contains multiple xrefs. When I open the xref file in ArcGIS Pro it is positioned on exactly the right position on the map, while when I open the same file in FME it is positioned somewhere in France. I know that the reason why the drawing is placed somewhere in France is because FME does not recognize the coordinate system. But how is ArcGIS Pro then able to do it? When I click in ArcGIS Pro on the source tab of one of the sublayers properties I see that the coordinate system is unknown. The reason why I ask this is because I would prefer to use FME as a workflow to convert .dwg files to feature classes in .gdb database, but that as long as the drawings are not possitioned right this would be useless to do. Wondering if someone knows about how this can be the case.Looking forward to the asnwer, thanks :)

552
bwn
Evangelist
judy_fme
judy_fme
asked in Transformers
how to dissolve line segments into long line?

I need to dissolve line segments into long line base on some attributes. I tried LineCombiner and it doesn't work, still same segments in the result.

97914
indybrown
Contributor
gogopotter90
Contributor
gogopotter90Contributor
asked in Data
How to use Python script into FME ?

Hello , i have a Python script works good into Pycharm without problems , to do some tasks on excel file then i am using the new excel file output of Python as input in FME .i would like to use Python caller , to put the same script inside FME.how could I change the script to be compatible with Python caller ?which changes should I consider and think about it  ?Thanks in advance 

1552
gogopotter90
Contributor
marchpirism
Observer
marchpirismObserver
asked in Authoring
Issue with Lost Progress in FME and Autosave Concerns

Today, when I opened FME, I was surprised to find that none of my recent progress had been saved. I’ve been working on this project daily, usually leaving my computer on standby overnight. Every day, the project would reload without any issues, and even when I manually closed FME, the recovery pop-up would appear, allowing me to restore any unsaved changes.However, today, FME didn’t offer the recovery option, and my workspace loaded without the latest changes. It was quite shocking. After some troubleshooting, I discovered that if you copy the workspace to a different directory and open it from there, the recovery option reappears. I did this and managed to recover my work, but I’m concerned that what I recovered might only be the most recent autosave, which was generated after I started investigating the issue.I'm wondering if there’s a solution to prevent this from happening again, or a way to retrieve the exact progress I lost.Additionally, is there a way to configure FME to automat

892
hkingsbury
Celebrity
sammy
Supporter
sammySupporter
asked in Transformers
Resolve domains option to output coded value rather than "null"

Is there an option or setting that I have missed?I have a reader pulling in data from a portal feature service. I set it to resolve domains.I have a field that, for whatever reason, the coded value is not being resolved so the “_resolved” field is being populated as <null>.Rather than having to add transformers to each of my workbenches to check each of my domain fields, I was wondering if there is a setting I am missing somewhere?In this instance, I would rather have the coded values populate the “_resolved” field rather than it show up as “<null>”. Is there an option that I can set in the reader (or somewhere else) to be able to do this? I am using Workbench 2023.1. This post indicates that there was no option 3 years ago… hoping there’s been an update made? Also, looks like no progress made on this request (from 4 years ago!) to at least add a warning in this type of situtaion. Please go upvote: 

2426
sammy
Supporter
emerson_styles
Contributor
emerson_stylesContributor
asked in Data
How to add nodes on a line with point data

I’m doing a routing analysis and I have a road network that I need to create new nodes along where I have points for addresses. I used the AnchoredSnapper transformer to ensure that the points align with the line data. The point data (addresses) is a separate dataset from the line data (network). Does anyone know how to create new nodes along an existing line using point data?

682
liamfez
Influencer
michaelbreen
Contributor
michaelbreenContributor
asked in Transformers
Disabling Feature caching causes transformer to fail.

Has anyone experienced a workbench erroring when feature caching is disabled? For context I have had this workbench running through task scheduler for around two years (keeping it updated) and recently discovered an issue where it crashed at a specific transformer (feature joiner).In testing I have run the workbench with feature caching on (it worked fine) so I tested all the normal points - replace transformers, replace readers/writers, change user credentials. When I turned off feature caching is where the error occurs (in the same spot as when running it through task scheduler).The attached logs show where it crashed on the feature joiner, has anyone experienced this? My last step is to recreate the workbench from scratch and test that as well.

1175
jamesadams
Contributor
nigelgriffiths
Contributor
nigelgriffithsContributor
asked in Transformers
Calculating area of overlap for one feature layer against another, and filtering based on percentage of overlap.

Hello, I am attempting to replicate the following PostGIS SQL code within an FME workspace: where ST_DWithin(property_boundary.shape ,restriction_area."SP_GEOMETRY",100) and ST_AREA( ST_INTERSECTION(property_boundary.shape ,restriction_area."SP_GEOMETRY"))/ST_AREA(restriction_area."SP_GEOMETRY") < 0.1 property_boundary layer is parcel data for an area. restriction_area is a collection of polygons where the same restriction applies but for different reasons which is listed in the attributes. If the above script is true for a given property an attribute is then applied. I am not very familar with PostGIS SQL, but from my understanding, this script is filtering for all property_boundary shapes that intersect a 100 meter buffer of the restriction_area. Then, it calculates the total overlap between each property_boundary shape, and each restriction_area shape. If the area of overlap for a property_boundary shape is less than 10% of the total for a given restriction_area it is selected in

1302
bwn
Evangelist

Badge Winners

Show all badges

Community Stats

31,758
Posts
120,640
Replies
39,382
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.