Skip to main content
  • EN

Transformers

Using transformers to modify data.

  • 12,684 Posts
  • 50,748 Replies
12684 Posts
mickael
mickael
asked in Transformers
Find overlapping segments of two MultiCurves

Hello, I have two geojson files, available [here] (until the 21/04/2021). Each one contains a MultiLineString feature, converted to IFMEMultiCurves with FME. I would like to be able to detect any overlapping segment, with some tolerance, no matter their directions, and set a property to any overlapping (or "close-enough") segment from one dataset with any segment from the other dataset.I have tried various transfomers, but I am not able to detect overlapping segments, nor to break my datasets into segments ... Any advice about how to do this ? Thanks in advance :)

90
mickael
3 years ago
K
kahya16
asked in Transformers
How can I convert from the IMDF standard to the IndoorGML standard.

I am trying it via Quick Translator but I am not getting a printout. I want to be able to convert the IMDF standard to IndoorGML. Thank you in advance for your help.

150
nampreetatsafe
Safer
3 years ago
daveapegg
Contributor
daveapeggContributor
asked in Transformers
Is anyone else having issues with GeographicNeighborFinder?

Hi guys, I have been having an issue where some Base feature attributes where an attribute is Null are being populated with the attribute of the first Base feature that passes through the transformer.... the Candidate doesn't have this attribute so i can't be from that. I've run the workbench on FME 2020 and 2021 and get the same result. Cheers, Dave.

70
redgeographics
Celebrity
3 years ago
aron
Contributor
aronContributor
asked in Transformers
"Spatial tiling" with SQL?

I was considering the possibilities working on large datasets by doing transformations as needed, in stead of clogging down the system with one big run. One way to do this would be to extract the required area, conducting the desired transformations and writing the result to a new table. Repeat when required, at some time in the future the new table would be completely "transformed". Assuming a dataset in postgis that has no county codes or similar ways to easily group adjacent features. And assuming it is huge and vectorized with many tables and gigabytes of data. From my experience the clipper transformer is pretty slow and would not perform well on the large datasets in this example.  Q: Is there a efficient way to create a system of tiles covering a huge area, like a country or similar? And then writing these "tilecodes" to the features spatially covered? Can this be done with SQL?  This is a follow up question to one I had a few days ago: https://community.safe

40
david_r
Evangelist
3 years ago
A
amalenczak
asked in Transformers
How to use feature count (or a value derived from feature count) as a parameter.

Hi all, I’m working on an FME script and I’ve hit a wall I can’t seem to get over.  Basically, I’m using a custom transformer (PointClusterer) to cluster a bunch of points by proximity. The number of clusters I want is however many it takes to have groups of 300 plus remainder. So if I have 1500 points, I have five groups, 1501 points, I have six, 1499 points, I have five etc. The problem is that the PointClusterer transformer wants the number of clusters, not the cluster divider, and I want this field to be filled in dynamically based on the characteristics of the data I'm loading in. Theoretically, this shouldn’t be a problem. There are a bunch of different ways to get FME to calculate the number of clusters I want based on the total feature count I load in. Here’s an example of a really basic way I cooked up. I take the total count of features, divide that number by 300, round down, then add 1 and write that number to a field as an integer. Unfortunately, when I connect this f

3020
caracadrian
Contributor
3 years ago
R
rhysdixon8
asked in Transformers
How can I alphabetize a text string?

I need to check a match between two output fields. The order of the data is inconsistent, and therefore ABC is not flagging as a match with CBA. I want to alphabetize the text strings so that the order is consistent and can be picked up via the equals or contains function in TestFilter.

110
caracadrian
Contributor
3 years ago
connecter
connecter
asked in Transformers
ShortestPathFinder- help to understand the optimizations

Hi, could somebody please help me to understand the optimization parameters in the ShortestPathFinder? Here are my questions:Why does it take longer to calculate with a lower number of "Number of Iterations" (Options: When any condition passes, Number of Verifications: 1, all other empty) In my workflow (reorder 200 points) with a value of "100"iterations it runs forever, with "1000000" runs less than a 1 minute)What is the purpose of the "Iteration Rounds" option? Is there a link to the "Number of Iterations"?Thanks

130
connecter
3 years ago
C
clickingbuttons
asked in Transformers
Attribute to value, assign attribute's value to a new attribute

I have a list of features. Each has a number of columns with a date as name and as value a numeric value. I want to use the date columns as a new column's attribute value, and write the date column's value into another field, like this:  In this example I'd end up with 3 features. Furthest I've gotten so far was with the AttributeTransposer, however it returns every other field's value as missing and I can't get them back. Any ideas how to accomplish this?

90
nielsgerrits
VIP
3 years ago
kieranmg
kieranmg
asked in Transformers
Get Direction/Bearing from series of points

Hi All, i've a dataset of points along a road network. What i'd like to do is either : Get the specific travel direction for each point using the angle from the previous point(NW, S, etc)or Get an overall direction for all points by merging the points of the same road(road_name) and getting the direction of the subsequent lineEach points id is incremented so i can tell the order, i'm just not sure how to go about it. For Option 2 i have tried a LineBuilder -> HorizontalAngleCalculator with some success but i'm seeing inconsistencies with lines that should be the same. Still the same when I tried using a sorter first to make sure the start and end points were arriving in order sorting by ID.

1840
kieranmg
3 years ago
A
amalenczak
asked in Transformers
How to select and sort spatial data (lines) by length and proximity.

Hi everyone, Apologies if I'm asking in the wrong section, but I've been stumped with a geospatial problem and I have no idea where to even begin solving it.  I'm working on a project where I have a bunch of lines inside of polygonal land parcels. Here's a rough sketch of what I'm talking about: I need to further subdivide these parcels into sections that contain ~80km of line each, while trying to maintain line connectivity as much as possible. So as an example, I'd want the finished subsections to look like this (very rough) sketch here, where the blue line represents the boundary of each subdivided polygon that contains ~80km of line:I've used FME a fair amount, but I have no idea where to even start creating a workflow that can handle this. I know I can use LengthCalculator to get length attributes for each line, but I'm completely clueless on where to go after that. If I can get the lines selected and attributed into discrete groups using length tot

50
A
3 years ago
sigtill
Contributor
sigtillContributor
asked in Transformers
GeometryPropertySetter - make it dynamic

Using the GeometryPropertySetter to set Traits to IFC files needs to use an AttributeExposer to be able to select the right attributes to put on the trait. This does not work well on Dynamic Workspaces with 20-100 attributes. Is there a way to use the GeometryPropertySetter in a dynamic way? For instance submit a list of attribute names or some other "hack" to make this dynamic for "more IFC-files"?

150
sigtill
Contributor
3 years ago
P
paulbcote
asked in Transformers
Set Names for OBJ textures

Hello,I'm creating a collection of building models from an ESRI file GDB feature class. I'm writing eachmultipatch to a Wavefront OBJ file. Any number of these OBJ files may be imported into a modeling program at the same time. I've had problems when different models refer to texture files that have the same name.  My workbench assigns a unique name to each OBJ file. I want each texture associated with a model to employ the unique obj name in the name of the texture image: eg: bosYU9732_[n].jpg Currently, FME names each texture "noname[n].jpg where [n] is a small integer.  I found this thread from 2014 which seems to include tips for hacking the .mtl file. https://community.safe.com/s/question/0D54Q000080hE7FSAU/rename-material-and-texture-from-wavefront-obj-to-obj Unfortunately many of the links are broken, and it is not clear whether any of the replies were useful to the original poster. Has anyone got updated tips or an example for me?  Thank you! 

650
E
3 years ago
A
andrewbae
asked in Transformers
Help my HTML Extractor Stopped Working

I have a workflow last run about 2 years ago that uses several html extractors to get information form various parts of a website. I went to run it again without changing anything and got the following error `fme_rejection_message' has value `PowerPlants_HTMLExtractor: <class 'soupsieve.util.SelectorSyntaxError'>: Malformed attribute selector at position 0 line 1:[id=Height_of_the_Dam_(m)_nbr_rng1]^'I have other CSS selectors configured the same way that are still working. Any ideas   

110
debbiatsafe
Safer
3 years ago
U
u20900191
asked in Transformers
I want to convert a file (.las) to format (citygml), but when performing the task in the software (FME QUICK TRASLATOR), it generates an error. the file in (.las), is a file made with drone

I want to convert a file (.las) to format (citygml), but when performing the task in the software (FME QUICK TRASLATOR), it generates an error. the file in (.las), is a file made with drone

250
nampreetatsafe
Safer
3 years ago
mickael
mickael
asked in Transformers
How to "fix" a MultiCurve object ?

Hello ! I have MultiCurve objects (GeoJson MultiLineString) that represent routes along roads, and which have some geometry issues : sometimes lines are overlapping, and some lines meet at a point but with opposite direction.Here is the overall dataset :And here is a problematic area :Exemple dataset is available [here].So my question is : is it possible get a cleaner file, with no overlapping lines or segments, and with a better global direction consistency ? And how to do so ?I tried to use Deaggregator, Intersector, Snapper, LineCombiner; and a few more, but so far I don't fully understand what I am doing, and don't get closer to what I want. Thanks in advance for any tip or help :)

300
mickael
3 years ago
harmen_kampinga
harmen_kampinga
asked in Transformers
Calculate the nodata in a raster based on other values?

Hi, thank you for reading my question! And maybe you have an idea? Please let me know! It's about: filling the nodata gaps in a raster.So, I have downloaded a DTM raster file. It's based on a pointcloud and some classes are filtered out, like water, building, vegetation, bridges. That leaves some nodata holes in the raster. I like to recalculate them, based on the nearest cell values. In the past, I did this with GIS and some neighbor tools for rasters, but I can't really find how to do this in FME. I have tried the RasterDEMGenerator and also the RasterConvolver, but without any good results... maybe I don't use them well or maybe I should use a completely different approach? No clue anymore. Any help is appreciated! Best,Harmen

480
harmen_kampinga
3 years ago
J
jitsu87
asked in Transformers
I never used python in FME and now I am getting python errors for one of my workspaces. can anyone help me understand the error? I am unable to get through this.

Here is the error :Python Exception <TypeError>: 'NoneType' object is not iterableError encountered while calling function `removeDiacritics'StringDiacriticRemover_3_PythonCaller_2 (PythonFactory): PythonFactory failed to process featureStringDiacriticRemover_3_PythonCaller_2 (PythonFactory): A fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for detailsFeatureJoiner (FeatureJoinerFactory): A fatal error has occurred. Check the logfile above for detailsFeatureJoiner (FeatureJoinerFactory): A fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for details

500
david_r
Evangelist
3 years ago
M
muhammad_yasir
asked in Transformers
No Module name pandas:

Hi there, I have installed the pandas library into my workstation using the following command:fme.exe python -m pip install <package_name> --target <package_destination_folder> and got following message:Successfully installed numpy-1.18.1 pandas-0.25.3 python-dateutil-2.8.1 pytz-2019.3 six-1.14.0 However, when in python Caller I tried to import pandas using the following command:import pandasand ran the transformation, it throws an error message:Python Exception <ModuleNotFoundError>: No module named 'pandas' Could anyone help me in fixing the error? 

2682
S
3 years ago
R
robeesafe
asked in Transformers
Hello! Is it possible to extract coordinate pairs (lat/lon) that are within an actual shapefile boundary as opposed to using a bounding box of a shapefile? When I use the BoundsExtractor transformer I'm getting more points than warranted. Thanks.

Hello! Is it possible to extract coordinate pairs (lat/lon) that are within an actual shapefile boundary as opposed to using a bounding box of a shapefile? When I use the BoundsExtractor transformer I'm getting more points than warranted. Thanks.

130
rahulsharma
Safer
3 years ago
R
rimberd
asked in Transformers
I would like to change the table names of my citygml file. How can I realize that? I need it in order to transform my citygml to an imx file. thank you in advance.

I would like to change the table names of my citygml file. How can I realize that? I need it in order to transform my citygml to an imx file. thank you in advance.

40
daveatsafe
Safer
3 years ago
thijsknapen
Contributor
thijsknapenContributor
asked in Transformers
Stringfunction FindRegEx doesn't match regex pattern '.*?a.*' whereas the StringSearcher transformer does; do 'non greedy' searches fail in the stringfunction?

I hope the title is already quite self explanatory.To illustrate the issue,I generated some (lowercase) text strings with 10 to 50 characters, using the methodology that was described by cwarren in the topic https://knowledge.safe.com/questions/88643/random-letter-generator.html.I first used a stringsearcher transformer with the pattern '.*?a.*'I then also used the FindRegEx stringfunction in an attributemanager for the same expression, with various combinations for configuring the optional parameterswhile including or excluding "" characters around the regex patternwhile including or excluding the ^ and $ anchors (for 'start of string' and 'end of string')I tried searching for only part of the string in the stringfunctionwhile also trying various combinations of greedy vs nongreedy searches.i.e. '.*?a' is a non greedy search to match 'zero or more' (i.e. '*') of 'any single character' (i.e. '.'), until the first

1240
thijsknapen
Contributor
3 years ago
patmhid
Contributor
patmhidContributor
asked in Transformers
Is there a way to use a counter as an increment as outlined below? Thanks

I have a data set with multiple repeated values such as thisADAADAADABentonCanyonCanyonDearbornDearbornDearbornDearborn and I want to increment a count every time the preceding value is different than the next value.so my 'count' would be like1 - ADA1  ADA1 - ADA2 - Benton3 - Canyon 3 - Canyon4 - Dearborn4 - Dearborn4 - Dearborn4 - Dearborn

19110
M
3 years ago
dustin
Influencer
dustinInfluencer
asked in Transformers
Extract unique values from attribute table using PythonCaller

Hello - I have a file geodatabase where most feature classes contains an attribute 'text_desc'. I would like to extract all unique values, and concatenate those into a single comma-separated attribute to generate a report. Due to slow gdb read times in FME, I would like to do this in PythonCaller for efficiency. Is this possible?

6811
david_r
Evangelist
3 years ago
M
mspohn06
asked in Transformers
Hello, Is there a way to change the style of bullet points in a word written with fme? Thanking you in advance

Hello, Is there a way to change the style of bullet points in a word written with fme? Thanking you in advance

210
M
3 years ago
pti001
Contributor
pti001Contributor
asked in Transformers
I like to Create new Psets to my existing IFC Model. I tried the Acad Tutorial or the ifc Space update but both are not working with the FME2021. Attached you could find my project.

I think bei Problem is to handle the traits and to attach them to the Objects.

60
pti001
Contributor
3 years ago

Badge winners

Show all badges
30,179
Posts
Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.