Skip to main content

- - Community Resources
Ideas
Product Updates
Events
Blog

EN

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,684 Posts
50,749 Replies

When you subscribe we will email you when there is a new topic in this category

12684 Posts

asked in Transformers

XML Templater is slow while writing huge xml file

I have an requirement where to write an xml file with around 12MB, which is taking almost 30 mins in a 16GB ram server. Is there any alternatives

townestContributor

asked in Transformers

Enable feature caching between sessions

Is there a way to enable feature caching between sessions, so that the workspace doesn't need to be re-run after closing Workbench? Thank you.TylerFME Workbench 2020.2.1.0 Win64

asked in Transformers

Convert Civil 3D dynamic block visibility state text to a GIS attribute

Hello, I am working with a Civil 3D 2019 file with FME verison 2018 that I want to convert the dynamic blocks as points to a GIS layer. I can see in the Civil 3D file a field name Visibility1 that has text of what type of water fitting it is. i.e. TEE, BEND, VALVE etc. (see image) I would like to "expose" this attribute to use in the final GIS point layer as an attribute. I looked online for solution. I tried using the attribute exposer to get autocad_entity_visibility, autocad_text_string, autocad_entity_visibility and autocad_visible_attributes{} butI don't see any text. I have exploded and not exploded block entities. I checked and unchecked read visible attributes as text entities. I am sure that there is a solution, but haven't found it yet.Thank you for your responses and help.

townestContributor

asked in Transformers

Attribute Creator with found Regex, Else default

I want to create a new attribute from a regex pattern found in another existing attribute. If no pattern found then default to static value. Say for example, attribute bID has values 1<a>4, 44<a>, 98. My new attribute would be code1 would have values a, a, d. The regex finds the 'a' and 'd' is the default if no 'a' is found. I have played around with a series of transformers, but my solutions are clunky. Can someone propose an efficient solution? I'm struggling a bit with how to use the text editor to return a found regex pattern. Still learning! Also, I want to stick with implementing regex code because my actual problem may have a more complex regex pattern.Thank you,TylerFME2020.2.1.0 Win64

asked in Transformers

Using ChangeDetector to compare GeoJSON and Shapefile versions

I'm attempting to confirm that a set of GeoJSON area features are geometrically identical to a Shapefile produced from the same source. Of the 19k features, less than 400 come out as Unchanged, with the rest going to Inserted AND Deleted. I've set match Geometry to 2D and turned ON Lenient Geometry Matching. When I write the same GeoJSON out to Shapefile, the resulting Shapefile gets all of its features routed to Unchanged under the same settings. Any ideas as to why I'm seeing this behavior?

asked in Transformers

Expert Notes: Group-By Functionality in the FeatureWriter for 2021.0

New for FME 2021.0 is Group-By functionality on the FeatureWriter transformer. Group based transformers process data simultaneously based on data groupings. When Group-By Processing is enabled, the user can choose which attribute to use, which divides the data into groups. Additionally, if your data is pre-sorted into groups before entering the transformer, selecting “Process When Groups Change” can speed up the transformation as the transformer isn’t waiting for all of the data before sending the group of data out. In addition, when the groups change in this mode, the current writer will be closed and all its data will be written out before the next feature arrives. By adding this functionality to the FeatureWriter, data can be forced to be written out chunks at a time by using attribute values to define groups, instead of waiting for the entire transformation to end. This will avoid running out of resources such as file handles or memory in certain scenarios. One example is streamin

asked in Transformers

Splitting feature type from a transformer

Hey, How do you split two differents feature type, like point and polygone, that went into a Tester together, back to being independant again. Thanks, Ian

asked in Transformers

Connect points to the grid

Hi, I have a set of polygons (representing the street blocks) from which I was able to create centroids. I would like to create a grid from those points, meaning that points would represent grid intersections. Have already tried with triangulation but had no success.If it is helpful I can try and upload a sample. I would really appreciate any suggestion. Thank you. Edit:I believe I need to explain a bit more. In the current approach I am creating a "grid" based on the street centerlines and merge them with Neighbourhood Aggregator to 800x800m cells. The problem is that at the end grid borders are always on the centerlines (one side of the street is in one cell, where the other side of the street is in neighbouring cell). I would like to now try a different approach, where the grid borders would connect centroids of those blocks, this for example would be the output (red lines). Ideally, they would have a more rectangular shape, but not exclusively, it could also contain squa

joe.fmeContributor

asked in Transformers

Sorting duplicates gets rid of cells with values in

Hi all, Feel like a regular here now, but after the success of my last question about keeping the lowest date in a series of entries, it appears that only some of these entries have values in. For example the reference field and date field will always have a value in, but the others? Not so much. Here's an example (attached). I've tried to use Aggregators and AttributeManagers to varying levels of success, which have ultimately caused more issues...but I wondered if there was a way of keeping the data from the populated rows and putting them into the others for that specific Reference number? Hopefully the attached screenshot will show what I mean. Apologies for the blanking out of data as it's confidential, but I've been wondering about this all day. It seems so simple, yet...not. Thank you

asked in Transformers

How to develop a linked custom transformer (the right way!)

Hello, this topic is based on this initial post from me:https://community.safe.com/s/question/0D54Q000080hM3SSAU/what-are-the-fme-best-practices-for-modularization?t=1609774258752 However, the question is now a bit different. Therefore, I will open up a new topic. Goal: I would like to develop a linked custom transformerIssue: If the custom transformer has some sort of complexity, I have problems debugging it, since things like “feature caching run” is not available there.Used FME Desktop Version: 2020.1.3.0 (Build 20632) I tried 3 possible solutions, but I have some issues with all of them. Maybe you can help me out finding the “right way” to do it. Possible solution 1: Convert the linked custom transformer into an embedded one, develop inside the embedded custom transformer and then export it back into a linked custom transformer.Possible solution 2: Copy the content of the linked custom transformer into a new workspace, develop inside this new workspace and copy it after the develop

asked in Transformers

PythonCaller Transfromer and Multiprocessing

I'm struggling with the PythonCaller Transfromer regarding multiprocessing. The script below is a simple example to illustrate my problem. How can I get it running as a PythonCaller script? Currently the translation log says:File -c could not be openedProgram TerminatingTranslation FAILED.Error running translation.Translation Abortedimport multiprocessingimport randomimport time def worker(t, i, return_dict): print("Sleep {} seconds".format(t)) return_dict[i] = t time.sleep(t) def multiprocessing_test(n): print("in multiprocessing_test") manager = multiprocessing.Manager() return_dict = manager.dict() jobs = [] for i in range(n): p = multiprocessing.Process(target = worker, args=(random.randint(3,6), i, return_dict,)) jobs.append(p) p.start() for p in jobs: p.join() print(str(return_dict)) if __name__ == "__main__": def processFeature(feature=None): print("in processFeature") multiprocessing_test(10) #proces

asked in Transformers

Extract table from webpage and hyperlinks in table

I'm trying to extract all of the data from a table that lives on a webpage along with the hyperlinks that are embedded inside of one of the columns. The HTML table reader is only able to return the data that is displayed on the webpage, not the hyperlinks that are present. On the flip side, I can only get the HTMLExtractor transformer to collect the first record in the table. Attached is my workbench... what can I do to collect all of the records in the table?

joe.fmeContributor

asked in Transformers

Keeping highest date

Hi all,I'm trying to keep the highest date in a range, and each of these has the same reference number. For example - "Reference Number 1 has 8 dates and we need to keep the highest date for Reference 1", but repeat a few thousand times. I've had a method which worked before using Adjacent Attributes and sorting, but it doesn't seem to be working here. The dates are input in the %Y%m%d format (ie. 20120301) which I had hoped would make sorting easier. I didn't know, after a long search and trying methods out, if anyone had any pointers on how to achieve this highest date business? Thank you

asked in Transformers

Write textured OBJ to FBX

Hi Everyone, I have problem with exporting textured OBJ file to other 3D files. Only geometry was exported. It is even possible?

sameerContributor

asked in Transformers

OneDriveConnector not rejecting invalid Download Location

Hello & Happy New Year Whilst testing this transformer I realised that if I set it to:Download "As File"Download To Folder "Intentionally set to wrong location" Then the invalid setting is not rejected nor the cog changing its colour to red.Is this by design? If I, of course, amend the ObjectID then the feature will be rejected.I also set the target folder (wrong location) as an attribute and same result ThanksSameer

ekkischefflerContributor

asked in Transformers

Trouble writing IFMEFace to IFC

I'm trying to write a a few 3D buffered lines into an IFC file. Buffering the lines to solids works fine, resulting in IFMEMultiSurface geometries which in itself consist of a good amount of IFMEFace geometries. When writing to IFC, I'm creating these features:1 IfcSite1 IfcProject1 PropertySetDefinition700 IfcProxy (my buffered lines) In the log I get the following warning while no features are written: IFC: Unable to write a geometry of type 'IFMEFace' with representation identifier 'Body'... Last line repeated 65059 times ... Any help would be appreciated. I can't find any documentation on 'representation identifiers' and how they influence writing IFMEFace geometries to IFC. FME 2020.1.2 b20620

juanmahereSupporter

asked in Transformers

DISSOLVER transformer not working properly . FME2020.0.1.0

I've had some issues regarding this Transformer: Dissolver.Using a dataset of polygons, after being worked, it is assumed that there are present a bunch of geo-issues as Gaps, Overlaps... Firstly, for GAPs, as my First option, I start dissolving the entire dataset to then extract "holes" or gaps with the transformer: DonutHoleExtractor. Here is my input: Consequently, and as I expected, all Holes were extracted and solved within the rest of the FME workbench, until I double-checked on the final output, where I mimic same transformer on Final Output, and surprisingly I got new Holes: Example: (I know, there are a bunch of holes... :_( )From the first Dissolver output, I'd get the Green ones, and with last final check (remember, same Dissolver transformer), I get the red ones, green ones were solved:Also, as you can appreciate, from the very beginning, there were green and red ones already on the dataset. The Dissolver parameters: My Second option was to try, on the sa

gisgis2014devel

asked in Transformers

Adding Measurement as line on the Road Network

I want to add from excel file start and end point that are in Meters, to the road network(which is complex) and create line from it. attaching sample shapefile and excel file. Join field is RoadName. Does anyone solved such case? All suggestion will be very helpful. Thanks a lot.

asked in Transformers

RasterExpressionEvaluator and If statement error?

I have a single band numeric raster on which I wish to cap the max values. I read in as tiff and then run through the RasterExpressionEvaluator with a simple if statement as follows:The output I send to the data inspector - but this is where it gets confusing as all the cells which have values greater than or equal to 20 are now set to NoData (0) and are NOT set to 20.0:In effect the @if statement seems to be ignoring the 'else' option. What am I doing wrong?

gisgis2014devel

asked in Transformers

Testing if unique values have different values in another field.

Hi, How I can test if unique values have different values in another field. Example: Field1 Field2AB1.... 1AB1.... 2AB3.... 3AB4 ....4AB5.... 5AB6.... 6AB7.... 7AB8.... 8So, AB1 has in field 2, values 1 and 2. So I want to filter that separately. Values can be changed, so I want generic solution. Can anyone help me with that? Thank you

asked in Transformers

How to create a PDF report based on features that will create their own list of data to be reported. One page by feature

Hi community,first of all, I whish you the best for the new year... Second, I have to create some report based on features retrieved by a first query.These features will be the "header" of the report page.I will have as much page as I have feature. The report "body" will be build according to query besed on the feature. So for example I will have: 1) 3 features : AAA- BBB- CCC==> 3 PDF pages with AAABBBCCC. The body of the pagze will be a query based on: Get info from AAA==> Create a table in the pageGet info from BBB==>Create table in the pageGet info from CCC==> Create table in the page... and At the end the 3 pages will look like: {MAIN_FEATURE_ID} TABLE WITH DATA---I already had a look at the PDFPageFormatter but I don't understand how it has to be configured. I hope you understand what I want to achieve.Thanks in advance for your help.Best regards,Steph.

asked in Transformers

how to save IFMEPolygon

Dear Sir or Madam:I am using FME to convert s57 to shapefile, but I cannot save the information below IFMEPloygon( the information in the red rectangle in the below picture).Can you give me some tips?Thank you very much.

asked in Transformers

S3Connector - Download translates special characters to underscore

HI there,I'm using S3Connector to download files from a bucket to a folder location defined in the "Download as File" parameter. These files may have special characters in the filename, such as: "%", "(" and ")" and they get converted to "_".Example: "1110716% - (Copy).dwg" --> "1110716_ - _Copy_.dwg" Is there some way to handle these characters?Or if there's a set list of characters that the transformer is treating these characters this way so I can set up rules down the pipeline to treat them as underscores? This is happening on FME Desktop and Server: 2020.2, Build 20787 Thank you,Janet

asked in Transformers

Stop PointOnAreaOverlayer after checking all points

Hi,I would like to check if some points (around 2,000) overlap with building areas (around 54 million). When running the PonitOnAreaOverlayer it takes about 1.5 h to run as the transformer needs to count all the polygons, too. Is there a possibility to stop the transformer running after the points went through? I am still a beginner to FME, so there is probably only one single click to do...Best,Jo

townestContributor

asked in Transformers

AutoCAD text point location/justification?

I've noticed that FME converts AutoCAD text into a point at the bottom left justification of the text even though my CAD drawing has the text justified middle center. Is there any way to adjust where FME reads the text into a point? Thank you. Tyler FME(R) 2020.2.1.0 (20201130 - Build 20806 - WIN64)

1
...
171
172
173
174
175
176
177
...
508

Page 174 / 508

Badge winners

johnjmillarhas earned the badge 12 Days Participant (2024)
scottshas earned the badge Student (Grey)
deanhowellhas earned the badge 12 Days Participant (2024)
susmarhas earned the badge 12 Days Participant (2024)
geomancer77has earned the badge Welcome Back

Show all badges

30,185: Posts

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.