- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,739 Posts
50,959 Replies

When you subscribe we will email you when there is a new topic in this category

12739 Posts

Most replies

Most views

Newest first

takashiContributor

asked in Transformers

Case that HTMLExtractor cannot extract elements by class name as CSS Selector

From this Q&A;: Extract data from webpageSource HTML: https://historicengland.org.uk/listing/the-list/list-entry/1435084I tested the HTMLExtractor in FME 2017.0.0.1 build 17271 to extract some parts from the source html setting a class name to the CSS Selector column.Source HTML (part):<div class="main-col"> <div class="text-col"> <h1>Basingstoke War Memorial</h1> <h2>List Entry Summary</h2> <p class="summary"> This building is listed under the Planning (Listed Buildings and Conservation Areas) Act 1990 as amended for its special architectural or historic interest. </p> <div class="attributeList"> <p><span>Name:</span> Basingstoke War Memorial</p> <p><span>List entry Number:</span> 1435084</p> </div>HTMLExtractor Parameters:Result: Elements belonging to "summary" class have been extracted, "attr

370

7 years ago

miikamakela

asked in Transformers

ValueError: could not convert string to float

Hi, I have a strange issue in this sampler tool which relates to a python syntax in a private parameter. The CT is based on an old tool that used to be on the hub. I have updated it, but it fails to work if parameters are set from outside the CT. If they are hard coded, then the tool works just fine. Any ideas?Miika

3315

7 years ago

conchContributor

asked in Transformers

Managing data extents within mapnikrasterizer

Hi using the Mapnikrasterizer and trying to zoom to a particular set of features (or area) befor creating an image with the input datasets. For example (and keeping it very basic for now), suppose two datasets are being fed into the Mapnikrasterizer: Dataset1 covers an entire State/County...whatever jurisdiction. Dataset2 is a polygon and only partly covers part of the jurisdiction. WITHOUT CLIPPING the data from Dataset1, can Dataset2 be used to manage the extent of the contents such the the final image produced by Mapnikrazterizer is limited to the extents (or thereabouts) of Dataset2? If tried using the BoundingBoxAccumulator, BoundsExtractor, Bounding Boxreplacer and 2D Box Replacer to mange the extent but they don't appear to have any affect. Grateful for any feeback CC

210

7 years ago

arthyContributor

asked in Transformers

How to write add a string containing a special character to the log file with TCL/python

Hello,I woul like to write the expression VAL_NON_NULwhose value equal to "TAUX !=0" using a TCL script.I tried the following command inside a TCLCaller:FME_LogMessage fme_inform "condition\40("&VAL;_NON_NUL")"but only the string "condition TAUX ". The part after the exclamation! just vanished.I also tried to to use a python caller but I didn't get the expected resultsHow can I fix this issue?Thanks

505

7 years ago

mark2atsafeSafer

asked in Transformers

FME Community: Star Wars Day Badge

Just a quick note to mention the Star Wars Day badge - awarded to whoever posted a question or answer on May 4th (yesterday). https://knowledge.safe.com/badge/502044/skywalker.htmlSo congratulations to the 27 users who earned this new badge. Check your account to see what badges and custom badges you have. I've got 3 custom (green) badges - I wonder who has the most?

230

7 years ago

aronContributor

asked in Transformers

Aligning polylines

I have roads and trails in one shapefile (file A) and in a separate I have lines which show which trails are signposted (file B). Unfortunately the later is not very precise so it does not align well with the trail or road. Can I use FME to detect proximity and then create a new shapefile where this proximity is marked by "high-lighting" the relevant parts of the trails/roads in file A?

260

7 years ago

philipContributor

asked in Transformers

ChangeDetectors/ run WorkspaceRunner once (if change was detected)

Hello, I use several ChangeDetectors to verify if the content of my "source tables" differs from the content in my "tables to publish". I would like to update the "tables to publish" only in case, if some changes occured. I tried to gather all records from the "added" and "deleted" outputs of the ChangeDetectors to check if there is at least one record that changed. In case there is changed values/geometries, i want to run the WorkspaceRunner, but only once (to call another fme workbench doing the database update). Is there a way to do this? Thanks for any ideas! Philip

7 years ago

andyew

asked in Transformers

Geographic query between point in one table and line in another.

Folks,I'm finally making some headway with a Mapinfo to GML writer. Table to GML output is working fine. The requirement is to inspect the start and end point of a polyline and see if a point from another table exists. I then need to take the ID of the polyline and the ID of the point and write those value out to GML I now have a challenge with two options. I could create a dataset in Mapinfo where I do the geographic intersection using MapinfoORThere may be some magic way to create this data in FME. I suspect a combination of a CoordinateExtractor and PointonLineOverlayer might be what I'm after but my novice skills are letting me down. I don't know how to join these two things together.I should add I need to identify the start as "1" and the end as "2" as part of the GML writing.

7 years ago

jdhContributor

asked in Transformers

ListBuilder Input is Ordered by Group

Has anyone else noticed a significant decrease in performance when using the ListBuilder Input is Ordered by Group?When I have 100,000 features in 10,000 groups of 10 features each, when I set the Input Is Ordered to no, the processing time is 8 seconds, even though the transformer is blocking. Whereas when set it to Ordered by Group, the processing time is 74 seconds (almost 10x slower), even through the transformer is non blocking.No parallel processing is involved.

130

7 years ago

arde

asked in Transformers

I want to filter a date attribute field. I only want the features with the current date to return. What would be the way to go?

1150

7 years ago

claird

asked in Transformers

Aggregator transform node issue

I've been working with the aggregator transformer converting various kml files into one. The issue I'm facing is that when aggregated FME takes the nodes and meta data from the first line in the group. I'm okay with it taking the meta data, but I'd like to be able to edit the whole line and be able to not just see the nodes from the first line, but rather all the nodes from the combined lines.

7 years ago

richardtriesfme

asked in Transformers

data download service input schemas not matching output schemas

Hi,I'm wondering how to modify this so that output schemas match those input?Regards,Richard

7 years ago

borochri

asked in Transformers

For igds_text_num_lines, what value should be used when the number of lines of text is not constant?

7 years ago

rkrajesh

asked in Transformers

i have a 3d dgn file in that 3D buildings generated from Lidar data....now i have to group that features as a seperate building in FME...so please provide answer how to do that?

7 years ago

taojunabcParticipant

asked in Transformers

Why @username not marked as hyperlink

When using Q&A; Forum, I enter the @username submission, part of the @username is not marked as hyperlink, but is displayed as the general text. But I found that the other user submitted content in the @username will be displayed as hyperlink. is my way what is wrong?

110

7 years ago

roarousland

asked in Transformers

Fatal error message during export from MicroSation GeoGraphics format. Access querry feiles.

During export from MicroStation GeoGraphic I get this error message from the GG-reader:Microsoft Access Reader: Opening `H:\Produksjon\Kart\2017\Roar_data\Prosjekt\Data\Testdata\Input\TAB\ParksExport.mdb' for read operationMicrosoft Access Reader: Query failed, possibly due to a malformed statement. Query Text `SELECT * FROM PARKS WHERE PARKS.MAPID = (SELECT MSLINK FROM MAPS WHERE MAPS.MAPNAME LIKE 'ParksExport.dgn')'. Provider error `(-2147217865) The Microsoft Access database engine cannot find the input table or query 'MAPS'. Make sure it exists and that its name is spelled correctly.'A fatal error has occurred. Check the logfile above for details@Relate: Failed to execute prefetch query. Continuing with incomplete cacheMicrosoft Access Reader: Database read complete. Retrieved 1 feature(s)This happens for several Reader formats.I converted Parks.tab from the training dataset, to GG, and tried to convert back to TAB.The errormessage comes from the GG-reader.- What makes this happe

7 years ago

pratapContributor

asked in Transformers

Leader Line in Geodatabase

Hi,Can any one suggest/guide me the procedure/material for placing leader line along text in annotation feature class in gdb.Pratap

7 years ago

opowell

asked in Transformers

how to download & process a csv from the web, but which url changes daily based on the date

Hi, I am trying to automate a process whereby I download a CSV from an opendata site (a list of schools from our UK Department for Education) and process it to create a shapefile for the area I'm interested only. I can download the data manually then run my workflow which creates the geometry and clips to my area, etc... but the automated download via the url is the bit I'm struggling with.The source data is uploaded daily and posted as a link which url is dynamic to reflect today's date. This is today's link: http://www.education.gov.uk/edubase/edubasealldata20170502.csvI wanted to create the workflow and run the it every week or month as scheduled task but it needs to know the date it's running.I've tried to use :1. CSV reader with the url in the path -it works fine when all as above. Then I amended it in the text editor to replace the date with @Timestamp("^Y^m^d") * . It reads the schema and have all fields / columns "green" but fails on

11914

7 years ago

tim_woodContributor

asked in Transformers

Which Tester operators are case sensitive?

At the excellent FME conference in London yesterday, I thought @1spatialdave said he used Contains in a Tester because it wasn't case sensitive. I've been doing @LowerCase(@Value(myAttr)) for some tests where I'm not confident of the case of the value I'm testing. So I'm interested to know which Operators are case sensitive and which are not. For example, if my value is "COMPLETED", I presume that myAttr = "completed" will not match. But will myAttr LIKE "completed" match?It would be great not to have to worry about doing @LowerCase()...If some operators are case sensitive and some aren't, please can we have this on the Tester help page. If it's already available, please it be linked to from the Tester helop page.Depending on the answer to this, I'll vote onhttps://knowledge.safe.com/idea/24357/case-sensitive-option-when-testing-attribute-value.html

920

7 years ago

aquamarine

asked in Transformers

Space Delimited XYZ file Extents

Hi, I have a large number of space delimited XYZ files (*.xyz) and I would like to find a way to determine the extent of the files. I don't want the minimum bounding rectangle, but the actual boundary as it would be if I were to join all the outer points of the file together.I thought about buffering every point in the file, then dissolving the resultant buffers, but that is very time consuming so I would like to find an alternative method if possible.Thanks,

100

7 years ago

femoContributor

asked in Transformers

Attaching one rastermap flush with another rastermap

Hi,I need to atach a new geotiff to an existing one. The extents of the new maps overlap with the existing ones, therfore i want to clip the new raster so that they are displayed flush with the existing ones.To achieve this, i think i need the "real bounds" (data extent) of the existing raster for the subsequent clipping process. If I clip with the bounding box I would expect gaps between the maps!Until now I have achieved this:- lower left corner and lower right corner(the bounding box is bigger than the real data extent):Above you see the process. I wonder how I can get a polygon that represents the outershell of thereal data extent? Any ideas out there?Best wishes

7 years ago

jeroenContributor

asked in Transformers

compare geometry polygon with the geometry of multiple polygons

I'm working on a test setup that compares two polygon data sets with each other. The end result should be a match on geometry within a 10% tolerance (bigger and smaller) and the centerpoint (inside point) should not be more than 2 meters away. The one on one match with matcher is quite easy and also the test for the 10% tolerance and 2m centerpoint works but i'm getting stuck on the next step. I have one data set that is leading (red is more detailed) and i would like to know if there is a match with the blue set when you combine two or more polygons of the red data set and do the same test (10% and 2m). Is there a way to loop the results at the end so i can use the output from the unreferenced featurmerger and and match them with mutiple polygons from the attributecreater '3 = no 1on1 match' and do the same tests as before. If there is a case that there are two or more matches, how can i use the best match in size?In the end i want to use it on two maps that both have

940

7 years ago

ian2016

asked in Transformers

Map frame , title etc in 3D PDF

Hi I am having trouble adding map marginalia to a 3D PDF I am creating. I create a surface and write that to 3D PDF. Nothing I add using the example at https://community.safe.com/s/article/creating-pdf-cartographic-output works. When I output it to 2D it is working. So the question is, is it possible to add a "frame" around the #D view and Title boxes etc?

120

7 years ago

shanezentner

asked in Transformers

Adding more decimal places to geodatabase feature class.

Currently, the geodatabase is rounding to six decimal places and I need the latitude and longitude decimal places to go to 10 places behind the decimal as shown in the original data. Is this possible? The geodatabase writer that I am using is uses dynamic properties.

130

7 years ago

robertlewis

asked in Transformers

TCPIPReceiver Query

Hi, I'm trying to query a TCP/IP protocol service. Not having much exposure to the TCP/IP protocol I'm wondering if it is the workflow of the TCPIPReceiver? I can confirm the workbench is hitting the target server with the query created in the Attribute Creator however I'm getting no response from the server. See attached image of workbench. Any advice would be appreciated?

110

7 years ago

Page 395 / 510

Badge winners

chadprophas earned the badge Welcome Back
mpsimshas earned the badge FME Flow Authoring Training
boostpadhas earned the badge FME Form Advanced Training
boubcherhas earned the badge Welcome Back
anandakundu.scehas earned the badge Welcome Back

Show all badges

30,425: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.