Skip to main content
  • EN

Transformers

Using transformers to modify data.

  • 10,000 Posts
  • 52,712 Replies
10000 Posts
speknl
Contributor
speknlContributor
asked in Transformers
FME 2022.1 - Why is the XLSXW writer so slow?

I have this workbench in which I combine multiple CSV-files and write out to one Excel-file. the file contains aprox. 190K rows. In the previous FME version (2020.x) I used this workbench it took a few minutes. Now the XLSXW is taking hours to write the output.  Did something change in the way the XLSXW writer functions? I did a test by writing to a CSV file, this took seconds to complete, so clearly the problem lies with the Excel writer. Hopefully someone knows about a fix. Cheers, Jaap

760
M
H
hasyiramin
asked in Transformers
Hello, can we convert .shp files, to aixm (.xml) ? and how to convert them, thanks

Hello, can we convert .shp files, to aixm (.xml) ? and how to convert them, thanks

740
M
mzondervan
Contributor
mzondervanContributor
asked in Transformers
Ordering table rows after transposing

I followed the steps in Example 2 here to switch my table columns to rows: https://community.safe.com/s/article/transpose-a-table-using-fmeIs there a way to keep the original column order as the new row order after the table is transposed?Using the counter/sorter, as outlined in the example does not give me the desired order of rows.  

230
mzondervan
Contributor
mhprawiro
Contributor
mhprawiroContributor
asked in Transformers
GoogleBigQueryConnector return error Python Exception

Hi, The GoogleBigQueryConnector return the error of Python Exception. I'm not too sure what should I do to resolve this exception. I'm using the new version of FME 2022.1. Previously this transformer is working well in the FME 2020.Message error detail:Python Exception <ImportError>: cannot import name 'decodeWWJDString' from 'fmegeneral.fmeutil' (/Library/FME/2022.1/python/python39/fmegeneral/fmeutil.pyc)PythonFactory failed to load python symbol `fmepy_google_bigquery.connector.GoogleBigQueryConnector'Factory proxy not initializedGoogleBigQueryConnector_CALLER (PythonFactory): PythonFactory failed to process feature Can someone help me on this please. Thanks

370
mhprawiro
Contributor
ewb_fme
Contributor
ewb_fmeContributor
asked in Transformers
Move files to error directory after failed FeatureWriter

Is it possible to move files to an error directory when a FeatureWriter fails? Unfortunately, I have not found a way so far. Is there any other way than to use an FMEServer Automation that triggers another FME Workbench in case of an error, which only moves files to a directory? Is it possible to achieve this with only one FME Workbench?

170
ewb_fme
Contributor
friedhelm
Participant
friedhelmParticipant
asked in Transformers
Hi everybody. I have pointcloud dataset and I want to create a raster digital elevation model. I want to achieve that raster cells have a NoData value where they do not cover a point of the pointcloud.

I am using the RasterDEMGenerator transformer to create a digital elevation model. The resulting raster cells cover the entire bounding box of my point cloud. So far so good.  What I want to achieve is, that such raster cells, that do not cover any point of the point cloud will have a "NoData" value. I have tried all of the available interpolation methods, but non eof them seemed to work in this respect.  Any ideas? Thank you

190
maayke
Contributor
arnovananrooij
Contributor
arnovananrooijContributor
asked in Transformers
Point from Oracle shows at the wrong location in Visual Preview with a Background Map from a WMS

Hi,FME seems to display a single point from Oracle at the wrong location. I have a simple workspace with a SQLCreator with the following statement:select SDO_GEOMETRY('POINT(163170.864 501575.234)',28992) from dual I would like see the location in the visual preview so I have a background map which is a WMS in the same coordinate system: http://www.openbasiskaart.nl/mapcache/?  with the layers {Openbasiskaart}|{osm}. The point is shown at the wrong location somewhere in the middle of the sea. When I add a bufferer with 200 meters it is shown at the correct location. Is this a bug? I have attached my workspace (FME 2021.1.3)

70
M
rudewi
Participant
rudewiParticipant
asked in Transformers
set the SDF 'Has Elevation' (true/false)

If I write to SDF the 'Has Elevation' of the schema seems to be on 'false' by default. My data has geometry with Z values, wich are visible if i open the SDF file in the data inspector. But the SDF schema stays on 'Has Elevation = False', wich means the Z value isn't shown in autocad map3D. How can I change this?

80
evieatsafe
Safer
D
dpavlicek
asked in Transformers
Global counter not working as expected

Hi, I have 2 global counters with the same domain in my workspace (default parameters), but each of them is producing an individual sequence. As per documentation, this should produce for example 0-9 and 10-19, but I'm getting 0-9 from each counter... see the screen attached... am I doing something wrong?

563
M
S
sakshi1996jain
asked in Transformers
I'm facing an error of features will be logged and skipped.. please help me asap as I'm enable to write my entire data on postgres.

Hi,I'm having this error when I try to write the values in postgres through fme tool. The attribute has 6 possible values (0-6). what is the best way of solving this problems.Value of attribute 'n_lane' could not be converted to type 'int2'. Feature will be logged and skipped.And then at last the tool throws an error of insufficient memory available.I mean I really don't understand how to solve this issue..Please someone help me out with this.I'm attaching a photo so that you can have a clear vision of this error.​

830
redgeographics
Celebrity
jdh
Contributor
jdhContributor
asked in Transformers
Equivalent to Erdas Imagine "Clump/Sieve" or "Eliminate" function

I have an 8-bit mixed raster, where there are numeric values from 0 to 100, and then certain values over 200 are classified, 200 = water, 205 = snow, etc.Unfortunately there is a bit of noise in the data where there are single pixels coded as water (200). I would like to remove these individual pixels, replacing them with either a mean or majority filter (of 0-100 values only), without affecting any other pixel including 200 value pixels that are contiguous (so a straight convolution of the raster is out).The closest thing I can find is the Erdas Imagine Clump (to identify contiguous pixel groups) and either Sieve or Eliminate to replace groups smaller than a given threshold. https://hexagongeospatial.fluidtopics.net/reader/fH0o7KrMKUViXGUeoilQuA/cAzM7j6Akx80Fj5zsuhRFQ Any ideas of an efficient way to do this in FME? I have approximate 275GB of data to process.

1654
olivier
Contributor
C
cuckovic2206
asked in Transformers
Hi, I'm new to FME software and community. I have a question. I have three 3D points that don't have same height. I want to create arc from these points.

First, I have straight lines that are connected, then i extract end points and mid point (which I offset in direction of Z axis). From there I use these points to manually draw arc that connects these points. I want to know is there a possibility to automate this process. These lines are representation of wires between poles. I'm new to this software and don't have much of knowledge so any help would be appreciated.

170
david_r
Celebrity
stefan_kutac
Contributor
stefan_kutacContributor
asked in Transformers
Trouble with ChartGenerator (Colour and Labels)

I'm working with the ChartGenerator Transformer to create a bar chart and have two questions:1) How can I change the bar colour so each bar is a different color? I did find a post to change the RGB to (0-1,0-1,0-1), but my entry is still pink, so I can't use that.2) How can I add a label showing the number of items at the top of each bar? The PowerPiontStyler has an option for "Label Data", but I don't see one within the ChartGenerator. Currently, my table is shown like this:Thanks in advance!

260
kailinatsafe
Safer
mohamdwassouf
mohamdwassouf
asked in Transformers
I hope knowledgeable people can help me In the attached file there is a structure in .ifc format and I want to create a writer on FME DESKTOP in CITYGML format. How can I transfer the location information to the CITYGML writer without losing any of

In the training examples for converting from ifc to citygml, the site information is not taken into account.How can I keep the site information after converting it to citygml?in another meaningIn the attached file there is a structure in .ifc format and I want to create a writer on FME DESKTOP in CITYGML format. How can I transfer the location information to the CITYGML writer without lossing any of it?

40
kailinatsafe
Safer
L
lachichi_farah
asked in Transformers
How merge two layers spatially (and without common field)

Hello! I have two data set that I want to join spatially and not by attributes because there are no common fields. I want to merge (for example a layer of cities and a layer of population (I want to merge to know how many people they are per city). I tried spatialrelator and featureMerger but I failed Thank you for helping 

1390
M
smfks911
smfks911
asked in Transformers
What transformer is to use to convert from LL-GDA94 to MGA94 (i.e. Lat/Long to Projected coordinate system)?

Hi altruist, I have a set of data MITAB data in LL-GDA94. Which transformer should I use if I want to transform it into GDA94?

690
redgeographics
Celebrity
stezi
Contributor
steziContributor
asked in Transformers
Writing colored mesh to OSGB

I have created a colored mesh from a LAS file using PointCloudSurfaceBuilder and would like to write it to an OSGB file. My overall intention is to convert the OSGB to SLPK using ArcGIS Pro, as the FME I3S SLPK writer does not produce good results.  After writing the OSGB file using FME, the colors are gone, as the front appearance is set to one single ambient and diffuse color. Is it possible to multiple colors per mesh part?  Thanks in advance for Your help!  

1000
virtualcitymatt
Celebrity
mohamdwassouf
mohamdwassouf
asked in Transformers
What does ifc coordinate 0 mean as shown in the pictures What is the coordinate system for the reader that we have to add? Do we add ll84 or x-y M?

What does ifc coordinate 0 mean as shown in the pictures What is the coordinate system for the reader that we have to add? Do we add ll84 or x-y M?

50
virtualcitymatt
Celebrity
johnglick
Contributor
johnglickContributor
asked in Transformers
extracting link from html xquery issue.

I'm attempting to extract a link from html that looks something like this: <a class="email-link" href="https://app.myapp.com/results/a7696ced77454dd39d8241e79f981b3d">here</a>. using the xquery extractor. the x-query //a/@href seems to work in the online testers but not in FME. Any ideas?

330
johnglick
Contributor
smfks911
smfks911
asked in Transformers
Transformed data in MSSQL is not shown up in QGIS (urgent help please)

I have dynamically transformed CRS system of the tables (MGA94-56) from MSSQL database and then written into another MSSQL database (MGA2020-56) with same table schema. I can see the new tables exist in the SQL server. Also When I am checking the tables on FME workspace by using CoordinateSystemExtractor, I can see the tables are transformed. But the data is not displayed on QGIS, though attribute table can be seen. Also in QGIS property option, the CRS system is still showing the old one. Can anyone kindly tell me what could be the likely reason/s?

1260
smfks911
virtualcitymatt
Celebrity
virtualcitymattCelebrity
asked in Transformers
Efficient way to texture a tiled set of TINS?

Looking for alternative ideas/methods to texture a set of 3D terrain TINs which are tiled with images from some kind of image service (WMTS, WMS etc). The images and TIN tiles don't share the same extents My current process involves the following steps: Fetching and georeferencing the images, Merging the images in to one mosaicClipping/Tiling the mosaic to match the TIN tiles (here I also pick up the tiles ID)Use the AppearenceSetter (Grouping by the TileID to set the texture on each TIN tile). Here i use the TopDownGeoreference methodWrite the tiles out to format X (e.g, OBJ) Performance is slow(est) at the Mosaicking, Clipping and the Writing out parts (2, 3 and 5). Now, I see that FME 2022.1 has the option to now Clip surfaces which are textured. I'm thinking about changing the order a bit here to try and take advantage of it but before I did I was curious to see if anyone had any experience with this kind of workflow. @daveatsafe​ perhaps you might have some tips?

250
hkingsbury
Celebrity
moustik
Contributor
moustikContributor
asked in Transformers
Good morning, I wanted to know if the RasterResampler tool works correctly in bilinear mode ?

I am currently switching a project from Arc to FME and I am replicating different Arc operators to FME ones. I currently have a problem regarding RasterResampler as outputs from Arc and FME differs though using the same specifications (cell 0.05 and bilinear transformation).I am including a zip folder containing input maps, output after transformation from Arc and FME and the FME tool. I also tried a workaround, but it creates more transformers, doesn't get better results in general, and defies the point regarding processing time. Thanks Sébastien

280
hkingsbury
Celebrity
james_c_452
Enthusiast
james_c_452Enthusiast
asked in Transformers
Is there a better way to compare each coordinate from one point cloud to every point in another cloud?

Hi, Basically, I have two point clouds that overlap. One with colour, and one without. I want to find the nearest point with colour to every point without it so that I can use the colour from the nearest point I can do it by:Coercing the subset of points without colour into individual pointsMapping the XYZ of the coerced points to an attributeMaking a small buffer around these points (say 2.5cm/1 Inch)Then clipping the remaining cloud to a small area around each buffer (creating a large number of small point clouds that have the XYZ of each original point without colour)Turning the coerced XYZ attribute values into a component of the small coloured point cloudsFinding the smallest distance of each point cloud between the coerced XYZ component and the coloured XYZ component Using that smallest distance to find one point in each cloudReplacing the XYZ of the nearest neighbour with the coerced component and thereby finding the closest RGB value for the original points that had no colour.T

1830
kailinatsafe
Safer
L
lachichi_farah
asked in Transformers
How can I separate words (which were in an attribute) in several attributes for the same feature ?

Hello, I have in my attribute, words separated by comma. I would like to have a word by attribute not all the words in an only attribute. I used "AttributeSplitter" , a list has been created, then I used "Listexploder" and I have my words (which were in an only attribute) separated but not in several attributes for the same feature, it created several features! I want separate word (which were separated by comma in a attribute), in different attributes (one word by attribute) with the same number of featuresThanks ! 

120
L
L
lachichi_farah
asked in Transformers
How can I have the name of features (polygons) which intersect a feature (polygon) in an attribute

I would like to have overlaps of the features by creating attribute with all the names of the other features which overlaps. I used AreaOverAreaLayer but It's not what I'm looking for. With this transformer, I only had the number of overlap.Moreover, with this transformer, if a feature (polygon) is overlaped at two different location of this polygon, it creates me 2 features different, but I want an only feature for a polygon. A feature by polygon. Thank you !

1770
L

Badge Winners

  • Student (Grey)
    lenabaghhas earned the badge Student (Grey)
  • Welcome Back
    lenabaghhas earned the badge Welcome Back
  • Welcome Back
    dcoxhas earned the badge Welcome Back
  • Welcome Back
    mglimsdalhas earned the badge Welcome Back
  • Webinar Watcher (Ruby)
    bchadhas earned the badge Webinar Watcher (Ruby)
Show all badges

Community Stats

31,808
Posts
120,814
Replies
39,430
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.