Skip to main content
  • EN

Transformers

Using transformers to modify data.

  • 10,000 Posts
  • 52,721 Replies
10000 Posts
sam_appleton
Contributor
sam_appletonContributor
asked in Transformers
Upload entire folder from local PC to Flow Shared resources, via server app

Hi, Is it possible to upload an entire folder from a local PC to Flow Shared resources, via server/automation app? I know that single files are able to be uploaded, but I was hoping my workflow would go like this: User uploads file via web app. It is stored in Shared resourcesSeparate workbench uses a Path reader on the file, gets all .shp files and performs ETLI can't see any other way to do it, other than the user having to upload 20 different shape files via the app interface. I get this warning when using FME copy writer, with s published parameter of 'filecopy_source_dataset':File Copy Writer: Feature contains an invalid source dataset 'C:\\Users\\myuser\\Documents\\Development\\FME\\UPLOADFOLDER'. No file operations will be performed for this feature Many thanks, Sam

490
hkingsbury
Celebrity
sami26beniaouf
Contributor
sami26beniaoufContributor
asked in Transformers
Drap a 2D surface or polygone on a 3d Surface

Hello everyone,Is there a way to drap a 2d surface or polygone into a 3d surface (like in the picture joined). If there is in which format do we need the surface and polygone to be? Thank you in advance

350
kailinatsafe
Safer
aron
Supporter
aronSupporter
asked in Transformers
Write to 'Primary Key' and 'geometry_column' in a Dynamic PostgisWriter?

I am using a SchemaScanner to prepare a dataset for dynamic writing to a PostGISWriter. How do I write to the columns for PrimaryKey and Geometry in an dynamic environment?

751
nielsgerrits
VIP
S
sophieko
asked in Transformers
Hi, I have an issue about the RasterPolygonCoercer transfrormer.

I want to turn my vector layer into a raster layer and then back into a vector layer to simplify it. When I used NumericRasterizer, I grouped my layer by category, but when I convert it back to a vector layer, it's not working. When I tried to rasterize it without grouping it, it worked fine, but I lost the attribute I was interested in.

90
S
A
arnoldatk
asked in Transformers
GDB Annotation to DWG Text, lots of labels missing

UPDATE: Managed to figure out what went wrong in my comment below the main post (TLDR: Used the wrong transformer and field value from my dataset) Hi, so I'm trying to convert my annotation layer in my GDB files along side the point, polygon and line layers into DWG. In my screenshot of my ArcGIS Pro instance, you can see the various labels above my polygons.But it looks like only 2 of them passed through to DWG when converted through Workbench.In my current workspace I'm using a LayerTypeField field in the attribute table of all of my layers I wish to converted to sort them into the correct flows (Points, Polygon, Lines, Annotation).Those values are exposed via an AttributeExposer parameter as you can see here:The annotation layers are very basic ones that are created from running Convert Label To Annotations within ArcGIS Pro itself and an additional field added that just contains "Annotation" as text for filtering purposes in Workbench (LayerTypeField).  At this ju

660
A
dewrightco
Contributor
dewrightcoContributor
asked in Transformers
Find the nearest line segment to a point with a couple common attributes?

I have a point array of addresses, and a line geometry layer of streets, and I need to be able to get the ID of the nearest line to the point that also has a couple matching attributes. What are the best options to consider?

330
nielsgerrits
VIP
kschultz
Participant
kschultzParticipant
asked in Transformers
Directory And File Pathnames reader does not read the file properties anymore? Is there a better way to do this or am I missing something?

Under path parameters for the reader it no longer has "retrieve file properties" which means I can't access the create date of files breaking one my workbenches. I tried using the filepropertyextractor transformer but its just too slow for the amount of files I need to read. Is there a way to fix this?

1510
kschultz
Participant
M
mrr
asked in Transformers
How to remove collinear point's in polygon

Hi everybody! I have tried to remove collinear points without sucess. For example, a square(polygon) but between two vertex I have one or more collinear point's. So how to remove this???

1940
C
soly
Contributor
solyContributor
asked in Transformers
Zigzag remover (Python error )

Hello,it is first time ,I use zigzag transformer but I got error .python caller failed to process feature .how could I fix it ?i have used spike remover for the same input lines data and it works great without problem .which transformer is better (spike or zigzag) ?which angle that should I use from your experience ?thanks in advance FME 2021

90
danilo_fme
Evangelist
lynne
Contributor
lynneContributor
asked in Transformers
Locate Features Along Route - points on linear features

I have a bunch of points that fall on or near a linear features (routes/roads). Is there a way to use the Locate Features Along Route tool in FME to identify which route those points fall on?

1250
danilo_fme
Evangelist
soly
Contributor
solyContributor
asked in Transformers
What is the best tolerance value for anchored snapper segment type

Hello ,i would like to know ,what is the best tolerance value that use in anchored snapper (segment type ) to avoid any problems i have used 0.02 , automatic .it works well for some lines but it make problems for some lines when they are so close or cross eachother .The segment type of anchored snapper make lines to be intersected instead of cross lines . which value that people has experience with segment type always use without any problems ? is there any alternative for anchored snapper segment type that do the same purpose fme 2021 

460
hkingsbury
Celebrity
tim_bkr
Participant
tim_bkrParticipant
asked in Transformers
Replacing repetive strings

I have string attributes which contain repetitions of the type ";;;". How to get rid of these, however numerous the ";" are. I also want to nullify the attribute if it ends up being ";" but that can be done with a trimmer afterwards. I also would like to delete other repetitions.Examples"31;31;44" should become "31;44""*3*;*3*;*4*" or "*3*;*4*;*3*" should become "*3*;*4*" "#TH#;#BAT#;#TH#;#BAT#" should become "#TH#;#BAT#"

84
timotheebecker
Contributor
kelin84
Contributor
kelin84Contributor
asked in Transformers
Read XML from URL updated from variables

Hi, I hope someone can help:I have an XML URL.The URL is updated from my reader with different variables. I go through the AttributeManager to stitch together the different URL's I need to go through.I input that result into the FeatureReader When I go the the FeatureReaders parameters and choose elements to match, I see this:If I take the URL the FeatureReader receives as an input and paste it into a browser, it worksIf I take the working URL and hardcode the value directly into the AttributeManager, without any variables, the FeatureReader gives me the same errorIf I paste the working URL directly into the dataset within the feature reader I get access to the parameters and can set the Elements to Match, but that won't make it updateable from the features coming in.To me it seems like I can't use an attribute with the URL as a dataset on an XML URL in the FeatureReader. Does anyone know how to use an attribute calculated from the input data to get the information out of a

650
nielsgerrits
VIP
P
peters
asked in Transformers
Flatten API response body into features. How do I go about this response? It's quite different.

Hello, I have a response from one of the APIs I'm using that is formatted as the following example:{ "measurements": { "timestamps": [ 1504377563, 1504378166, 1504378372 ], "waterGround_mm": [ -5032, -5030, -5031 ], "waterNAP_mm": [ -7532, -7530, -7531 ], "validity": [ null, null, 1 ] }}Now, I can flatten this using FME to the following lists:_timestamps{0}: 1504377563_timestamps{1}: 1504378166_timestamps{2}: 1504378372_waterGround_mm{0}: -5032_waterGround_mm{1}: -5030_waterGround_mm{2}: -5031_waterNAP_mm{0}: -7532_waterNAP_mm{1}: -7530_waterNAP_mm{2}: -7531_validity{0}: <null>_validity{1}: <null>_validity{2}: 1Now my idea would be to rename these lists somehow to _list{}.measurement, _list{}.waterGround_mm and so on, and then use the ListExploder to explode _list{} to features. Sadly I can't find a way to properly rename _measurement{} to _list{}.measurement. Also, just trying to explode _measurements{} takes a long time with 30.000 records. Is this the proper way to go ab

190
david_r
Celebrity
peteratqfes
Contributor
peteratqfesContributor
asked in Transformers
S3Connector and the Cache-Control Header Bug?

Is it possible to set the Cache-Control header using the S3Connector? When I set Cache-Control in the Metadata it changes it to x-amz-meta-cache-control, which supposedly doesn't influence cache control on client requests. My Content-Type metadata changes are working. Is that a bug or expected behaviour? Via Cloudberry   

90
peteratqfes
Contributor
A
anik
asked in Transformers
How can I have a workspace reader to only read writer information.

I current have a workspace reader that reads all of fmw files in a selected folder and use the WriterFeatureTypes to find all names writers in each fmw file being read.But when I run it, it produces errors and warning messages that aren't relevant to the writer (screenshot below).Since I only wish to know the names of the layers that the writers in each fmw file writes to, is there a way to avoid reading other information about the file such as the transformers to remove getting these errors/warnings and improve the runtime?

160
A
M
mutzhdom
asked in Transformers
Cannot Read part of the german/bavarian lod-2 building model (citygml-file) that i have previously read successfully. Error is : "unable to open <https://www.w3.org/MarkUp/DTD/xhtml-datatypes-1.mod>"

The data lod-2 is available for public download from the servers of the bavarian Opengeodata platform at: <https://geodaten.bayern.de/opengeodata/OpenDataDetail.html?pn=lod2> here is the direct link to a 2x2 km square that is downloaded as citygml: <https://download1.bayernwolke.de/a/lod2/citygml/704_5322.gml> I have a whole workflow for processing that data, which stopped working without any changes to the workspace. Then i realized that i can not even read the data into a brand new workspace with the same basic error message being shown:'http://repository.gdi-de.org/schemas/adv/citygml/1.0/cityGMLBaseLoD2.xsd' mapped to 'C:\\Users\\mutzh\\AppData\\Local\\Temp\\FME_XSD_CACHE\\fmexsd_1696954419928_14896.xml'Parsing schema document 'C:\\Users\\mutzh\\AppData\\Local\\Temp\\FME_XSD_CACHE\\fmexsd_1696954419928_14896.xml' ...XML Parser error: 'Error at file: 'http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd' line: 126 column: 22 message: unable t

100
M
arash_hokm
Contributor
arash_hokmContributor
asked in Transformers
Add a specific text as header and footer of text file

Hello FME Community, I am using a 'StringConcatenator' and a 'Text Writer' to create a text file. I intend to add two separate texts as the header and footer.  Is there a way to add these texts without duplication? 

670
arash_hokm
Contributor
ivanvdn94
Contributor
ivanvdn94Contributor
asked in Transformers
Creating a perpendicular line through a point and clipping it within a Polygon using FME 2019.2.3

Hey everyone. I have 3 road datasets I am working with. One point, one line and one polygon. I need to join these three datasets. The point data is set so that each point is about 100m from one another. I can manage to merge all the data but now I need to create a perpendicular line through my points to create segments of my road data.

2020
havmoejbv
Contributor
havmoejbv
Contributor
havmoejbvContributor
asked in Transformers
Parsing points and lines from text file coordinate lists

I have some data in text files that may contain both points and lines. Each line contains a code and either a sub-code or a coordinate set: 05 1          2302     6826513.392   548235.740  257.374            05 31         2302     6826704.339   548284.671  275.511            09 91 05 1          2302     6826513.392   548235.740  257.374            05 2          2302     6826518.762   548233.548  257.950            05 3          2302     6826525.326   548234.694  258.184            05 4          2302     6826532.691   548235.254  258.606            09 99The first column is the first code, '05' is always followed by a coordinate, '09' is always followed by a sub-code: '09 91' defines start of a line, '09 99' defines end of a line. So the short example above contains two points and a polyline with four vertices. Any suggestions on how I can turn this text file into two points and a polyline?I have a python script that can handle the parsing, but I was wondering if there is a better way to

530
havmoejbv
Contributor
tiztrain
Contributor
tiztrainContributor
asked in Transformers
WMS not displaying in FME Desktop, loads fine in ArcGIS Pro.

I am trying to add the following WMS in FME Desktop:http://gis.rijeka.hr/geoserver/At/wms?service=WMS&version=1.1.0&request=%20GetCapabilities&srs=EPSG:3765&format=image%2Fpng I have no problems loading this map service in ArcGIS Pro but can't seem to get it to load in FME Workbench or Data Inspector. The WMS contains two layers, I have tried adding them individually as well. Not sure what I am doing wrong. Any assistance here would be great.

1830
rohan02
W
wbarker
asked in Transformers
Is it possible to select distinct from a csv file into an SQL table?

I want to read from a csv file and put the contents in an SQL database table. The issue is that there are duplicate lines in the CSV file, so I want to select distinct into the SQL table to remove duplicate rows. Is there a slick way to do this, or do I need to read the csv into a temporary SQL Table holding the duplicates, and re-read the data out of that table using perform sql executor transform into its final destination? .

5614
rohan02
A
arnoldatk
asked in Transformers
GDB Points to AutoCAD Blocks

FINAL UPDATETurns out the problem was that the hatch fill in my block is incompatible with colors for some reason. Having a standalone circle for a block was ok. What I ended up doing was typing • via Text and then saving that as a block and now my CAD looks like a proper point layer.  2nd UpdateI added my template file to my writer parameters and I am now able to generate blocks for my individual points, but I can't seem to get the colors from my attributes to stick to my blocks.UPDATE This is my current workflow, but it still doesn't seem to produce a cad file with data inside all.  **Original Post below**I have a point layer in an Esri GDB file I'm using workbench to convert to DWG AutoCAD data while maintaining color data. I have no issues with lines and polygonal layers but my understanding is that CAD uses blocks while Esri uses points. I tried a direct conversion where I just had a reader with my GDB and a writer with my DWG and the end result was a file with the poi

1340
A
A
andreagalligari
asked in Transformers
AttributeRenamer failing in Removing Output Attribute and maintaining original Attribute sorting from Excel schema

I'm reading a feature layer from ArcGIS Online containing about 20 layers into FME, each one with proper domains and field aliases. Unfortunately, it is not possible to: first, resolve domains without including only code output attributes, and second, there is no option to "resolve" Attribute names using aliases. I'm then trying to find a time-efficient way to solve this by using AttributeRenamer. I'm currently importing an Excel schema that contains only two columns for Input and Output Attribute and the list of attributes I want to keep from the reader output. In the Import Wizard, I deselect "Sorted" (img 1) to keep the original order of attributes and then I set the "If Input Attribute Is Missing" to "Remove Output Attribute" (img 2). What I'm experiencing is that imported attributes from the schema are still alphabetically sorted despite the "Sorted" box being deselected (img 4) and second, when I run the transform

80
A
G
generationn00b
asked in Transformers
Reading from WMS image - How to maintain a consistent height and width of image with varying bounding boxes without stretching the image..

I have a workspace that inputs property polygons and bounding boxes from an oracle database and it feeds into a WMS feature reader to obtain a raster image. It then overlays property boundary as a redline on top of the image. How do I maintain constant height and width of the image without stretching it? The WMS I am reading from does not have scale hint, nor does it have scale denominator in its implementation.

430
daveatsafe
Safer

Badge Winners

  • FME Form Basic Training
    kundalayhas earned the badge FME Form Basic Training
  • FME Form Basic Training
    chaotixhas earned the badge FME Form Basic Training
  • Welcome Back
    hpodzunhas earned the badge Welcome Back
  • FME Form Basic Training
    simont.hlnughas earned the badge FME Form Basic Training
  • FME Form Advanced Training
    dezuviriamhas earned the badge FME Form Advanced Training
Show all badges

Community Stats

31,820
Posts
120,854
Replies
39,449
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.