- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Transformers

Transformers

Using transformers to modify data.

12,725 Posts
50,915 Replies

When you subscribe we will email you when there is a new topic in this category

12725 Posts

Most replies

Most views

Newest first

pabloolivaresmSupporter

asked in Transformers

Hi, im trying to replicate some SQL querys from old database in Access. The actual database is in PostGIS. The problem is there a first query, and the second one is making a join from first one's results.

The firs one query is And the second one is Then I need to do a join with this second query and create a list with the results.I dont know if with the SQL Executor transformer I can replicate this two querys. Any idea? Thanks

130

1 year ago

dpenland

asked in Transformers

Help using a parameter in the text editor to make calculations based on user input.

Long time listener, first time caller.Newish to FME and was attempting to use a user parameter for the first time to allow the user to input the number of days they need to pull data. I have the parameter and the initial formula working fine. DaysPulled is my user parameter: @DateTimeFormat(@DateTimeAdd(@DateTimeNow(),-P$(DaysPulled)D),%Y%m%d) The problem I'm running into is later on in the flow I need to use that user input and add a number to it, effectively turning the user parameter into DaysPulled +1 and DaysPulled+2. I've been beating my head against the wall trying to modify DatePulled using add, sum, +1, etc and can't find the right format to get what I need. Example of failed attempt.@DateTimeFormat(@DateTimeAdd(@DateTimeNow(),-P@add(1,$(DaysPulled))D),%Y%m%d) Can anyone point me towards a solution?

280

1 year ago

zacharylee1204

asked in Transformers

How do I create "points" and import to 3ds max

Hello Sir/ Madam, So I have a .txt file with Points Name, X, Y, Z. So I would like to create points and import in 3ds Max. My .txt table is as follow Point X Y ZA 822041.761 833958.234 13.519B 821997.708 833954.943 16.341 I create points by using vertex creator transformer. Then I convert to .dxf and import to 3ds Max. It works fine. However, all the points are named "Point" in 3ds Max. Is there anyway that I can use the Point name "A", "B", etc instead of point? Other formats is fine, as long as I can get the coordinates and point name. Hope somebody can give me a hand. Thank you.

330

1 year ago

gattogisContributor

asked in Transformers

How to download and save multiple DTM zip files from CSV with URLs. Need help with settings for extracting individual files

418

1 year ago

pwilkebrownContributor

asked in Transformers

ESRI FeatureServer [ArcGISFeatures] Reader Fails to read some layers

I have a workspace in FME Workbench 2022.2 that reads an ESRI ArcGIS Server Feature Service containing 7 layers. It successfully reads all 7 layers and transforms them to the appropriate feature types. That same workspace in FME Form 2023.1.1.1 is able to read in the number of features for all 7 layers but only able to successfully read in the features for 3 of the 7 layers. On the 4 layers that fail it appears to be failing after the first batch of 1000 records are requested. As a test I created a new project with only the FeatureServer reader in FME Form 2023.1.1.1, again same problem. As another test I tried using the MapServer endpoint for the service rather than the FeatureServer endpoint that failed on the 4 layers. This successfully read in all 7 layers.ArcGIS Feature Service Reader: Got 4222 results for layer/table ID 0ArcGIS Feature Service Reader: Splitting reading of 4222 features into 5 batches of up to 1000 featuresArcGIS Feature Service Reader: Getting feature results 0

410

1 year ago

masonb12Contributor

asked in Transformers

I can read an arcgis online feature service and then write to a new sqlserver table. But the new table has no field called unique ID as the primary key. The error is "the layer does not have identity properties".

I created a primary key using SSMS for the new table but I still get the error the layer does not have identity properties.

100

1 year ago

mowhite87

asked in Transformers

I sometimes have to read from multiple readers. Is it possible to set the maximum features to read to ALL feature types? Not just all per reader? Related, is it possible to set the Search Envelop for ALL readers?

1 year ago

galigisEnthusiast

asked in Transformers

Iterate through individual GDBs and Merge FCs with same name

Hi All, I'm trying to create a workflow that iterates through a folder which contains individual GDBs (e.g. 20 individual GDBs) and then merges the Feature Classes with the same name into a new blank GDB.Any idea how to make that happen?Thanks 🙂

202

1 year ago

cw_

asked in Transformers

Assign z coordinates to polyline verteces from underlying points

Hi, I have 2 data sets (shape-files). A point dataset with 3d-points or at least points where the elevation is stored in an attribute field (different data quality) and a polyline dataset with 2d-lines whose vertices are identical to the points from the point dataset. Is there a way to assign the elevations from the point datasets to the line vertices and then create 3d polylines from them? Thanks for your help

150

1 year ago

dcam

asked in Transformers

Using String Functions in the TestFilter

I have a very simple workspace that just tests whether a string has a “.” Or a “:’ in it and if it does then these characters are deleted. I am using the Testfilter to test for the characters, and then a stringreplacer to delete them and then I must make sure the string is all caps. Is there a way to do these three operations by using the String Functions in the Testfilter? I haven’t been able to figure out how the string functions work. Also, will using the string functions speed up the translation? I have 47 million records to test and right now it takes 4 hours to run. I am using FME2018. I have included the workspace and source CSV file. Thanks.

26914

1 year ago

esalmagul

asked in Transformers

In the writers, under user attributes we can see the table with name, type, of data, width., etc. Is there a way to copy/pate or export this table in csv? I am tasked with data type for multiple outputs, and it would be great not to do so manually.

1 year ago

crb66

asked in Transformers

Cannot Manage Automations as 'fmesuperuser' and 'fmeadmin'

We are attempting to use the Automations > Manage Automations as a built-in user, but when browsing to that page it is blank and there are no automations in the popup list. We've made the user a member of 'fmeadmin' and 'fmesuperuser' but it makes no difference. So far only the 'admin' account is able to Manage Automations.What are the minimum permissions required for users to make this work?

1 year ago

jrlalessiContributor

asked in Transformers

Convert ESRI Feature Class with single feature to geoJSON MultiPolygon

I have a feature class with a single feature that I need to convert to a multipolygon type geoJson file. I'm not super familiar with geoJSON, and I'm being told this is a hard requirement. How does one create a multipolygon geoJSON file from a single feature?

200

1 year ago

mattbooker2

asked in Transformers

Reading features from Excel with unknown schema

I have FeatureReader transformers within my workspace that are configured to read features from an Excel file. The name and path of the Excel file are variables provided by parameter values, but the Excel sheet name is always the same. The schema of the file is likely to vary every time the workspace is run. I'm really struggling to get any features to read in, and am a bit unsure of where I'm going wrong. From similar posts in the past (eg; https://community.safe.com/s/question/0D54Q000080hdRJSAY/how-to-expose-attributes-from-featurereader-if-feature-type-is-dynamic) it seems that what I'm trying to do potentially isn't possible without scripting something bespoke in a PythonCaller, but it really seems like something that FME should be able to do. Does anyone have any advice or a working methodology for this sort of problem? Thanks in advance

540

1 year ago

csj5483

asked in Transformers

I have two tab files and while joining them I get this error for one of the row ERROR |FeatureJoiner (FeatureJoinerFactory): The UTF-16LE string 'DOÃƑÂ±A ANA-HILL' could not be converted to the encoding: windows-1252.

180

1 year ago

juliarozemaContributor

asked in Transformers

SQLExecutor - Incorrect Syntax - Trying to Disable Trigger on SQL DB

Hello,I have a SQLExecutor connecting to my SDE on a SQL database. I am using the Microsoft SQL Server Non-Spatial Format with an embedded Connection. My SQL Statement is:FME_SQL_DELIMITER ; GO DISABLE TRIGGER gisowner.SEGME_MSLINK_COUNTER ON gisowner.[a10]; GOI get the following errors:Query failed, possibly due to a malformed statement.Provider error `(-2147217900) Incorrect syntax near the keyword 'TRIGGER'.'A fatal error has occurred. Check the logfile above for detailsFailed to read features from dataset 'AHS_GIS' using the 'MSSQL_ADO' reader

563

1 year ago

jugoslaviaaSupporter

asked in Transformers

Why are my polygon holes filled while writing to GDB?

I have a gdb with polygons ( multipolygons). I read polygons and simply write to a new gdb and my polygons holes are filled? It happens also while reading Isee. As if there is a geometry validation happening. How can I stop this? It is really annoying.

160

1 year ago

aaronm2800

asked in Transformers

Help with syntax when using Tester transformer

Hi, I need some help setting a basic test with the tester transformer. I'm trying to fail rows from a feature if they match any values in a csv file I've added as a reader. I'm having some issues getting things configured correctly. So something like NOT @Value(field) Contains <Right value>. But I can't seem to connect the right value. Connecting the csv as an input isn't what I want, but I cant figure out the syntax to use in conjunction with '$(SourceDataset_CSV2)'. Sorry for this basic question but I couldn't figure this out looking at the documentation. Thank you.

350

1 year ago

jopie

asked in Transformers

Compare two datasets. Both pointdata with (x,y). the second dataset has got adresses. Result must be a dataset where an objects in the first dataset is nearest tot an adress in the second dataset .

The first dataset has 10500 objects ( a table with x,y id, date,etc. etc.)The second dataset 7000 object s )(a table with x,y,id ,,date, adress etc.etc.)Based on the x and y we would like to get a combined file as a result.Where all 10,000 objects from the first dataset are located at the closest object to an address point.A list of these.. It seemed logical to us to use the transformer neighbor finder for this. But this doesn't work. ideas more than welcome Johan

160

1 year ago

louisboekhoudtContributor

asked in Transformers

Hi, I need to bring some correction to a CSV file. The picture on top shows the rows (highlighted) that need correction. The one in the bottom shows the row in corrected form. Would this be possible in FME workbench 2023.1? In my case several ti

1 year ago

deanhowellEnthusiast

asked in Transformers

Symbolise Layers in HTML Report Generator / HTML Layouter

I have a map that has 5 layers in it and want to have them all displayed using different symbology in the HTML Layouter but I can only define a single colour for the layer.Is it possible to generate HTML output with a little more cartographic input for each incoming layer?

843

1 year ago

mickd

asked in Transformers

Error reading DGN files from Projectwise

Hi. I have a workspace that is using the Micostation DGN (v8) reader that's reading files from a Projectwise URL collection. It's currently reading four dgn files successfully however when trying to add other I'm getting an error message. Failed to obtain any schemas from reader 'IGDS' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more informationWorkspace generation failed. Parameter file was C:\\Users\\{USER}\\AppData\\Local\\Temp\\FME_1701131211957_17128 I've tried opening the files in a clean workspace and even rebooted my machine to rule that out. The same message persists. Within the reader I'm "Grouping Elements By Scheme - Level Names"and selecting "Preserved Names Cell Insert Points". I also assign a coordinate system to the dataset. Are there any suggestions about how I can overcome this, or will I need to go and have a chat

480

1 year ago

jake

asked in Transformers

SFTP File download "Failed Initialisation"

Hi, I know this has been partially answered here but it doesn't quite answer my exact issue.I'm trying to use FTPCaller to download a file from an SFTP site but get the error 'Failed Initialisation'. FME will create the target file fine but with no data in it, and with the above error.I have tested FTPCaller on other SFTP sites and it works fine. I can download the file using Filezilla and I can also get the file download to work using the SystemCaller transformer to run a batch file which runs PuTTY (using a PSCP comand line). All with the same credentials.All file permissions appear to be setup fine and I've tried changing every parameter in the FTPCaller with the exception of SSH-agent/Pageant authentication. Having already got it to run with PuTTY I didn't see any advantage to going down this route.I'd really like to be able to do this directly with FME and not involve a third party package such as Pageant or PuTTY. Is this possible?Thanks in advance,J

1080

1 year ago

kbraun77Contributor

asked in Transformers

When you import data into a choice user parameter, is it always a static list? If you import from POSTGRES and that table updates, I'm assuming that the import won't change?

1 year ago

brian3734

asked in Transformers

FeatureReader unable to connect to AGOL when using a user parameter to set the feature service

Hi everyone, I'm trying to set up a model that will allow the user to select from a list of feature services to read from. I've got a Choice user parameter set up but whenever I try to run the workspace I get this error:I'm very confused since the service connection is working just fine and the feature reader will read in normally when I directly reference a specific service. Help a noob out?Thanks, Brian

130

1 year ago

Page 39 / 509

Badge winners

f9xpfvpbwohas earned the badge Expert (Grey)
f9xpfvpbwohas earned the badge Teacher (Grey)
f9xpfvpbwohas earned the badge Student (Grey)
gopalseahas earned the badge Expert (Grey)
gopalseahas earned the badge Teacher (Grey)

Show all badges

30,477: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.