Using transformers to modify data.
Recently active
I use a XSD Driven XML Writer to compose a XML file. Afterwards I read the file and send it with the HttpCaller to a SOAP Endpoint of some application.Is is possible to skip the "Save to File" "Read from File" part and directly write into a XML attribute of some feature?
Hi, do you know what the problem could be? I have a backup of the MS database, which I load into FME and write to the postgres DB with Postgres writer, but I have no data in postgres. Maybe a datatype? But FME reports no errors. Thank you
I am using the aggregator transformer to take multi part polygons across NI, grouped by Local Government District, so when the data is displayed and selected on a map the records in one district will be selected as a multi part. I want to keep all unique identifiers and addresses for the records, as well as other attributes. I have currently got all the attributes to remain by using the assemble hierarchy section in the transformer using LGD as parent id and unique id as the id, but the group by doesn't seem to be working as the records are being selected as individuals polygons, not multiparts.
How do I set a xml element to xsi:nil=true in a XSD Driven XML Writer?I tried to set with "name.nil" xml_boolean. No luck. I changed the type from xml_boolean to xml_char. No luck.I created a feature_type for <name> element and set the attribute via a "nil" attribute. No luck. The output shall look like this: <aixm:name xsi:nil="true" nilReason="inapplicable"/>nilReason works without problems.
Dear all , It's a hollow PIPE , I want to extract XYZ for each a) centre point (c1)b) face centre point (v1&v2) + face INNER vertex point (vf1&vf2)c) radius (e.g. distance from v2 to vf2)d) total length (e.g distance from v1 to v2) thank you for kind support
I have different gdbs at different level in a folder.In each gdb there is the same dataset. I want to merge (usually with a junction) the similar datasets from the gdbs (all dataset has the same structure). But I not sure of what reader should I use:I use a reader with feature Type Name as "any schema".And Reader "PATH\\**\\*.gdb" Then I put a FeatureReader , but I cannot get attributes from all the dataset. Any Help will be appreciate.
Hello everyone,I am having random timeouts on FMEServer when i am trying to connect to a PostgreSQL database (using FeatureReader/FeatureWriter) or when i am trying to realize a simple get/post with HTTPCaller. The timeouts seems to happen randomly, mostly when there are multiple simultaneous jobs.The HTTPCaller timeout is partially solved by activating the option "Retry Failed Requests", but sometimes the maximum value of "Maximum Retry Attemps" (10) is not enough (i.e. the timeout is still there after 10 retries). For the FeatureReader/FeatureWriter there is no retry option available.A similar problem was found here It seems that i have an unstable connection to my postgres db, sometimes it will read from it and other times I get this error message: (safe.com) but there is no hints to the source or solution of this error.Some details:FME Server 2022 Build 22792 with 5 enginesUsing Linux (RHEL 8.7) with dockerThanks in advance
Hello All,British National Grid Long/Lat (OSGB 36) [EPSG: 4277] seems to be missing from FME's suite of coordinate systems - or am I mistaken? I have a table with Longitude and Latitude data in this projection and I want to create points from them, and then convert them to British National Grid (Meters) (OSGB 36) [EPSG: 27700]. I can try to use the Reprojector transformer, but I can't see EPSG: 4277 anywhere.Is there anything which I could use instead? Or is there another solution such as creating a custom coordinate system?Many thanks,Jane
Dear All, I have the following setting : I've created a User parameter of type "choice" where the user can tick which attributes he wants to keep and send to the Writer (column1, column2, column3, etc.). With the MultiChoiceParamSplitter followed by a ListExploder, I can get a table where the attribute "_choice_param_values" holds the attribute names the user has selected (e.g. column1, column3), but how can I use it then in the AttributeKeeper (or any other transformer that would do the job) ? I've tried to pass the table as input with "_choice_param_values" as Attributes to Keep but it does not work at all... Or maybe, from the outset, I didn't tackle the issue from the right angle and you have suggestions about how I could I achieve what I want in a totally different way around ? Any ideas are welcome, as I've run out... NB : I've seen the (seemlingly related) post below but it did not solve my issue.Having trouble passing user pa
I have a batch file (.bat) that I need to run. What Transformers would I need to use to get this to run using a workspace in FME Desktop?
Please can you tell me how i do this?
I need to do a transformation, like pivot table, using Python, and for that I would need to install libraries, like "pandas"... How can I install custom libraries to FME Python ? I created a environment with Anaconda, installed pandas there, but now, how to use that environment in my PythonCaller?
I am trying to mosaic 228 ECW tiles into one uniform image using RasterMosaicer transformer. The individual tiles are quite large as the 228 individual tiles together are 15GB. I am finding the process using RasterMosaicer extremely slow and is taking close to 24 hrs to complete using FME desktop. Just wondering what the best method is to mosaic these tiles and have a resulting image equal to the size of the individual input tiles, 15GB...or less.
I'm having trouble removing buffer segments correctly when generating a buffer around a line dataset with roads.Input data (road lines with road name and city): When buffering this, I end up with:This method has a lot of overlap that i'm not able to process properly. Is there a way to buffer it like this or process the _overlap >= 2 in a way that this is the result:I tried the areaonareaoverlay and correct the overlap afterwards but did not get the desired result.
When using a FeatureReader to read CSV file, one can manually select in the "Parameters" section which attributes we want to read from the file. Very short question : does something equivalent exist for reading only a selection of attributes in a reader that loads "Esri ArcGIS Portal Feature Service" data ? Thanks in advance
Dear All, I am facing the following very weird issue. I want to test for several attributes if, for each of them, there are some features that contain a specific value.To do that, I have created a Custom Transformer that takes as input 2 user parameters (defined exactly in the same way, published and required) : 1) colname = the name of the attribute ; 2) progname = the value to test if the feature is equals to. When I go back in the Main, right-click on the custom transformer > Properties, in the prompt I can see well the 2 user parameters (colname, progname). But when I click on "Run to this" custom transformer, the prompt only asks for 1 of the 2 parameters (always 'progname', even if I switch the order of the parameters in the parameter manager of the custom transformer). In the Translation log, I see that the following command line is run :fme.exe myscript.fmwThis results in translation failure with the error message :Undefined macro `progname' dereferenced in file [...]When I
I'm trying to write data to a csv. I have a uniqe identifier that has two leading zeros. When writing to a csv file the zeros are removed. When viewing the feature information window the attribute has a string value. When doing the same in the written csv it says 64 unsigned integer even though I have set it to string in the writer parameters. What am I doing wrong? Making sure FME writes it as a string will keep the leading zeros right?
I am trying to get from a table like this example:to this table:I have searched for answers but can't fully seem to get where I need to be- including trying variations of attribute transposer, attribute exploder, attribute exposer, and attribute pivot (this helped me get closer to the answer but didn't allow for text..). Any advice would be much appreciated!
Hello FME community, I am currently working on a deep learning project that involves preparing training samples for building polygons. I have the building polygons in an OGC GeoPackage file with Coord.System EPSG: 26916, as shown in following screenshot: Additionally, I have the PNG aerial images for the same area without projection, which means every aerial image X,Y starts from the upper left (0,-0) and ends at the lower right (2000,-2000) as shown in following screenshot: I need to have the polygons of the training sample in pixel coordinates for each corresponding image. The output should be a CSV file that includes the vertices of every polygon in pixel coordinates as shown in following screenshot: I have attached the datasets for better understanding.Does anyone have any ideas or potential solutions?
How can I convert a Multicurve geometry type to multiline geometry type?
Hi everyone, I have DWG files drawn in local coordinates and I need to transform them to shapefiles in a national projected coordinate system. This is currently done with Spatial Adjustment (Transformation - Similarity) as the links file (.txt) provided has two displacement links: -1000 -1000 "Destination X Value" "Destination Y Value"1000 1000 "Destination X Value" "Destination Y Value" p.s. I've just replaced actual numbers by "Destination X Value" etc. What would be the best way to replicate this process with FME? If it is Affiner how do I utilise the values from the links file? Thanks in advance!
I have a process I need to run on point clouds. In short, I tile them, sort the tiles, and remerge the tiles back into a single cloud. This is for compatibility reasons with a piece of software that doesn't like clouds that are not well-sorted spatially. The workspace is fairly simple; input, tiler, sorter. pointcloudcombiner, output. It works well and does what I want when run on a single input cloud. However, I need to run it in bulk on large numbers of clouds. And performance suffers. I realized this was because it was tiling every input cloud before sorting them and assigning them back to the combined clouds, so I added Group Bys. Then I changed the group bys to "Process when group changes" to keep the data moving. But each step holds another set of data "in process" when set that way. So instead of only keeping one cloud in memory at a time, it keeps 3. If I create a custom transformer of my steps and copy it as many times as I have input clouds, ea
Hello everyone, I'm a beginner in FME and need some help. I'm trying to join (1:1) data from our datalake with an existing GIS layer. My goal is to append the result of this join nightly to another existing layer. I've attempted to use SQLExecutor to query multiple tables in the datalake and DatabaseJoiner to join the query table with the GIS layer, but it doesn't seem to be working. Any suggestions or advice would be greatly appreciated. Thank you!
Dear All, Here is my issue with the FindString() function : I have the following string stored in user parameter value_to_test = "101,102" ; the attribute "ProgNum" contains values that range from 100-900 and I want to set a new attribute "FoundNum" to be = "true" when "ProgNum" is one the (comma-separated) values of value_to_test. As FindString(string,strToFind) should return the index in string that matches strToFind , I've tried the following expression :@FindString($(value_to_test),@Value(ProgNum))I have also tried the FindStringRegularExpression@FindRegularExpression($(value_to_test),@Value(ProgNum))None of the them is working ! Quite despaired I've also tried to revert $(value_to_test) and @Value(ProgNum) in the function call, but it does not work better... Does anyone have an explanation what it is not working and what I am doing wrong ?? Thanks in advance NB : I know that I could work with AttributeSplitter etc. but I would like to know why the FindString and FindRegularExpress
Hi, I have two datasets. Both are polygons. Dataset 1 is the area of a city minus a few areas within that are not relevant for this project. Dataset 2 contains houses as polygons. My goal is to create a third dataset of polygons of random size. The polygons have to be inside of the polygons of Dataset 1, rectangular (preferably not just squared), and within a random distance to the houses. Does anyone know a way to solve this?