Using transformers to modify data.
Recently active
This is either going to be a very stupid question or a very silly bug.I want to check if MyUserParameter has a value, so I put a Creator and a Tester on my canvas checking whether MyUserParameter does have a value. It tells me it doesn’t, whilst it clearly does! Hmm, what’s going on?Am I being dumb? Why can I not test a User Parameter?I can get it by using a ParameterFetcher, so it’s not a big issue.We recently upgraded from v2023.1 to 2024.1, and I thought this used to work, but I could well be mistaken.EDIT: It does work if I check if MyUserParameter is of type string or when using RegEx. It sounds like the ‘has a value’ and ‘is null / missing / empty’ doesn’t work with user parameters.
I have several rasters with varying Z values and thousands of parcels. I’d like to extract the lowest z value from multiple rasters by parcel. Any help is appreciated!
Hi,The below python code works in ArcGIS Pro:But returns the below error in FME:What would be the ‘FeatureProcessor’ python symbol?Regards
I am writing a workflow that refreshes data within a hosted AGOL feature service.To enable continuity of service, I have 2 hosted feature services for the same layer. eg. Playgrounds_A and Playgrounds_B. There is a view defined called Playgrounds_View whose source is either Playgrounds_A or Playgrounds_B My workspace plan is to refresh the contents of the ‘non-active’ feature service, and then set the Playgrounds_View to point to it.I have managed this previously with Python for ArcGIS scripts using commands like item.add_relationship() and item.delete_relationship()How can I recreate this functionality in FME workbench ?
HiI would like to extract some info from a website that are inside a p tag inside a div class = paragraphs_item__body_paragraph_bundlethe website is https://www.padovanet.it/notizia/20221025/strade-chiuse See picture belowthx for support Francesco
I have a very basic dynamic workbench that is reading data from SQL Server. Before writing data to a postgis database it is changing an attriubte name with SubstringExtractor. But it is extremely slow doing so after almost 3 hours 150 000 objects has been read by the reader. Typically 100 000’s of objects is handled in matters of minutes. It is reading about 25 different feature classes I need to migrate daily.I cant wait hours for the workbench to be complete. 2024-09-27 15:11:02|6056.7| 0.8|INFORM|Reading source feature # 470002024-09-27 15:11:53|6106.9| 50.2|INFORM|Reading source feature # 47500It takes 50 seconds to read 500 features? What is wrong? Why is the process so slow? I cannot understand where the bottle neck is.
Hi! I’m new to FME. I’m trying to replace an existing feature class with data from a SQL query. I got it to work by using a Reader that specifies the existing table, SQLCreator then a Writer. When I add the writer, it’s using the “Copy from reader” option. Is there a way to use the FeatureWriter transformer and specify an existing feature class instead of using a Writer?
Hello,For the logged known issue in FME Form “FMEENGINE-82549” with “Excel Writer: Field Names row not written” the solution described is to Set the Row Height to 0 on the Feature Type, as discussed here. But what are the steps to do that? Is it to simply just use transformer “ExcelStyler” and use setttings for “apply style to”? Thanks!
Hello everyoneI need to run a test process that reads a file in netCDF format and clips it using a Clipper. I am using a shapefile for clipping, but the Clipper is giving me the following error:Clipper_<Rejected> (TeeFactory): Clipper_<Rejected>: Termination Message: 'Clipper output a <Rejected> feature. To continue translation when features are rejected, change 'Workspace Parameters' > Translation > 'Rejected Feature Handling' to 'Continue Translation'' Here is an example of the process I'm trying to test.I want to write two output files, one in NetCDF format and the other in Geotiff format.Afterwards, I need to open one of the result files and the original netCDF file in QGIS to check the values.The goal of this test is to verify why, in another process, the clipped result is altering some values related to the original global input file (netCDF). Thank you in advance for any assistance you can provide.
I have data stored in a SQL server database in a native geomtry type format. I would need to migrate this data to a postgis database and store the data using simple geometry (point, lines and polygons instead of the generic geometry datatype).I have seen options how to modify the destination schema. But it does not include how i can specify the geomety type. https://support.safe.com/hc/en-us/articles/25407537293069-Dynamic-Workflows-Destination-Schema-is-Derived-from-a-Schema-FeatureMy data is stored as geometry but it is known and expected that specific tables will polygon or lines. Is there a somewhat simple way to do this without creating the destination tables beforehand?
Reading the documentation and online search regarding this transformer - ArcGISOnlineConnector I have some questions. The Actions are pretty self-explanatory and it seems possible to both upload and download data from AGOL. However that does not seem to be the case. I can list every Group and item. However when I try to Download it just says: cannot download file of type 'Web Scene'cannot download file of type 'Scene Service'cannot download file of type 'Feature Service'cannot download file of type 'WMS'cannot download file of type 'Geocoding Service' I was hoping to download a Geopackage or something else. Is there anything that CAN be downloade? Any other usage areas for this Transformer?
Hello,We have an excel file with different first lines.For this reason, we have defined the featurereader in the excel file, which allows us to have the column names in A, B, C ... and not the column name with the values of the first line.This works very well, but as soon as we put a parameter in the dataset (instead of a hard-coded directory path), we lose the A, B, C field names and can't use them generically.do you think there's a solution for keeping column names in A, B, C?Best regards
Hello fellow FME form users,I had a script which worked in FME 2022.2, but not in FME 2023.2. I then get the following error:<WMTS> An error occurred while generating the GetTile URL, please check the dataset URL and selected parameters Another weird thing is when I make a fme workspace app based on this fme script, then I don't get the error at all and I manage to get results. It's just not clear to mer why the script doesn work in fme workbench 2023.2I have checked the following parameter to yes: “Prefer Dataset to URL” This is our curernt fme form build:FME(R) 2023.2.0.0 (20231201 - Build 23764 - WIN64) and this is our curernt fme flow build:FME Flow 2023.2.1Build 23774 - win64I have attached the workspace, so that others can also test with my workspace.
Hello FME Community,In order to retrieve the list of fields from Shapefiles, I am currently using the following workflow: SchemaScanner => ListExploder => AttributeManager(Name).csv.My objective is to perform this process on a set of Shapefiles contained in a folder and output the CSV files into another folder while keeping their original filenames.However, I encountered some issues with this setup:Filename Issues: I am having trouble preserving the original filename for each output CSV file. The current workflow doesn't seem to carry over the original Shapefile name correctly. AttributeManager: I'm using AttributeManager to manage field names, but I'm unsure if I'm configuring it correctly for this task. It doesn't seem to handle the filename dynamically.Do you have any suggestions or solutions to address these issues?
Hello,my challenge may have already been solved, or it may be difficult for me. Maybe I'm just missing something:i have a line dataset and a point dataset. the points are measurement points of the lines. in our convention, a line has 2 measurement points, an arc has three measurement points and splines have at least 4. there is no attributive connection between the two datasets. the measurement points are identical to the corresponding veritces of the lines 3D.the line represents the upper edge of the sidewalk and i derive the lower edge of the sidewalk (street level) from a point cloud. due to the point cloud, the lines jump at the vertices in height along the line. i want to interpolate the line and have so far fed the 3D interpolator with the start and end point of the line and let it interpolate the line. so far so good.but now i want the lines to be interpolated not only at the start and end points, but always exactly at the vertices at which a measuring point from the point data
Hi, I do some requests over an api to get some features.As result I have some attributes for each feature. One of them is containing the coordinates (lat,lon)Something like this:52.2413243,10.5215958,52.2411936,10.5215612,52.2410751,10.5215738,52.2409598,10.5215146...Is there a simple way to use the geometry attribute with structure lat,lon,lat,lon… and convert these values to vertices? I assume I have to use vertexcreator? But I do not want to define all nodes separate. Does someone know a smart way to do this in fme ? Thanks in advance
I have 2 datasets within my workspace and wish to append the contents from one into the other. Will need to map fields as they are not named the same. (or can do an attributerenamer step beforehand. ) No join clause is required, it’s just a simple append.What are the recommended steps?
Hello, I’m using the LandXML writer to export a surface. However, FME creates two Parcels, in addition to the surface (that i created based on a point cloud). These Parcels cause problems when trying to import the surface into some software. Civil 3D works fine, since it support Parcels, but for other software it does not work. Is there a way to NOT create parcels when exporting the LandXML?
Hi, I'm using the latest FME desktop workbench version FME(R) 2022.2.0.0 (20221103 - Build 22765 - WIN64)) to convert IFC to GIS. For some IFCs files the workbench failed at the last step to write to the geodatabase, then the workbench gets terminated. The error is Internal error running translation Postcondition: Expression: FME_SUCCESS == badLuckI'm wondering what it means? thank you. Full error log attached below:Feature output statistics for `GEODATABASE_FILE' writer using keyword `IFC_Process::IFC_Process_FeatureWriter_0': =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Features Written =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- DP_320ELGE00__GCLR_DC_320BDAR02_MD3_0001 13 ============================================================================== Total Features Written 13 =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Inte
Hi I am trying to use the XMLTemplater with a SUB template. The start of the ROOT expression looks like this (from an existing xml file that it valid)When I run the workspace I get this message. Does anyone know what the syntax error is and how to correct it?
Hi,I’ve tried a few times to do this over the years but I haven’t been successful. What I want to do is convert a set of cubemap images into on equirectangular panorama. Kind of like this:I know there are a lot of free python solutions of Github, but I haven’t been able to get any of them to successfully work. I’m not particularly good a python and I don’t want to install any script packages. I’d prefer to do this entirely within FME as I am already loading in the images.Would anyone know a solution?
Hello ,I am running workbench with caches .to check the result of each transformer . I have main custom transformer includes many custom transformers .when I make any changes inside the custom transformer so I have to run the main custom transformer to see the results of changes for the inside custom transformers .but it takes long time and I have each time to wait when I make small changes inside it .Could I run the transformers or custom transformers inside the main custom transformer without running the main custom transformer for each time ? if possible ,How ? thanks in advance Fme 2021
I have been given a .JSON file to try and convert into an output Esri File Geodatabase format. I have managed to flatten the nested JSON values into attributes, and can view these ok. However, I am having a real issue trying to get my workbench to read the coordinate values that make up the polygon geometry objects. If someone could assist that would be much appreciated. I have attached a file, but stripped it back just to include the line containing the coordinate information for one polygon. Thanks, R
I use a workspace that reads a list of data sources in an Excel file. The data sources are either a gml file, in url format or not, or wfs urls. The workspace reads the data and converts and merges it into one filegdb.In total, the workspace processes approx. 50,000 features. Nevertheless, the following error message often occurs: HTTP transfer error: 'Failure when receiving data from the peer' when reading (with a FeatureReader) the WFS sources. See also the discussion in: problem-wfs-query-5215.Findings (including those based on) this last discussion:Increasing Timeout values or limiting the maximum number of features to be read does not seem to have any effect. Another suggestion to read the GetFeature request via a browser resulted in the expected XML content for most services, but for the wfs that gives the HTTP transfer error, in an image with only coordinates and attribute values in text format. It can take a while for the browser (Chrome in this case) to convert the read v
Hello, Hope I am posting thing in the correct area! I have an FME workbench that takes a series of inputs, overlays them and sends them to point feature on our AGOL server. This process worked until yesterday when all of a sudden I keep getting an error message saying that it cannot find the REST service.“ArcGIS Online Feature Service Writer: Could not find a layer/table matching feature type 'Utility Side _ Customer Side'”What is weird is that I have a reader for the exact same service that can see and read the service the writer cannot seem to find.