Using transformers to modify data.
Recently active
I had a workspace with 13 user parameters. When renaming them all, I accidentally erased one's identifier, and it duplicated it and the new one is bugged. When I try to save, the workspace crashes. After publishing it on the server, trying to run it shows not a single user parameter. I can not delete it, and it is linked to every single transformer of the workspace (copy pasting any transformer from the bugged workspace to a new one imports the bugged user parameter and therefore corrupts the workspace).
Hello,I have previously in Form 2023 added custom paths in the “Edit Data Download Properties → Include Data from Writers” when preparing to upload to Flow.The issue I now have in Form 2024.1 is that after I have published the workspace to Flow or if I reopen the workspace my custom paths are not saved within the workspace, or if it’s saved to Flow as it was in Form 2023. This makes the Republish option button not useful as I can see as I have to rewrite the custom paths. Or have I might missed something? To be clear I belive this only counts for custom paths and the benifit with custom paths is that I can customize how files are organised within the .zipped file from the Data download service.
Hi, this must be easy but can't seem to find it...I want to convert duration from seconds to hours, minutes, seconds. So 337759 seconds should be 93h49m19s.I thought the DateTimeConverter should help me, but can't seem to get it right:results in 21h49m19s...I could calculate it myself, but I guess I'm overlooking a setting in this transformer?
After deleting some files using the os.remove instruction within a PythonCaller the translation ends successfully but it gives these errorsWorker 215652 > Failed to apply the constraints feature to the readerWorker 215652 > Failed to apply the constraints feature to the readerWorker 215652 > Failed to apply the constraints feature to the readerWorker 215652 > Failed to apply the constraints feature to the readerWorker 215652 > Failed to read features from dataset 'C:/Users/LOCA1A~1/Temp/225/wb-cache-CLMS_Download_20240607_DESKTOP_2-igKtLc/LEGACY_DuplicateFilter_2 2 194 fo 0 UNIQUE 2 7b50d2c16b579db61a32ffc86b48776319f4311b.ffs' using the 'FFS' readerI have searched the web for the origin of the error but I can't find anything that makes senseI would greatly appreciate any help
Hello,I have several lines in my data base which are self overlapping. On the the picture you see the vertices and the order when drawn. Vertices 3 and 4 have been drawn before vertex 5 which makes the line self-overlapping or self-intersecting. How can I detect lines in my database which have that kind of problem ? I tried the geometry validator but I noticed that it detects only some of them. So it is not fully reliable in my case. Is there any other transformer ? I thought maybe of calculating the bearing as the change of direction could indicate that problem as well. Thanks for your help. (btw I don’t want any transformer to automatically correct them, I only want to detect them)
This is either going to be a very stupid question or a very silly bug.I want to check if MyUserParameter has a value, so I put a Creator and a Tester on my canvas checking whether MyUserParameter does have a value. It tells me it doesn’t, whilst it clearly does! Hmm, what’s going on?Am I being dumb? Why can I not test a User Parameter?I can get it by using a ParameterFetcher, so it’s not a big issue.We recently upgraded from v2023.1 to 2024.1, and I thought this used to work, but I could well be mistaken.EDIT: It does work if I check if MyUserParameter is of type string or when using RegEx. It sounds like the ‘has a value’ and ‘is null / missing / empty’ doesn’t work with user parameters.
I have several rasters with varying Z values and thousands of parcels. I’d like to extract the lowest z value from multiple rasters by parcel. Any help is appreciated!
Hi,The below python code works in ArcGIS Pro:But returns the below error in FME:What would be the ‘FeatureProcessor’ python symbol?Regards
I am writing a workflow that refreshes data within a hosted AGOL feature service.To enable continuity of service, I have 2 hosted feature services for the same layer. eg. Playgrounds_A and Playgrounds_B. There is a view defined called Playgrounds_View whose source is either Playgrounds_A or Playgrounds_B My workspace plan is to refresh the contents of the ‘non-active’ feature service, and then set the Playgrounds_View to point to it.I have managed this previously with Python for ArcGIS scripts using commands like item.add_relationship() and item.delete_relationship()How can I recreate this functionality in FME workbench ?
HiI would like to extract some info from a website that are inside a p tag inside a div class = paragraphs_item__body_paragraph_bundlethe website is https://www.padovanet.it/notizia/20221025/strade-chiuse See picture belowthx for support Francesco
I have a very basic dynamic workbench that is reading data from SQL Server. Before writing data to a postgis database it is changing an attriubte name with SubstringExtractor. But it is extremely slow doing so after almost 3 hours 150 000 objects has been read by the reader. Typically 100 000’s of objects is handled in matters of minutes. It is reading about 25 different feature classes I need to migrate daily.I cant wait hours for the workbench to be complete. 2024-09-27 15:11:02|6056.7| 0.8|INFORM|Reading source feature # 470002024-09-27 15:11:53|6106.9| 50.2|INFORM|Reading source feature # 47500It takes 50 seconds to read 500 features? What is wrong? Why is the process so slow? I cannot understand where the bottle neck is.
Hi! I’m new to FME. I’m trying to replace an existing feature class with data from a SQL query. I got it to work by using a Reader that specifies the existing table, SQLCreator then a Writer. When I add the writer, it’s using the “Copy from reader” option. Is there a way to use the FeatureWriter transformer and specify an existing feature class instead of using a Writer?
Hello,For the logged known issue in FME Form “FMEENGINE-82549” with “Excel Writer: Field Names row not written” the solution described is to Set the Row Height to 0 on the Feature Type, as discussed here. But what are the steps to do that? Is it to simply just use transformer “ExcelStyler” and use setttings for “apply style to”? Thanks!
Hello everyoneI need to run a test process that reads a file in netCDF format and clips it using a Clipper. I am using a shapefile for clipping, but the Clipper is giving me the following error:Clipper_<Rejected> (TeeFactory): Clipper_<Rejected>: Termination Message: 'Clipper output a <Rejected> feature. To continue translation when features are rejected, change 'Workspace Parameters' > Translation > 'Rejected Feature Handling' to 'Continue Translation'' Here is an example of the process I'm trying to test.I want to write two output files, one in NetCDF format and the other in Geotiff format.Afterwards, I need to open one of the result files and the original netCDF file in QGIS to check the values.The goal of this test is to verify why, in another process, the clipped result is altering some values related to the original global input file (netCDF). Thank you in advance for any assistance you can provide.
I have data stored in a SQL server database in a native geomtry type format. I would need to migrate this data to a postgis database and store the data using simple geometry (point, lines and polygons instead of the generic geometry datatype).I have seen options how to modify the destination schema. But it does not include how i can specify the geomety type. https://support.safe.com/hc/en-us/articles/25407537293069-Dynamic-Workflows-Destination-Schema-is-Derived-from-a-Schema-FeatureMy data is stored as geometry but it is known and expected that specific tables will polygon or lines. Is there a somewhat simple way to do this without creating the destination tables beforehand?
Reading the documentation and online search regarding this transformer - ArcGISOnlineConnector I have some questions. The Actions are pretty self-explanatory and it seems possible to both upload and download data from AGOL. However that does not seem to be the case. I can list every Group and item. However when I try to Download it just says: cannot download file of type 'Web Scene'cannot download file of type 'Scene Service'cannot download file of type 'Feature Service'cannot download file of type 'WMS'cannot download file of type 'Geocoding Service' I was hoping to download a Geopackage or something else. Is there anything that CAN be downloade? Any other usage areas for this Transformer?
Hello,We have an excel file with different first lines.For this reason, we have defined the featurereader in the excel file, which allows us to have the column names in A, B, C ... and not the column name with the values of the first line.This works very well, but as soon as we put a parameter in the dataset (instead of a hard-coded directory path), we lose the A, B, C field names and can't use them generically.do you think there's a solution for keeping column names in A, B, C?Best regards
Hello fellow FME form users,I had a script which worked in FME 2022.2, but not in FME 2023.2. I then get the following error:<WMTS> An error occurred while generating the GetTile URL, please check the dataset URL and selected parameters Another weird thing is when I make a fme workspace app based on this fme script, then I don't get the error at all and I manage to get results. It's just not clear to mer why the script doesn work in fme workbench 2023.2I have checked the following parameter to yes: “Prefer Dataset to URL” This is our curernt fme form build:FME(R) 2023.2.0.0 (20231201 - Build 23764 - WIN64) and this is our curernt fme flow build:FME Flow 2023.2.1Build 23774 - win64I have attached the workspace, so that others can also test with my workspace.
Hello FME Community,In order to retrieve the list of fields from Shapefiles, I am currently using the following workflow: SchemaScanner => ListExploder => AttributeManager(Name).csv.My objective is to perform this process on a set of Shapefiles contained in a folder and output the CSV files into another folder while keeping their original filenames.However, I encountered some issues with this setup:Filename Issues: I am having trouble preserving the original filename for each output CSV file. The current workflow doesn't seem to carry over the original Shapefile name correctly. AttributeManager: I'm using AttributeManager to manage field names, but I'm unsure if I'm configuring it correctly for this task. It doesn't seem to handle the filename dynamically.Do you have any suggestions or solutions to address these issues?
Hello,my challenge may have already been solved, or it may be difficult for me. Maybe I'm just missing something:i have a line dataset and a point dataset. the points are measurement points of the lines. in our convention, a line has 2 measurement points, an arc has three measurement points and splines have at least 4. there is no attributive connection between the two datasets. the measurement points are identical to the corresponding veritces of the lines 3D.the line represents the upper edge of the sidewalk and i derive the lower edge of the sidewalk (street level) from a point cloud. due to the point cloud, the lines jump at the vertices in height along the line. i want to interpolate the line and have so far fed the 3D interpolator with the start and end point of the line and let it interpolate the line. so far so good.but now i want the lines to be interpolated not only at the start and end points, but always exactly at the vertices at which a measuring point from the point data
Hi, I do some requests over an api to get some features.As result I have some attributes for each feature. One of them is containing the coordinates (lat,lon)Something like this:52.2413243,10.5215958,52.2411936,10.5215612,52.2410751,10.5215738,52.2409598,10.5215146...Is there a simple way to use the geometry attribute with structure lat,lon,lat,lon… and convert these values to vertices? I assume I have to use vertexcreator? But I do not want to define all nodes separate. Does someone know a smart way to do this in fme ? Thanks in advance
I have 2 datasets within my workspace and wish to append the contents from one into the other. Will need to map fields as they are not named the same. (or can do an attributerenamer step beforehand. ) No join clause is required, it’s just a simple append.What are the recommended steps?
Hello, I’m using the LandXML writer to export a surface. However, FME creates two Parcels, in addition to the surface (that i created based on a point cloud). These Parcels cause problems when trying to import the surface into some software. Civil 3D works fine, since it support Parcels, but for other software it does not work. Is there a way to NOT create parcels when exporting the LandXML?
Hi, I'm using the latest FME desktop workbench version FME(R) 2022.2.0.0 (20221103 - Build 22765 - WIN64)) to convert IFC to GIS. For some IFCs files the workbench failed at the last step to write to the geodatabase, then the workbench gets terminated. The error is Internal error running translation Postcondition: Expression: FME_SUCCESS == badLuckI'm wondering what it means? thank you. Full error log attached below:Feature output statistics for `GEODATABASE_FILE' writer using keyword `IFC_Process::IFC_Process_FeatureWriter_0': =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Features Written =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- DP_320ELGE00__GCLR_DC_320BDAR02_MD3_0001 13 ============================================================================== Total Features Written 13 =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Inte
Hi I am trying to use the XMLTemplater with a SUB template. The start of the ROOT expression looks like this (from an existing xml file that it valid)When I run the workspace I get this message. Does anyone know what the syntax error is and how to correct it?