Using transformers to modify data.
Recently active
The system integrate data from ArcGis API Services(source) to Microsoft SQL Spatial DB(target). When the api side have new row of data, i want to check if the data that is already pulled to DB is already existing using let say object_id field. I cannot use upsert at the writer since the flow is that we do not the want any change of pulled data since it will need to go through manual approval for any data changes. How to insert new row of data only without updating existing data?
Hello,I have a Navisworks 3D file of our facility that needs to be viewed in ArcGIS Pro and published as a 3D Scene. We exported it out to a fbx for City Engine which is then exported to a scene layer package to be viewed in ArcPro and this “works”, but we have a only layer with zero attribution. Is there a way I can either use the original Navisworks file or the fbx to break out the all the features withing the facility and create an output as a multipatch gdb? sorry for my noobnessthanks in advance.-C
If yes please may i request you to share me demo workbench ? If NO, is there a workaround to convert Navisworks files to IFC format ? Any suggestion / idea / workbench is more than highly appreciated forever . I also request FME experts who even have little know-how please requested is your little for any leads . thank you / Br
I am having 100 individual text files consist of Point feature..So..........At a time, How could i convert each files into KML files respectively?
To reproject WGS84 (Lat/Long) to GDA2020 (Easting/Northing) in FME v2024.1, the only option appears to be via GDA94. This moves the data approx. 1.8m NE as it assumes that WGS84=GDA94 and GDA94+1.8m = GDA2020.While this is usually what people use, there is a need for a second option of WGS84=GDA2020 (ie a Null transformation + Geographic to Grid) as other software packages, such as Conquest have adopted this. For more information see: https://www.spatial.nsw.gov.au/__data/assets/pdf_file/0008/224396/WGS84_and_Australias_misaligned_web-maps_Information_Sheet.pdf. Is this something that FME will be implementing anytime soon?
I'm still a newbe to FME considering below.I'm trying to query open data from the Dutch https://public.ep-online.nl/api/v4/Mutatiebestand/DownloadInfo?fileType=csv (API-key required, available from https://epbdwebservices.rvo.nl/) to get the data from a csv-file. HttpCaller works, url obtained with JSONFragmenter (attributes to expose: 'downloadUrl’)+testfilter (to get the actual url). However, I can't seem to use this url in an FeatureReader or further HTTPCaller to actually get the data itself from the csv-file. Copying the url (contains a token valid only one time) does download the file from a browser as a zip-file, but how can this be done in FME?I tried to look at https://public.ep-online.nl/swagger/index.html but couldn't make anything out of it due to lack of technical knowhow. Any ideas? Setup as of now: FeatureReader tried below (the response_body solely contains the url):Also tried '@Value(_response_body)[*.csv]’ for parameter dataset, but also to no avail. Another try with
I have read through this post to try to get a fix but it doesn’t address the issue i am having.The work flow is…use a Directory and pathname reader to get a list of zip file in a specific folder. sort by path created date sample the first 1 feed the path widows to the reader (esri geodatabase reader or featurereader [preferred]) I am trying to capture the feature datasets within the gdbI have gone to the parameters of the fgdb featurereader and exposed the geodb_feature_dataset format attribute as well as the fme feature type.I have also gone into the generic port and exposed the same. it does not show up as an attribute. i also have used an attributeexposer after and it is not possible to expose it because it is not there.If i change the reader to read *.gd this featuredataset still is not exposed in the featurereader.The only method i have had success with is to set the Output Port to One per Feature Type. This is not optimal as any transformer i want to use will have to be done on e
Hi there, Anyone could help? I would like to build a FME workbench to run a multiplication for all the value if they are belongs to the same name. Attached a sample data e.g. I want to get the multiplication for armstrong_2006( 42*10*39*26), then I want the result to be added back in this spreadsheet. thanks.
Hi all,I would like to run FME Desktop automatically. After seeing some posts, the only method that I have found is using FME Server, however, I have not understood how it exactly works. Could anyone please help? Is there any other way?Many Thanks
Hi, I have a workspace that i want to compare timestamps between two rows in a database based on some matching information.i’m using an sql extractor to pull the pertinent information, which spits out something like this: IMAP TIME SUBJECT DATETue Aug 20 02:42:25 EDT 2024 XXXXXXX_#6337.4 8/20/2024Tue Aug 20 02:42:52 EDT 2024 XXXXXXX_#6337.4 8/20/2024Tue Aug 20 04:06:13 EDT 2024 XXXXXXX_#704.0 8/20/2024Tue Aug 20 04:06:41 EDT 2024 XXXXXXX_#704.0 8/20/2024Tue Aug 20 05:33:15 EDT 2024 XXXXXXX_#7274.2 8/20/2024Tue Aug 20 05:33:47 EDT 2024 XXXXXXX_#7274.2 8/20/2024I’m then using a StringSearcher to extract the time with the regex \d+:\d+:\d+ and this gives me the time in essentially a %H:%M:%S format:Extracted original IMAP (for comparison)02:42:25 Tue Aug 20 02:42:25 EDT 202402:42:52 Tue Aug 20 02:42:52 EDT 202404:06:13 Tue Aug 20 04:06:13 EDT 202404:06:41 Tue Aug 20 04:06:41 EDT 2024
Hello, I'm trying to use AffineWarper to transform 3D data (x,y,z) from a local coordinate system to a national coordinate system. This works well, but unfortunately the z coordinates are not changed. They retain the heights of the local system. Does the transformer only work in 2D?The offsetter doesn't help me here because the difference between the z-values is not the same for all coordinate pairs.Please help. Thank you.
Doing a query on a List named “LayerAttributes” worked in FME 2022 but doesn’t work in FME 2024. Any suggestions on how to work around this issue?In FME(R) 2022.2.3.0 (20230131 - Build 22789 - WIN64) I was able to query the list and get results. Here is a cutdown example where the query Value(LayerAttributes{@sum(@Value(LayerNameID),1)}) gives me the same results as LayerAttributes{7} However, in FME(R) 2024.1.1.0 (20240729 - Build 24619 - WIN64) the same query doesn’t work. @Value(LayerAttributes{@sum(@Value(LayerNameID),1)}) gives me <missing> and LayerAttributes{@sum(@Value(LayerNameID),1)} give me LayerAttributes{7}
I am new to FME. I have a geojson file with an array of features - for example under functionalClass i have 6 different modes of transport and under category I have 5 different types of roads. I want to create a new geojson file but using an existing geopackage (with only the attribute field called roadName as a value) but I need the new geojson file to have the same array of features as the first one. What would be the best way to create this? I have consider the feature readers and writers, JsonTemplater and JsonFormatter. But I am a bit lost on where to start or what transformer is the best to use in this case? Or is there an easy way to extract the arrays in FME so I can build csv files and just map them using an attributemapper transformer? Thank you for your time.
I have a dataset with attributes where in two columns the start and end of a range (postalcode)is it possible to duplicate the attributes with the missing postalcodes?example:range tels me: from 7595AM to 7595APthere are 2 postalcodes missing. 7595AN and 7595AO.from this attribute i would like to duplicate it to 4 attributes for each of the seperate postalcodes. thanx in advance. i am using FME Form 2024.1
Hello everyone,At the moment I am doing a conversion from BGT to NLCS (Dutch cad standard)I have an excel file (bgt to nlcs conversion) which has the corresponding color, line weight and linestyle names that I need for the conversion to NLCS.I have created a seedfile and via the Line style editor in Microstation 2023 I imported the rsc files that I needed in the seedfile.In fme, I don't use the dgnstyler, but I just defined the following attributes in the Attibutemanager:igds_style_nameigds_colorigds_weightIn the Level manager in the seed file, I haven't defined the levelname and the corresponding style yet, since it would be too much work for me. So based on Fme I just hope to give elements their corresponding color, lineweight and style. Color and weight has been succesfully (see below for snapshot of the output in the data inspector), only igds_style_name not yet. I haven’t used igds_style, since I don't know the number and I have the igds_style_name available in the excel file, so
We are in the process of building a new FME workspace that is using the FTPCaller transformer to upload a file to a remote SFTP server. To ensure we are compliant with our internal security standards around cryptography, I am looking into SSH protocol versions and cryptographic algorithms in use by the FTPCaller transformer.My questions are:Which versions of the SSH protocol does the FTPCaller support? I know from connecting to a local SSH-2-only SSH server that it supports SSH-2, but does it also support SSH-1? (I hope not!) Is there any way of configuring the cryptographic algorithms used by the FTPCaller? Or, as an alternative, listing the supported/enabled algorithms?Thank you,Jonathan
Hi Im reading an API with health data that updates every week. The goal is to aumomatize the process so FME reads this API every week to take out the new data. Now this API has an attribute called “temporal” which has values like this: “2024-W30” or “2020-W10” which is just the year and the calendar week. The data goes back several years and each week the last week gets added.I only want to use the latest data each week so what I need is somekind of a filter that looks at the attribute “temporal” and only takes the data from the current year with the highest numbered week which corresponds to the data that got added last week. Any suggestions on how I could do this? Thanks in advance
I know this question have been asked few years back but unable to find its answer in the same thread today. I am using FTPCaller to download files from a remote SFTP server, I got logging in cridentials from the SFTP server admin and my computer is allowed to login to the SFTP server; which means there is no problem with connection and previledges. But FTPCallers responds with failed Initialization! any suggestion? Thank you!
I have a lot of polygons that represent buildings and I want to rasterise them but before I do I need all the polygons to be parallel to the horizon. I need to create a tool that calculates the polygon angles and then use these angles to rotate the buildings accordingly.
Good day,I am using a JSON-Templater.My Root Template looks like this:{"GisData": {"Lake" : [fme:process-features("LAKE")], "River" : [fme:process-features("RIVER")], "Park : [fme:process-features("PARK")] } }and in the Sub Template I have one port for the Lake, one for the River and one for the Park.In some cases I don’t have lakes for the JSON I want to create. So the JSON will look like this: "Lake": [], This is not useful and will create issues later on. How can I specify that I only want to add them to the JSON if they have a value ?
Hi,the AttributeTrimmer transformer does no longer trim correctly after updating from transformer version 3 to version 4.In my workspace I use the AttributeTrimmer to strip whitespaces from attributes. This used to work as intended and as described in documentation. It stripped all whitespace characters from the attributes, regardless how many there are. Recently I upgraded this transformer from version 3 to version 4. The new version works differently after that. Now it strips only 1 whitespace. When there are more of them at the beginning or end of the attribute the rest of them is left untouched (i.e. if there were 3 whitespaces at the end of a string entering the transformer, the result still has 2 whitespaces at the end).This seems to be not working as intended and described in documentation and should be changed in a future version. I use this transformer a lot to clean up attributes for comparison.Can someone else confirm this problem?Kind regards,Andras
Hi all,I’d like to use a FeatureReader transformer to read in an ArcGIS Feature Server and then have a user specify which specific Feature Service they would like to process. The Feature Server has ~15 services whose names I have added into a parameter. I added the parameter to the “Feature Types to Read” option, but can’t get the tool to successfully read in the service that I specify. I attached a screencap of how I have things set up so far...does anyone know how I can accomplish this? I think I’m close and might just be missing something small.
I’ve imported a topographic map that is in GeoPDF format. I want to convert to GeoTIFF. I see advice posted to put an ImageRasterizer between the reader and writer. My question is how to set up the ImageRasterizer “rows and columns” data. Where do I get this data? ThanksBill
I’m having a workspace with some connections to files that are on sharepoint. I did create the correct setup with the web connections to have a sharepoint account with client & tenant id etc in it. workspace works fine at my side, but the account that was provided is an account that has access to a lot off stuff.When I want to share the workspace with production so that they can run it, they also need to have the webconnection present in their workbench to get it to work (otherwise sharepoint online connector turns red etc).With this they can actually access more files than what is stricly needed (even though my workspace is password protected, nothing stops them from using that account for fetching different files) and this may lead to security issues.Although using a account with limited access to files on sharepoint would also help, I’m wondering if there is a different way to access files from sharepoint? I’m comparing it a bit with database connections:Connections are convenie
Hello, i am looking for a transformer that changes all objects of a dgn or a gdb by a certain amount in their z-value.Please help. Thank you.