A space to discuss FME Form
Recently active
Hello everyone,For one year, I’ve been running different workbenches daily (Windows Scheduler), reading from MSSQL tables to write into various hosted feature layers, used in various dashboards. I noticed an unusual consumption of the storage on our GIS server, coming from the “pgdata” folder of Arcgis Entreprise, so the underlying postgresql database (up to 20go additional Gb per month, while the size of all my hosted features stay constant at around 1gb only in total). After several tehnical sessions with ESRI, there is no doubts that this is caused by my FME workflows. Those workbenches are far to be optimised (as I was only starting to use FME) but they are working fine. It was easy to truncate all features to insert new features, sometimes up to 150 000 features daily, for one layer (see below, simplified version). The inserted features are polygons, from the same source hosted feature layer, daily joined with most recent MSSQL data. NB: Objectid is removed with “attribute manager
Hi!I want to add an attribute to geometry - is this done with the geometrypropertysetter?For instance, add ‘water asset’ to a cylinder but not as a layer name rather as an data tag / table.I ultimately want to be able to bulk add them however am starting with a simple test case.Thanks.
We have a customer who would like to read data directly from Microsoft Dynamics AX 2012 R2 with FME. Has anyone done that if so how to do it? I haven’t been able to find anything related to this.
Hello , i have too many points I would like to find the points and lines between start of path and end of path in different paths ?i would like to have excel file that include First row Start point (a) - next point (b)- lines (line id 1)Second row From b point - next point C - lines (line id 2 )and so on till end point (blue point )fllow direction from start point to end point as picture fme 2021 thanks in advance
I have followed this tutorial:Updating ArcGIS Online Feature Services using UPSERT (safe.com)As the last screenshot shows, I have 1495 records. Comparing the original CSV used to do the initial data load and the updated CSV, the new records in the updated CSV have not been added and existing records with changed attributes have not been updated.The tutorial suggests this is possible using the UPSERT operation. Example update I expected with the highlighted text the changed attribute value: 1000,ZYX3116631180,-123.093432,49.281221,31180,-53.7761,-21.7304,1,2011-12-02 22:01 Example add I expected: 9000,ABC1069610710,-123.093414,49.281637,10710,-79.377,-17.3218,1,2021-12-06 1:41
Since updating our server to the newest version of FME Flow, the "Browse Resources" button is broken on workspace apps. Users can only upload their own temporary files. Uploading files is a functional workaround, but it is much slower than selecting a file from the network drive mounted on the server. I have verified that both my user account and the app have permission on the resource. For the app I have given List and View permissions to the folder. Any recommendations?
I have a complex workflow using multiple Workspaces. Each reads and/or writes temporal operational data to CSV’s.My question is, when do you use a Reader/Writer as opposed to a FeatureReader/FeatureWriter?I’ve settled on using FeatureReaders/FeatureWriters though I’m not sure if make much difference.I understand the Feature* transformers are geared towards mid-workflow use where you have input and output.Thanks in advance.
Hello guys,I want to know about 2 questions:1. Is the license attached to the HDD or MB?2. Can it be upgraded from HDD to SSD? Thank you so much
I am creating a workbench where I will bring spatial object assets from an oracle database into a file geodatabase. I want to sort the assets into feature datasets as I go but I am confused as to how to go about this. I have only done a few FME workbenches so I don’t have a great deal of experience. So far, when I have been creating File Geodatabases, I add a Esri Geodatabase (Open API) writer and then the file geodatabase is created and any features I connect to that writer are added in. So its kind of a two for one where the file geodatabase is created plus my features are converted and added to it. How would I go about creating a feature dataset during this process? Is it possible with FME 2018 or does that come with newer versions. We will not be upgrading for several months and my co-op term will be over by that time. Thank you!
We are trying to use GoogleDriveConnector to update a folder within a shared folder on Google Drive. Unfortunately, when uploading the folder to the shared folder, it creates another folder with the same name as the one we’re need to update. We’d preferably like to overwrite this folder, or delete the Google folder before uploading, or something.There is a delete in GoogleDriveConnector but you have to have the exact Google id for that folder, which will change each time the FME is run. So we can’t automate weekly since we won’t know what the id will be each time.If neither of those options are possible (overwrite or delete), is it possible to upload to Google with a new name for the folder (like with a timestamp) so that we all know which is the most updated? (We can manually clean it out after that if need be.) This is less preferable, but right now I’m looking for any solution that may help our needs.Thanks!
Hi fellow FME enthousiasts,Another case i'm struggling with today.I have a list of parcels that need to be added into a Excel template. In most cases I can sort the parcels by parcelnumber and concatenate them grouped by the Section number and write them to the Excel.But the field in the template can fit a maximum of 5 parcel numbers. So if there are more then 5 parcels they need to be split in groups of 5. So say i have a file with 13 parcels, I would need to split them into 3 groups (2 of 5 parcels and 1 of 3 parcels). I can get the number of parcels with a StatisticsCalculator, but i struggle with the part where i have to split them into groups to write to the Excel. How would you do this? Cheers!
Hi, I use parallel (//) processing in other workspaces successfully but this is the first time with a Clipper. The tips offered in article: FME Parallel Processing: Tips and tricks for generating groups | Safe Software do not seem to apply, or at least I think they don’t. I am trying to clip an OBJ of ~12720000 triangles with ~93K polygons of diiferent sizes. The OBJ has no attributes, just geometry. 1st try: link the same modcount (4 groups) to both Candidate and Clipper inputs of custom xformer containing only a Clipper. The data passess through it without any clipping. The Clipper inside is set as “multiple clippers”; Clippers do not arrive first; Reject only parts, merge-clipper, and the rest is set with defaults.2nd try: cloning the OBJ as explained in article but it slow and eventually crashs as it runs out of memory. I sort of expected it but tried it anyway. I don’t see how I can use the tiling method here. Am I missing anything else? or maybe there is an update on setting
The steps I have so far: 2 layersSpatialRelator, which generates the list attributes with the intersects.Then I test the output to find out which features have more than 1 relation (indicating overlapping with more than 1 feature).Then I explode that list and delete the unimportant attributes with AttributeManager. I now have a table like this. First column containing a unique identifier for Layer 1, the second row containing the unique identifier for Layer 2. A feature of Layer 1 can overlap with multiple features of Layer 2, and vica verca, hence the duplicates on both sides.Layer 1 Layer 2 ID1 123 ID1 345 ID2 987 ID3 456 ID3 123 Now the hard part. I can FeatureJoiner them together, and then dissolve, but then I miss a lot of features and don't dissolve enough overlaps. It doesnt create the perfect output.What I want to achieve: I want all features of Layer 2 to dissolve together, based on the overlaps with features from Layer 2.I added a drawing to visualise wha
Hello fellow FME enthousiasts,I have a case which i can't seem to find a solution for.We have a process that adds a score to incoming records based on certifications added as hyperlinks in a table.During several steps these certifications have to be manually checked by an employee. Finally when everything has been approved the records are written to a central database (this can only be done when all the records have been approved, so the whole dataset has to be kept together during the whole process). Right now i have the process setup to output all data to an Excel table (with a template to make it readable for the employee). Here the employee can select if a certification is approved or not. This Excel table is then put back into the next process untill all necessary checks have been done.Each time a proces is run i would like to check at the end if all records are approved or not. Depending on the outcome two things can happenIf ANY are not approved, ALL records needs to be output t
I have a batch workspace that spawns multiple child workspaces using four separate FMEServerJobsubmitters. I have two engines in FME FLow but the other engine is occupied with other processes so I'm able to use only one engine. As i understood, if i set Wait for jobs to complete to "Yes" and Submit Jobs "In Sequence", FME Flow should spawn a sub-engine that will run the child workflows and once they are ready it will continue the parent process. This is the behaviour that I would need because I only want to continue parent workflow when all the child processes are successful. However, with this setup the first child process enters queue and never starts. It also shows in the parent log file that the submit was successful, but it ends up into queue. I have separate queues for the two engines and both the parent process and the child process are tied to engine2 running in queue2 so it should interfere with the other engine and queue. However, it seems that the par
Hello, I am currently trying to read in a feature class from an ESRI SDE and keep hitting a wall with this error: The table name 'DBO.Transportation/SidewalkAccessCenterline' could not be found in the Geodatabase as either a feature class or a table. This may be because the current user does not have permission to see 'DBO.Transportation/SidewalkAccessCenterline' I have tried the following:updating FME updating ArcGIS Pro changing Esri ArcGIS Compatibility from auto to arcgis pro changing what user ArcGIS Pro was using Made a new connection file checked to see if the file was versioned (it is) checked to see if I had read/write access over the folder the connection file was made in (i did)Any suggestions are welcome! Thank you!
I have designed a dynamic workspace to have a bulk transformation on all shape files within a nested folder structure. I have added the original folder location in the reader with checking tick mark for subfolder. Then I have used batch deployment and checked the 'recreate folder structure'. However, the destination files were not written in the similar folder structure as in the original structure. See how the subfolders within original Asset folder (image 1) were written outside the destination asset folder (second image). Can anyone tell me what was the likely source of this?
When reviewing an old workspace in FME Form 2023.2, I noticed that if I opened a Feature Reader or Feature Writer that previously had an SDE connection file path referenced in the connection parameters that the parameter was now blank. If no changes are made, the workspace runs to completion as normal. No errors are thrown and no transformers are marked as “incomplete” in the navigator pane. This tells me that those pathways are stored somewhere. This does not appear to be an issue with other data types like csv, xls, or file geodatabases. These file types used in a feature reader all have their connection file parameter populated when opened in 2023.2. This does not appear to be an issue if a Reader or Writer is used rather than Feature Reader or Feature Writer transformers. A Reader or Writer configured to work in a previous version of FME using an SDE connection file path is populated when opened in 2023.2.How I would expect to see the connection parameters when settings for the tra
Hi All,I need to run a join between an excel file to a feature class (GDB) with attachments by an unique ID. The GDB has been used to collect data within a Survey123 form.I did some testing but can’t retain the attachments in the final output,Any idea how to retain the attachments after running the join?
HelloI have a simple question, but I’ve found now answer.Is it possible to write a FBX file with transparency, transparent objects?Regards, Hartmut
Hi, I wrote some code to copy feature classes from one gdb to another.Everything runs fine through python, but it fails when I try adding it to a python caller - Specifically, it crashes ArcGIS Application. I have no idea what’s going wrong as I get no error message, only this screen:The odd part is that it manages to delete a layer and then copy the new one across before crashing:Here’s the code i’m trying to run. Apologies in advance for the mess, it’s not my strong point!import fmeimport fmeobjectsimport arcpyimport osimport fnmatchfrom arcpy import envclass FeatureProcessor(object): """Template Class Interface: When using this class, make sure its name is set as the value of the 'Class to Process Features' transformer parameter. """ def __init__(self): """Base constructor for class members.""" pass def has_support_for(self, support_type: int): """This method is called by FME to determine if the PythonCaller supports Bulk mode, which all
Hello ,i have used network topology calculator then aggregator (group by network id ) .i have found that there are some unwanted connecting lines that has same network id .I want to check the reason ?i am wondering if there is a method to find the connecting points that occur to provide each line the same network id as before ?so I can check them quickly .i am looking for a quick method to find unwanted lines that has the same network id .thanks for helpFme 2021
I am building a workbench that uses spatial filters, I have several readers input to the spatial filters that have different source coordinate systems. Originally, I used the ESRI reprojector to convert everything to 3TM (EPSG: 3776) prior to the spatial filters. This included a file with a source coordinate system of WGS84 Spherical Mercator (EPSG: 3857). However, my end result is about 4 feet off of where it should be. I tried selecting a transformation (I used Pro to see which transformation they used when I used the project tool and selected that one) but the result was still the same. I performed the projection in Pro on the same file and it was successful so it was a bit confusing as to what I was missing in FME. I decided to instead project my other files to WGS84 Spherical Mercator and work within that coordinates system. It was successful. I am guessing I may be using the ESRI reprojector incorrectly, or missing an input.
I’m reading a geotiff file with embedded scaling and offset, snippet from gdalinfo:Band 1 Block=1024x1024 Type=Byte, ColorInterp=Red NoData Value=255 Overviews: 6000x6000, 3000x3000, 1500x1500, 750x750 Offset: -1, Scale:0.008Band 2 Block=1024x1024 Type=Byte, ColorInterp=Green NoData Value=255 Overviews: 6000x6000, 3000x3000, 1500x1500, 750x750 Offset: -1, Scale:0.008Band 3 Block=1024x1024 Type=Byte, ColorInterp=Blue NoData Value=255 Overviews: 6000x6000, 3000x3000, 1500x1500, 750x750 Offset: -1, Scale:0.008When working with the data in FME just the the 8-bit value is shown (0-255) when I was expecting values between -1 and 1. In my particular use case the scaling is constant and I can just apply a correction, but I was wondering if there is a setting I’m missing to have FME apply the scaling/offset automatically.
I am comparing records from two sources. I want to sync the records from one source to the other source. I am using ChangeDetector to do this (Workbench 2023.1). Output wise, what is the difference between these two workbench configurations? (one with the FeatureJoiner and one without the FeatureJoiner). When I look in the output database, as far as I can tell, I am getting my desired outcome without needing the FeatureJoiner but I want to make sure I am not overlooking something.Is it necessary to use FeatureJoiner on the records coming out of the “updated” port of the ChangeDetector before pushing the records to the ESRI Portal Feature Service writer? The examples I am coming across are using a FeatureJoiner after the ChangeDetector for the updated records e.g.:https://support.safe.com/s/article/how-do-i-write-updates-to-an-existing-arcgis-onlin