Creating and organizing workspaces. How to use Workbench.
Recently active
Hello all! I am stuck and unable to create a formula in FME. It involves an Excel formula that I can't seem to replicate in FME. I know there's likely a simple way to achieve this. I need to subtract values. Here is a screenshot for reference: I would greatly appreciate any help!
Using an Esri FGDB Reader (an Esri FGDB FeatureReader) in a Workbench, I would like to apply a where clause using the last_updated field. I believe that because this is a date/time field that it is causing me troubles as I am able to run tests on other fields. What is the correct syntax to enter a where clause on a date/time field from a FGDB?
Hello, I use a custom transformation in the ArcGIS platform. It is a two step projection which uses the Ontario NAD83 grid file to project to NAD83 CSRS and then the second step is projecting from NAD83 CSRS to WGS84 geographic (LL). The two tranformations are:ON_NAD83_NAD83CSRS_CustomTranf, (custom transformation set up in ESRI)NAD_1983_CSRS_To_WGS_1984_2 (chosen ESRI transformation).This two step process was recommended by ESRI Canada to import data into their ArcGIS Online format. I have seen various articles for parts of this process in the FME Community but I guess I am looking for a stepwise list (e.g. obtain grid shift file from authority, create custom transformation in ESRI, etc.) to get the pieces of the puzzle in the right location to use in an FME workflow.Thanks
Hi everyone,I am working with a large dataset (over 500,000 records) stored in PostGIS, which I am reading into FME and writing to ArcGIS Online (AGOL). My goal is to automate this process by publishing the FME Workbench to FME Flow, so the AGOL feature service updates every few hours.When I overwrite the data, the Workbench runs without any issues. However, I want to truncate the existing data instead of overwriting it. When I attempt to do this, I encounter the following error:413 Client Error: Request Entity Too LargeOccasionally, I receive other request size-related errors as well. I tried adjusting the Features Per Request parameter to 500, but the issue persists.I’d like to ask if anyone has experienced this issue before and what possible solutions or workarounds exist to efficiently truncate and update the AGOL feature service without running into request size limitations.Any insights or recommendations would be greatly appreciated!Thanks in advance.
Hello Everyone, I wonder if folks might be able to help with troubleshooting ideas for a Scripted Selection that I am trying to put together. I am trying to dynamically read a SharePoint List using a web connection. When the sharepoint is read users get to choose from the list of records. I can get his working in Form but when published to Flow I do not get a dropdown[v] or list selector [...]. Am I missing a trigger or something? Thanks a bunch for reading.
Hello,Newbie to FME here, trying to create a simple script to move multiple pdf files all located in one folder to multiple folders which match the name of the folder. Tried using File Copy Writer but had no luck.
Hi all,I am using the Overwrite Existing Geodatabase/Template Geodatabase functionality:This creates a new copy of my gdb with a “_yyyymmdd” suffix. However, if my users run this multiple times a day, they have to delete the output of the previous run.I would prefer there to be a “_yyyymmdd_N” suffix, with N being incremented for every time the workspace has finished running that day.What is the sleekest way to implement this? I now have built something with a Path FeatureReader and a combination of Testers and StringConcatenators to filter out and manipulate the different filenames with either no suffix, a date suffix or a date+N suffix. Then FeatureJoiners to join the different path features into one:It works but its bulky and it feels overengineered.Any inputs? Kind regards,Joep
Has anyone had any issues with the speed at which the list of transformers appears when you start typing? For example, if I start typing Creator it can take 20 seconds or more for the list to appear for me to select the transformer from. All of the transformers are the same.
I have provided a consultant with the URL to one of my geocoder services. In order for them to access it, I need to issue a token. The token is issued in the Portal, which means it is valid for a maximum of two weeks. Currently, I have to issue a token every two weeks, a manual process. I would like FME to issue a token and then email it to the recipient. I know how to do the email part, but is it possible for FME to contact the Portal and issue a token?My ultimate goal would be to add this workbench to an Automation and have the token automatically issued every two weeks.
Good morning, I want to read the points the created the curve in DWG civil 3D fileso the reader will draw the curve with the same accuracy.
Since upgrading to FME Flow 2024.1, we see these warning messages in the log files. Is there a way to get rid of them?
So I made a previous post this week asking about CustomTransformers For most of the time I’ve been working with FME I’ve always seen linked CustomTransformers as tools where Global. That it they should live in Resources>Engine>Transformers on FME Server.I’ve always wanted to keep this clean and so most of the time I try to embed transformers wherever I can.But silly me, I just noticed that when publishing a linked transformer from workbench you’re prompted for a repository to choose…How have I not realised this before. This makes so much sense - it means that I can create linked CustomTransfomer that are project specific and keep them in their respective project.I never got this in I think in part because FME Desktop/Form doesn’t support this. The Transformers always need to be in a known/central location.I created an idea so that the same kind of structure can work with FME form as we can on FME Flow: To me this kind or structure just allows keeping everything together - for exa
I have a first shapefile with points indicating the number of inhabitants. I have a second shapefile with surfaces. I would like to know the number of inhabitants for each surface in FME. What is the process?
Hi FME teachers and users, I have files in (.fme) formats, how convert them to (.fmw) formats?
I have a number of workspaces, lets say 5, but this could expand.Each of these workspaces is like a validation check / test. There is a lot or duplication between the tests and I’m thinking about creating some linked customer transformers in order to not have to make changes 5 times in a row. I know this is usually good practice in programming in general.I’m a little hesitant though because adding linked custom transformers can add complexity (passing attributes 7 parameters etc etc) and makes testing/edits kind of annoying. I’m interested to hear others experience with working with linked customer transformers -pain points, whats great, when you use them over when you don’t
Hi! I am currently writing data into an Excel spreadsheet. I have added two feature types that are configured to truncate existing data and overwrite it in the spreadsheet. Now, I need to add another feature type that includes charts and some formulas. These formulas have been set in Excel to sum data from one of the tabs I created in the spreadsheet, and I made a chart based on that data. Is there a way to keep the third tab intact when I overwrite and truncate the data in the first two sheets? Thank you!
Hi everyone,I am new to FME and need some assistance with a project. I am trying to create clusters based on a point layer, using one of the parameters where the total hours equal to 'n' and a spatial parameter. The objective is to find clusters where the total hours equal 'n' and ultimately demarcate boundaries for these clusters to optimal coverage. I have been using the NeighborFinder transformer, but I am having trouble moving forward. Could anyone provide guidance or suggest a better approach to achieve this?Thank you in advance for your help!Sahan
Hi there,Creating many workbenches over the years, and this is very rarely a problem.But it is very rarely a problem because FME automagically selects the postgres writer writes the data using the correct geometry type, not because I have been able to specify.However, here i have a workbench reading in spreadsheet data using a [vertex creator] on the X/Y columns, but when I write the data out to postgis/postgres i find that it arrives there in linestring format. At least, QGIS then sees the layers as linestring!What is super wierd, is that this workbench has been reused for several years, each year with the postgis writer being modified to create a new table for the years data. All previous years it has created point data, this year it has decided on polygon. This happens when i modify the workbench in FME 2022.1.3, or in the current FME 2024.2.3.So, obviously this is unsatisfactory, and I want to be able to tell FME to create that postgres.postgis table with the geometry type of point
Can someone please let me know how I can grab two values from a JSON snippet like below image? Using FME Desktop I am trying to grab two values “portalURL” and "id" from two fragments of "info" and "events" and assigned them to two User Parameters “PURL” and “PID” Can you please let me know what Translator/former I can use to the task for me?
Hello! I have a problem regarding using a FMEFlowJobSubmitter within a workspace when running on fmeflow using only one engine. When testing the same setup on an old fmeserver i dont have this problem since a “child” engine is created and the procces does not halt. This also works ony my localhost fme flow. However when running on a new fmeflow setup i get the following error:346 2025-2-12 14:53:56 | FMEFlowJobSubmitter_5 (ServerFactory): Reason - 'Error communicating with FME Server host FME-flow uses a “"FME Engine of a distributed FME Server deployment". Could this cause the issue or is there any other known problems that i can look into? /Fabian
Hi there,Somehow I've managed to undock the Translation Log window from the bottom pane of FME Workbench and I've been unable to return it to it's original location.Currently, it is locked in the top-left of my screen and shows as a much more compressed version of itself (with no text) - see image.Can anyone enlighten me as to how to restore it?
hello! I am currently working on an API integration project. My task involves reading data stored in an ArcSDE geodatabase, selecting specific data, and posting it to a website. The website accepts data in JSON format, which should follow a specific structure:{ "type": "Feature", "properties": { "id": <id>, "name": <name> }, "geometry": { "type": "<geometry_type>", "coordinates": <coordinates> }}I read data from ArcSDE geodatabase and the option that converts data into the format above is GeoJSON writer. however, this writer saves the GeoJSON file to a directory, which I do not want. Instead, I need to convert the data into the required JSON format using a transformer, Extract specific parts like geometry and property from the JSON format that can connect with an HTTP caller to POST the data. I'm not sure which transformer would be suitable for generating the desired output. I would greatly appreciate any advice or help! Thanks!
I want to send ~150 users a stock email. No data translation in this one, I just want to read a list and send the email. (also a attachment, with a file that matches mostly matches their email addy but one thing at at time).
I am building a workspace to do data prep for an AI model training process. This will involve, in this order: Copying a number of image files of type A When copying completed, creating image label .txt files for these when all image copying and label creation complete, copying an exactly equal number of images of type B (from a larger pool than that of the A’s) creating the image label files for these Terminate process when counts match1 and 2 are working fine. I’ve added a counter after stage 2, and I want stage 3 to keep running until the count of type B images copied = count of type A images copied. How might I a) kick off 3. only when 2. is finished and b) stop 3. when count of B = count of A?
I have been given an xml file which when opened in Notepad++ shows encoding “Windows (CR LF)” “UTF-8” I need to write a new file with the same encoding. My writer has these parameters It writes the file ok but in Notepad++ the file encoding shows “Unix (LF)” UTF-8-BOM” What writer parameters should I use to get the same output?