Creating and organizing workspaces. How to use Workbench.
Recently active
I have two table that I am trying to keep in sync. I want a target table to match a source table. But I am trying to avoid deleting all rows from the target and reloading it. The source table is in our CIS (customer information system) Oracle database and the target is in our GIS Esri Oracle database. I am using a CRC calculator to find rows that are identical. Then I have a writer to delete rows from the target that have been updated in the source and to delete rows that no longer exist in the source. Then I have a second writer to insert rows that exist in the source but do not exist in the target or have been updated in the source. The delete writer is based on a single key column.Okay, so it is important that the delete writer commits before the the insert writer. I have tested it and the delete writer does appears to commit first. The tables are synced properly and the FME logs show the delete writer committed first. So, my question is this: Can i count on the the delete writers a
We have several FME based solutions - At the moment they are mixture of workspaces, CustomTransformers and formats. I guess my question is are people thinking about a package as a single tool (like a API connector) or can it also makes sense to include a number of transformers and formats in a similar way to an FME Server Project?
Hi,I’m attempting to create attributes from an unstructured html table.Looks like this… The table is originally a Word .doc, that I saved as a .html file so I could read it in FME. For example, I’d like to create an attribute (AttributeCreator) that selects based on row number … eg “Survey Authority” = Col1 row4or“End Date” = Col2 row8This there a way I can do this ?thanks
We have several memory intensive workspaces that normally return log file entries like:INFORM|ResourceManager: Optimizing Memory Usage. Please wait…Recently our IT department was sourced to a MSP, and it seems many security settings have changed. Now when FME tries to ‘optimize memory usage’, we receive Windows warnings similar to the screen shot below for ArcGISIndexingServer.exe and FNPLicensingService.exe. There does not seem to be any adverse effects in FME otherwise.Should we be concerned with these warnings? Will the memory available to FME be lower since access is being blocked? What can I ask the MSP to fix if it is an issue?
1st file example: 2nd file example:dog dogcat birdbird cowhorse cowCompare and write what’s missing from file 2 to a 3rd file.
In the 3D modeled buildings, some normal vectors on the exterior walls are pointing to the right while others are pointing to the left. How can I identify and reverse the vectors that are pointing to the right, so that they all point to the left?I attached sample buildings.
I have 2 datasets of roads, one is a whole of site polygon layer and the other layer is broken into segments for each section of road. I have manually edited the whole of site layer to match our property boundary layer. Now I would like to match the road segments to the whole of site possibly by snapping the segment layer to the whole of site layer. I really hope there is a way to do this as it would be a massive job to manually align each individual segment to the whole of site layer. It has taken me 3 weeks to do the whole of site layer alone.
Hi Guys, I have recently using FME and would like to know if anyone can help me explain how to extract the polygons from a JSON file. I intend to create a workspace, but it does not extract what I need. Also, I have read a few similar questions about this topic but still do not have a solution. The file is the following one:Also, I have attached my workspace with much of the work :( If there is anyone who can help me much appreciate it.
Using FME Desktop 2023.1 I am able to use a SQL Server Database Connection (None Spatial) and ETL from database with no issue. When I try to publish the same script to FME Server 2021 and attaching the database connection to the script I am getting this errors Failed to add database type 'Microsoft SQL Server' - FME Flow encountered an error and reported the following message.Path not found I also tried to use an exiting same connection which I already published with FME Desktop 2021.1 and now I am getting this error message 49 2024-7-23 11:04:25 | SQLExecutor_<Rejected> (TeeFactory): Feature specification `NO_LOGGING' in mapping file row `FACTORY_DEF * TeeFactory FACTORY_NAME SQLExecutor_<Rejected> INPUT FEATURE_TYPE SQLExecutor_<REJECTED> NO_LOGGING OUTPUT FAILED FEATURE_TYPE * @Abort(ENCODED,SQLExecutor<space>output<space>a<space><lt>Rejected<gt><space>feature.<space><space>To<space>continue<space>tr
Hi,I'm trying to clip raster data using a 1k*1k grid shapefile. I'm not achieving the desired results as the clipping is imperfect, resulting in gaps or extra pixels. My goal is to clip the raster strictly within the boundary without any additional or missing pixels.Could someone please suggest a workflow for this?sample data:
Hello Forum, I have a workspace which consumes an incoming geojson and then outputs three .tab files based on datestamp value combinations (via TestFilters): Active sites – where the start_date datestamp is in the past and the end_date datestamp is in the future Closed sites - where the start_date datestamp is in the past and the end_date datestamp is in the past Upcoming sites - where the start_date datestamp is in the future past and the end_date datestamp is in the future This workspace is doing exactly what I want it to do, so far. However, it’s entirely possible that there may be occasions when no object falls into one of the categories (e.g.: Upcoming sites). At the moment, if that happens then the workspace does not create an output. In this scenario I’m left with the most recent previously created output, where there were Upcoming objects. But in this scenario I need the workspace to create a tab output , but with no objects within it. Is it possible to programme this in into t
Using FME 2021, and 2023 SQLExecutor, I am running a simple query to return data from a non spatial table in SQL Server, but I am getting an empty column in return The number of rows are exactly 145 and SQLExecutor result is showing that but the visual Preview just showing an empty column (again with correct 145 rows) I even added a AttributeManager to script but same result is happening Can you please let me know what I am doing wrong here?
Hi,I am trying to write a DWG file with the units set to US survey feet. I can’t get it to work, its is in completely the wrong spot. I’m not entirely sure you can, but I’m not enough of and expert with FME (or US survey feet).Looking at the help file for my FME version (2023.2) it doesn’t have us survey feet as a possible unit to set the insertion units to.I have the unit set in a template file and that doesn’t help when the help says it should use this when I don’t explicitly set it.I am writing to a 2018 DWG (as that is the newest). I know for older versions of DWG you could not set US survey feetDoes anyone have any ideas? Surely US survey feet is a more common unit than the parsec for a DWGThanks
I have a number of CustomTransformers which contain some python - this python may or may not include some third parts python dependencies. It’s not only python, they also use regular old FME transformers as well.I’ve been playing around with the package development guide and doing some testing. I can see how to import third party modules for just normal CustomTransformers. I’d really like to be able to use the package manager tools here to help with dependencies, however, it seems like from my experimenting that fme based custom transformers can not benefit from these tools.Does any one know anything or have any comments on this?
Hi, I was hoping to create a workbench that has a base surface and a target surface and finds the volume between the two, is there any way to do that with the below transformer ie. make the base a surface with elevation differentials?Any suggestions appreciated!Thank you.
I know in the Esri ArcGIS Portal Feature Service writer there are parameters to control writing out with branch versioning.Is there similar functionality for traditional versioning?If yes, is there a way to have traditional versioning and preserve Global IDs using the Esri ArcGIS Portal Feature Service writer?
Hi, I'm trying to populate the "To" and "From" attributes in the Line feature. I have points snapped to the line feature, causing the line to split at the point. I need to fill out the "To" and "From" attributes. I tried a certain approach, but it didn't work:I buffered the point feature and used LineOnAreaOverlayer, and then the Coordinate extractor to find the start and end points of the line.If there is any other way I can use to accomplish this task, please advise.Thanks!
Hello, Using FME Workbench 2022.2 and am able to connect to ArcGIS Feature Service (10.9.1) via the reader with a supplied token (manually). Is there a way in FME workbench to automatically regenerates the ArcGIS token everytime the workbench is run? ThanksAnthea
Hi all,I have a set of input street lines with certain attribute (POSTAL CODES), and I would like to create area polygons from unique values of such postal code attribute. Street Lines with postal code attributeI have utilized AreaBuilder for such purposes and this is an example of the output: Inner polygons created by AreaBuilderThis is the params I have for such transformation:What I would like to have as an output is the area covered by all the street lines with unique postal codes, something more like this: Desirable Polygon from street linesIs there any other param customization I have missed or something else to do about? Regards.
I have a script that is supposed to run some .bat files base on calling defined SystemCallers. I have 3 System caller as each for DEV, HUB, and PROD environments. and I want to control which to run with User Parameters as belowCan you please let me know how I can control which SystemCaller to run based on user selection (For example: if user select the DEV then only the SystemCaller-DEV)
Hi list.I'm tasked with importing a lot of feature sets, each with its own set of fields/attributes. So I'm using dynamic output mode, utilizing the schema features read.Unfortunately the request is to add a "job ID", so I tried to append an entry to the attribute list of the schema features, but suddenly the proces fails, not recognizing the schema features anymore. And this without changing anything in the data features flow nor the writer.An example of the error message is:Microsoft SQL Server Spatial Writer: A feature has arrived with 'fme_feature_type' of DAF_DAGI.afstemningsomraade_908308, but the feature type is not recognized. Halting translationMy writer setup is shown in the attached image. Why does the writer suddenly confuse the fme_feature_type with the requested table name ?Or is the error message false/misleading ?The "fme_feature_type" of the data features are the exact same, I just manipulated the schema features in a parallel "stream".Any insights are appreciated.Chee
A small follow-up question, the prompt button on the toolbar has vanished for me since FME 2024.0. It also disappeared from the Toolbar options. Same goes for the Stop at breakpoint button.Any ideas how to get it back?
I'm using a path in an Esri geodatabase writer that contains a space in the path name - \\\\xxxxx\\gis\\SheriffsOffice\\Camera Information\\SO_Camera_Info.gdb. The workbench completes successfully (2019.1). When the workbench is published to FME Server and run, the path is truncated at the space form '\\\\xxxxx\\gis\\SheriffsOffice\\Camera.gdb' Is there a way to fix this?
Hello,I am new to FME but have some overall experience with coding and I know there has to be a simple way to solve the issue of automatically creating the file name based on an attribute. I am trying to create an excel file with multiple sheets and I have tried using the fan out parameter (along with anything else I can find online) but its been making multiple files or crashing, instead of just one file with multiple sheets. I have been researching this issue for far too long with absolutely no head way so any help will be greatly appreciated. I will also need to create a kmz/kml file with the same naming parameters if that changes anything.Thank you in advance,Sam
Hi All,Am attempting to read a feature service (actually several) that are open to the public on ArcGIS Online (AGOL). I have created a new web connection using an existing user in AGOL for our organization (getting a token, client id, etc).The data that I am attempting to read is the ACS Census data (several different feature services). When entering the copied URL from the AGOL website, and then attempting to select a layer from the feature service, I get the following errors. I see that that it is looking in the content of my user, but this data is open to all. This used to work for me before the changes in the web connections. Where do I look from here? I have tried this in FME 2022 and Flow 2024.Thanks,LorindaCreating reader for format: Esri ArcGIS Online (AGOL) Feature ServiceTrying to find a PYTHON plugin for reader named `ARCGISONLINEFEATURES'Using Python interpreter from `C:\Program Files\FME Flow\fmepython312\python312.dll' with PYTHONHOME `C:\Program Files\FME Flow\fme