Creating and organizing workspaces. How to use Workbench.
Recently active
Hello, I am trying to read data of different formats, controlled by a resource list. I isolate web services with a separate WFS FeatureReader, I do not have database resources and for the other resources I use a Generic FeatureReader, with the REAL_FORMAT parameter set to:<Guess format name from extension>Some resources include gml files on a web location (URL). The Generic FeatureReader usually reads them correctly, with one exception that gives an http 404 error (Not Found). I can avoid the error by choosing OGC GML (Geography Markup Language) for the REAL_FORMAT parameter. But I cannot control this from my resource list, only with a published parameter. I have tried adding an OGC GML resource reader, but this does not help. The Guess format parameter apparently does not make the right choice.Does anyone have an idea how to solve this, without adding a tester with a separate FeatureReader or using a WorkspaceRunner?I'm using FME Form 2022.2.4 (Win)Below an extract of the worksp
HiI work with stream processing and need to validate data in real time against a database using for example a database joiner. We have an MQ connector recieving large volumes of real time data. For best performance, I need to cache the dataset I am validating against, but the question is, what is the best way to update the cache? The data is updated in the database once per hour and there is 1.000.000 records in the table. A timewindow change can trigger cache update in Fme, but I can´t find out how to solve it, and what readers/transformers to use./Stefan *Edit, caption should be Stream processing….Cant edit.
I am seeking to mimic a script tool in ArcGIS Pro that I’ve constructed. The script tool provides a user with a list of fields within a shapefile, feature class, or feature service once the user has supplied the file path. Once the field has been chosen, the user can then select a feature from a list of features in the dataset with information from the field selected in the previous step. This allows the user to indicate a feature to run from a dataset rather than running the entire batch of features. I am struggling to find a way to prompt FME to assess an input file to provide that sort of list (in ArcGIS Pro this is done with the Validation page of the script tool). I’ve tinkered with incorporating User Parameters, but I feel like I’m missing something. If this sort of process is possible, I’d welcome some feedback and suggestions!
HelloI would like to copy files contained in an input folder to two different destination folders using filecopy writer, but I can't set two different destination paths.Do you have any suggestions?Thanks a lot in advanceEnrico
I merged a population raster with polygons (buffer) to find out how many inhabitants live in each polygone (buffer). I used the spatial filter for this operation and the results are mostly satisfying. There is one case when the results seem to be wrong : that is when I have overlapping polygons. In that case, each population raster in only use for one polygon. Which setting should I change to make sure that the entire population raster is checked for each polygon (buffer) in order to have the correct value for population?
Hello Forum,. I would like to connect to files stored in SharePoint. This is a redacted example of one of the URLs…. I’ve seen the ‘SharePointOnlineConnector’ transformer from https://support.safe.com/hc/en-us/articles/25407532347661-Reading-and-Writing-SharePoint-Libraries-with-FME. However that only works on build FME Build 24577 or higher. We’re on build 23619 - note that we are planning to upgrade in Summer 2025, but that’s a while off. Is there a way of reading from SharePoint without the SharePointOnlineConnector transformer? I see I can select Microsoft SharePoint List as a reader format in FeatureReader. However when I enter the URL (the un-redacted one in the image above) I’m then asked what features to read. When I then select the ellipsis I get this error Am I misunderstanding how the reader works? Do I need to present the reader with a different set of information per file in SharePoint? Is there another way of doing this? Thanks,Stuart
Hello Forum, I’ve been provided with a set of json files (note, not geojson, but json). Within each json file I know there are geometry coordinates pairs. See this screenshot of the json in Notepad++… How can utilise FME to open each json file and pull out the geojson elements to create a geojson showing the polygons? I’ve attached an example project json file. Note that I’ve changed the extension from .json to .txt to get through the Forum blocker not allowing json files. Thanks,
DescriptionI have a excel template file which I have in the excel reader dataset as a reader file. This file only has the name of the attributes and no features. I am trying to implement this job for the end user where every month they can upload the excel file with the same template structure, however different features month on month basis. I want to set up my parameters in a way that based off the template populated, it reads the file every month when uploaded by the end user and also give an ability to the end user to mention the sheet name in the prompt.
Can you please let me know how I can switch and select the workflow based on the value of Attribute? For example I need to select and continue between continuing PythonCaller or PythonCaller_2 based on the value of operation IF ‘operation’ == ‘ADD’ THEN Continue with PythonCaller IF ‘operation’ == ‘REMOVE’ THEN Continue with PythonCaller_2
In the past I've received 2 file MRSID files, 1 RGB and 1 Color Infrared, this time got a 1 MRSID file with all 4 Bands. I can RasterSelector then RasterBandRemover and get the RGB, this takes a little longer as I need to pass it thru transformer. QuestionCan I read a MRSID and only select the RGB Bands and not read the Color Infrared (Apha) as if I don't need it why read it (would this speed up the Workspace processing)?
I have many pdfs that are structured in exactly the same way.At a certain place I have to black out the text.My rough idea:- pdf-reader: define the search envelope so that only the text that has to be blacked out is read in- place black polygons at the position of the text- rewrite the pdf as a whole, with the polygons overlaying the textIs this feasible in FME ?
I have a dozen TIFF files I need to convert to PDF. These are not georeferenced or related to GIS; they are just black-and-white images. They are intended to be hyperlinked so users can view them on a website. I understand how to use the TIFF Reader, but the PDF Writer confuses me. I see there are only two choices to write to PDF: Adobe 3D PDF and Adobe Geospatial PDF Writers. I have tried both and received same error. I am using FME Form 2021. What is the best way to convert TIFF files to PDF files? Or what parameters do I need to set if I use one of the PDF Writers I mentioned? Here is the error I receive when I use any of the two PDF Writers:ERROR |PDFWriter: Could not open output file for writing. Please verify that the file is not open in other applications or that the file is not read-onlyThe TIFF files are not open and are not read-only.
I am having an issue writing metadata to an SDE geodatabase. I am reading features from a feature server and xml metadata from a URL. When I write to SDE it gives the error:Error occurred using IXmlPropertySet2::setXml(). HRESULT = -2147215103. File: D:\code\fme\foundation\formats\geodb2\geodbutilities.cpp Line #: 3580 I set the attributes up like in the tutorials (setting geodb_metadata_string and geodb_type) and I am testing on a new feature dataset. Using FME 2023.2Any ideas?
I’m using FME 2023.2.I thought I understood parallel processing but clearly there are some intricacies that I don’t understand and I’d appreciate any insights people can provide.I have a custom transformer that processes Lidar tiles and takes some time to run, so I enabled parallel processing and saw some significant performance improvements with my test set of 20 tiles.However, when I enable the full data set of 10,000+ files I get an error:2025-03-28 11:26:41| 63.6| 0.0|ERROR |Could not bind port to socket2025-03-28 11:26:41| 63.6| 0.0|ERROR |Failed to create transporter2025-03-28 11:26:41| 63.6| 0.0|ERROR |TransporterSender (TransporterFactory): An error has occurred. Check the logfile above for details2025-03-28 11:26:41| 63.6| 0.0|ERROR |An error has occurred. Check the logfile above for details2025-03-28 11:26:41| 63.6| 0.0|ERROR |f_25 (TransformFact): Transformer 'ProcessSingleTile': Unable to create worker; try reducing the parallelism level (currently 'MODERATE') or
I am using FME Form 2021. I have a Point Feature Class with 100,000 points that includes 4 ID fields, all of which are populated with unique IDs. I want to simplify the process of creating new unique IDs from the existing ones, so I no longer have to manually enter each one when I add a new point.For simplicity, I will refer to the unique ID fields as Field1, Field2, Field3, and Field4. For Field1, the maximum value is 141386; for Field2, the maximum value is 592124.What would be the best way to do this in FME? I am looking for general information like what transformers and parameters I need to use; I think I need to use the Counter Transformer.My goal is to add a new point in ArcGIS Pro and then run the FME workspace to generate the unique IDs for that point.
In Form (2024.1) the FME Flow connection is overwritten when creating a new database connection.This behavior is in our Citrix environment. Why is this happening and what can I do about it? Doesn't have a clue at the moment.
Hello Forum,I am experiencing an unexpected problem with what should be a simple point in polygon search process in FME Form. I have a Creator connecting to…FeatureReader - reading in a point dataset of 16255 recordsFeatureReader - reading in a polygon dataset, which covers a smaller area of what the points do The two FeatureReaders feed into a PointOnAreaOverlayer. But when I run the workspace 16255 point records are found. The number should be far smaller. Thanks.
Hi,I have points created by vertex creator but my points don’t have coordinate system. I need create by points square buffers with 25 kilometers. I’m using coordinate system setter to define WGS84, after use bufferer but the error below is showed. Bufferer can’t understand my coordinate system but without the coordinate system isn´t possible to generate the buffer. Thank´s
Since updating our FME Form host computer with the latest version of VMWare Tools, FME Desktop, FME Data Inspector, and all other FME Form GUI software does not run.We briefly get a spinner and then nothing. The problem was noted on FME version 2021 but is a problem with all version of FME Form up to the latest version FME(R) 2024.1.3.0 (20240927 - Build 24627 - WIN64).It is still possible to run Workspaces in batch mode.The issue seems to be with OpenGL as indicted in the log, below.I would be interested if others have the same issue and, if so, how the issue can be resolved.Here is a snip from the log file:VMWare Tools v12.5.0.24276846Faulting Module = vm3dgl64.dllWorking Version = 3.5.3.2Faulting Version = 3.6.0.0 Event Log:Faulting application name: fmeworkbench.exe, version: 2021.7.41.21614, time stamp: 0x60f7b7a5Faulting module name: vm3dgl64.dll, version: 3.6.0.0, time stamp: 0x66a16726Exception code: 0xc0000005Fault offset: 0x0000000000e3696dFaulting process id: 0x1becFaulting
FME tells me that there was 1 feature written to the database, but it is not true. In my opinion that’s a bug because the statement is objectively wrong.In this case the translation failed because of an error. No features were written to the database. No table was created. I guess FME counts the schema feature, although it is NOT written to the database.Here’s a part of the log and the workspace is attached.POSTGRES Writer: Fanout for feature type 'SQLCreator' failed to find feature type template 'schema_from_query'POSTGRES writer: An error has occurred. Check the logfile above for detailsSuccessfully closed POSTGRES database writer=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-Feature output statistics for `POSTGRES' writer using keyword `POSTGRES_1':=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Features Written=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-SQLC
Is it possible to change the keyboard shortcuts in FME Form?There are some important shortcut that rely on function-keys. With the rise of compact keyboards I am not the only one who has done away with that row.
POSTGRES Writer: Fanout for feature type 'SQLCreator' failed to find feature type template 'schema_from_query'POSTGRES writer: An error has occurred. Check the logfile above for detailsI tried to create a workspace using a dynamic writer (see attachment) but I get the error above. The writer uses following parameters:Table Name: `@Value(fme_feature_type)` The `fme_feature_type` attribute contains the value `SQLCreator` on my features because I use an SQLCreator to read the features. Schema Sources: `Schema From Schema Feature` I’m using the schema feature from the SQLCreator. Schema Definition Name: `schema_from_query` I think the schema definition name refers to the attribute called `fme_feature_type_name` on the schema feature. This attribute contains the value `schema_from_query` when using the schema feature from the SQLCreator. I have also tried to leave the Schema Definition Name field empty in the settings of the dynamic writer’s feature type. In this case it defaults to `De
Is there any option how to set multiple condition for visibility of user parameter? I need some parameters to be available for two choices of another parameter. I could define another connection parameter but i have to use it in same readers and writers of workspace.- is there a chance for some workaround?I can’t merge these two choices, because there another flow for each one of these two.I know thers new feature in FME 2025, but we recently upgraded to last major 2024 version. Probably we’ll be waiting for another release of 2025.
I’m working on an analysis to determine the correct calculation for elevation gain and loss along a line representing a real-world route (such as a trekking, marathon, or MTB course). I’m using FME and have two source vector datasets: a GPX file that already contains Z values for each vertex and a PostGIS line to which I need to assign elevations from a DTM (Draper). Is there a standard workflow for this type of calculation?
Hello, I have a SharePoint List that I am already using. Can FME be used to update this list? What Transformer(s) would I use? At this stage, I am looking for general information to help me get started, so anything you can provide would be excellent.