Skip to main content
  • EN

Authoring

Creating and organizing workspaces. How to use Workbench.

  • 3,246 Posts
  • 13,335 Replies
3246 Posts
stlj
Contributor
stljContributor
asked in Authoring
Best way to update prefetch cache in stram processing

HiI work with stream processing and need to validate data in real time against a database using for example a database joiner. We have an MQ connector recieving large volumes of real time data. For best performance, I need to cache the dataset I am validating against, but the question is, what is the best way to update the cache? The data is updated in the database once per hour and there is 1.000.000 records in the table. A timewindow change can trigger cache update in Fme, but I can´t find out how to solve it, and what readers/transformers to use./Stefan *Edit, caption should be Stream processing….Cant edit.

453
mattmatsafe
Safer
danraleigh
Contributor
danraleighContributor
asked in Authoring
Provide a Drop-down List of Fields in a Feature Class, Shapefile, or Feature Service

I am seeking to mimic a script tool in ArcGIS Pro that I’ve constructed. The script tool provides a user with a list of fields within a shapefile, feature class, or feature service once the user has supplied the file path. Once the field has been chosen, the user can then select a feature from a list of features in the dataset with information from the field selected in the previous step. This allows the user to indicate a feature to run from a dataset rather than running the entire batch of features.  I am struggling to find a way to prompt FME to assess an input file to provide that sort of list (in ArcGIS Pro this is done with the Validation page of the script tool). I’ve tinkered with incorporating User Parameters, but I feel like I’m missing something. If this sort of process is possible, I’d welcome some feedback and suggestions!

271
crutledge
Influencer
enrico.artini
Participant
enrico.artiniParticipant
asked in Authoring
Copying files to two different destination folders

HelloI would like to copy files contained in an input folder to two different destination folders using filecopy writer, but I can't set two different destination paths.Do you have any suggestions?Thanks a lot in advanceEnrico

464
enrico.artini
Participant
fme_junior
Contributor
fme_juniorContributor
asked in Authoring
Spatial filter with overlapping polygons

I merged a population raster with polygons (buffer) to find out how many inhabitants live in each polygone (buffer).  I used the spatial filter for this operation and the results are mostly satisfying. There is one case when the results seem to be wrong : that is when I have overlapping polygons. In that case, each population raster in only use for one polygon. Which setting should I change to make sure that the entire population raster is checked for each polygon (buffer) in order to have the correct value for population?   

241
takashi
Evangelist
scarter
Contributor
scarterContributor
asked in Authoring
Reading files from Sharepoint into FME Flow

Hello Forum,. I would like to connect to files stored in SharePoint. This is a redacted example of one of the URLs…. I’ve seen the ‘SharePointOnlineConnector’ transformer from https://support.safe.com/hc/en-us/articles/25407532347661-Reading-and-Writing-SharePoint-Libraries-with-FME. However that only works on build FME Build 24577 or higher. We’re on build 23619 - note that we are planning to upgrade in Summer 2025, but that’s a while off. Is there a way of reading from SharePoint without the SharePointOnlineConnector transformer? I see I can select Microsoft SharePoint List as a reader format in FeatureReader. However when I enter the URL (the un-redacted one in the image above) I’m then asked what features to read. When I then select the ellipsis I get this error  Am I misunderstanding how the reader works? Do I need to present the reader with a different set of information per file in SharePoint? Is there another way of doing this? Thanks,Stuart

352
scarter
Contributor
scarter
Contributor
scarterContributor
asked in Authoring
Extracting geometry values from json to create geojson files in FME Form

Hello Forum, I’ve been provided with a set of json files (note, not geojson, but json). Within each json file I know there are geometry coordinates pairs. See this screenshot of the json in Notepad++… How can utilise FME to open each json file and pull out the geojson elements to create a geojson showing the polygons? I’ve attached an example project json file. Note that I’ve changed the extension from .json to .txt to get through the Forum blocker not allowing json files. Thanks,  

19721
takashi
Evangelist
aashnaparikh
Contributor
aashnaparikhContributor
asked in Authoring
Excel File Reader - Dynamic sheet selection

DescriptionI have a excel template file which I have in the excel reader dataset as a reader file. This file only has the name of the attributes and no features. I am trying to implement this job for the end user where every month they can upload the excel file with the same template structure, however different features month on month basis.  I want to set up my parameters in a way that based off the template populated, it reads the file every month when uploaded by the end user and also give an ability to the end user to mention the sheet name in the prompt. 

603
takashi
Evangelist
bhk
Contributor
bhkContributor
asked in Authoring
How To Switch Workflow Base on the Attribute Valye

Can you please let me know how I can switch and select the workflow based on the value of Attribute? For example I need to select and continue between continuing PythonCaller or PythonCaller_2 based on the value of operation IF ‘operation’ == ‘ADD’ THEN Continue with PythonCaller IF ‘operation’ == ‘REMOVE’ THEN Continue with PythonCaller_2 

322
redgeographics
Celebrity
hlouie
Contributor
hlouieContributor
asked in Authoring
Read MRSID without Alpha Band (Color Infrared)

In the past I've received 2 file MRSID files, 1 RGB and 1 Color Infrared, this time got a 1 MRSID file with all 4 Bands. I can RasterSelector then RasterBandRemover and get the RGB, this takes a little longer as I need to pass it thru transformer. QuestionCan I read a MRSID and only select the RGB Bands and not read the Color Infrared (Apha) as if I don't need it why read it (would this speed up the Workspace processing)? 

734
kailinatsafe
Safer
vki
Contributor
vkiContributor
asked in Authoring
black out text in pdf

I have many pdfs that are structured in exactly the same way.At a certain place I have to black out the text.My rough idea:- pdf-reader: define the search envelope so that only the text that has to be blacked out is read in- place black polygons at the position of the text- rewrite the pdf as a whole, with the polygons overlaying the textIs this feasible in FME ? 

647
redgeographics
Celebrity
vxn43
Supporter
vxn43Supporter
asked in Authoring
Convert TIFF files to PDF files

I have a dozen TIFF files I need to convert to PDF. These are not georeferenced or related to GIS; they are just black-and-white images. They are intended to be hyperlinked so users can view them on a website. I understand how to use the TIFF Reader, but the PDF Writer confuses me. I see there are only two choices to write to PDF: Adobe 3D PDF and Adobe Geospatial PDF Writers. I have tried both and received same error. I am using FME Form 2021. What is the best way to convert TIFF files to PDF files? Or what parameters do I need to set if I use one of the PDF Writers I mentioned? Here is the error I receive when I use any of the two PDF Writers:ERROR |PDFWriter: Could not open output file for writing. Please verify that the file is not open in other applications or that the file is not read-onlyThe TIFF files are not open and are not read-only.

572
redgeographics
Celebrity
swach
Contributor
swachContributor
asked in Authoring
Errors wrting metadata to sde geodatabase

I am having an issue writing metadata to an SDE geodatabase. I am reading features from a feature server and xml metadata from a URL.  When I write to SDE it gives the error:Error occurred using IXmlPropertySet2::setXml(). HRESULT = -2147215103.   File: D:\code\fme\foundation\formats\geodb2\geodbutilities.cpp   Line #: 3580 I set the attributes up like in the tutorials (setting geodb_metadata_string and geodb_type) and I am testing on a new feature dataset. Using FME 2023.2Any ideas?

120
swach
Contributor
nic_ran
Contributor
nic_ranContributor
asked in Authoring
Understanding parallel processing in FME Form

I’m using FME 2023.2.I thought I understood parallel processing but clearly there are some intricacies that I don’t understand and I’d appreciate any insights people can provide.I have a custom transformer that processes Lidar tiles and takes some time to run, so I enabled parallel processing and saw some significant performance improvements with my test set of 20 tiles.However, when I enable the full data set of 10,000+ files I get an error:2025-03-28 11:26:41|  63.6|  0.0|ERROR |Could not bind port to socket2025-03-28 11:26:41|  63.6|  0.0|ERROR |Failed to create transporter2025-03-28 11:26:41|  63.6|  0.0|ERROR |TransporterSender (TransporterFactory): An error has occurred. Check the logfile above for details2025-03-28 11:26:41|  63.6|  0.0|ERROR |An error has occurred. Check the logfile above for details2025-03-28 11:26:41|  63.6|  0.0|ERROR |f_25 (TransformFact): Transformer 'ProcessSingleTile': Unable to create worker; try reducing the parallelism level (currently 'MODERATE') or

995
redgeographics
Celebrity
vxn43
Supporter
vxn43Supporter
asked in Authoring
Generate additional unique IDs from existing Unique IDs

I am using FME Form 2021. I have a Point Feature Class with 100,000 points that includes 4 ID fields, all of which are populated with unique IDs. I want to simplify the process of creating new unique IDs from the existing ones, so I no longer have to manually enter each one when I add a new point.For simplicity, I will refer to the unique ID fields as Field1, Field2, Field3, and Field4. For Field1, the maximum value is 141386; for Field2, the maximum value is 592124.What would be the best way to do this in FME? I am looking for general information like what transformers and parameters I need to use; I think I need to use the Counter Transformer.My goal is to add a new point in ArcGIS Pro and then run the FME workspace to generate the unique IDs for that point. 

512
vxn43
Supporter
harmen
Contributor
harmenContributor
asked in Authoring
In Form the FME Flow connection is overwritten when creating a new database connection

In Form (2024.1) the FME Flow connection is overwritten when creating a new database connection.This behavior is in our Citrix environment. Why is this happening and what can I do about it? Doesn't have a clue at the moment.  

362
harmen
Contributor
scarter
Contributor
scarterContributor
asked in Authoring
PointOnAreaOverlayer not producing expected results

Hello Forum,I am experiencing an unexpected problem with what should be a simple point in polygon search process in FME Form. I have a Creator connecting to…FeatureReader -  reading in a point dataset of 16255 recordsFeatureReader - reading in a polygon dataset, which covers a smaller area of what the points do  The two FeatureReaders feed into a PointOnAreaOverlayer. But when I run the workspace 16255 point records are found. The number should be far smaller. Thanks. 

342
scarter
Contributor
mr_fme
Enthusiast
mr_fmeEnthusiast
asked in Authoring
Problems with points in Bufferer

Hi,I have points created by vertex creator but my points don’t have coordinate system. I need create by points square buffers with 25 kilometers. I’m using coordinate system setter to define WGS84, after use bufferer but the error below is showed. Bufferer can’t understand my coordinate system but without the coordinate system isn´t possible to generate the buffer. Thank´s

8612
mr_fme
Enthusiast
sussexpete
Contributor
sussexpeteContributor
asked in Authoring
FME Workbench and other FME Form software broken by VMWare Tools

Since updating our FME Form host computer with the latest version of VMWare Tools, FME Desktop, FME Data Inspector, and all other FME Form GUI software does not run.We briefly get a spinner and then nothing. The problem was noted on FME version 2021 but is a problem with all version of FME Form up to the latest version FME(R) 2024.1.3.0 (20240927 - Build 24627 - WIN64).It is still possible to run Workspaces in batch mode.The issue seems to be with OpenGL as indicted in the log, below.I would be interested if others have the same issue and, if so, how the issue can be resolved.Here is a snip from the log file:VMWare Tools v12.5.0.24276846Faulting Module = vm3dgl64.dllWorking Version = 3.5.3.2Faulting Version = 3.6.0.0 Event Log:Faulting application name: fmeworkbench.exe, version: 2021.7.41.21614, time stamp: 0x60f7b7a5Faulting module name: vm3dgl64.dll, version: 3.6.0.0, time stamp: 0x66a16726Exception code: 0xc0000005Fault offset: 0x0000000000e3696dFaulting process id: 0x1becFaulting

579321
nia.colebrooke
Safer
dsign-world
Contributor
dsign-worldContributor
asked in Authoring
Dynamic Workspace: Wrong number of features written

FME tells me that there was 1 feature written to the database, but it is not true. In my opinion that’s a bug because the statement is objectively wrong.In this case the translation failed because of an error. No features were written to the database. No table was created. I guess FME counts the schema feature, although it is NOT written to the database.Here’s a part of the log and the workspace is attached.POSTGRES Writer: Fanout for feature type 'SQLCreator' failed to find feature type template 'schema_from_query'POSTGRES writer: An error has occurred. Check the logfile above for detailsSuccessfully closed POSTGRES database writer=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-Feature output statistics for `POSTGRES' writer using keyword `POSTGRES_1':=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Features Written=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-SQLC

364
dsign-world
Contributor
aron
Supporter
aronSupporter
asked in Authoring
How do I change shortcuts in Form?

Is it possible to change the keyboard shortcuts in FME Form?There are some important shortcut that rely on function-keys. With the rise of compact keyboards I am not the only one who has done away with that row.

281
j.botterill
Influencer
dsign-world
Contributor
dsign-worldContributor
asked in Authoring
Error using dynamic writer: POSTGRES Writer: Fanout for feature type '...' failed to find feature type template '...'

POSTGRES Writer: Fanout for feature type 'SQLCreator' failed to find feature type template 'schema_from_query'POSTGRES writer: An error has occurred. Check the logfile above for detailsI tried to create a workspace using a dynamic writer (see attachment) but I get the error above. The writer uses following parameters:Table Name: `@Value(fme_feature_type)` The `fme_feature_type` attribute contains the value `SQLCreator` on my features because I use an SQLCreator to read the features.   Schema Sources: `Schema From Schema Feature` I’m using the schema feature from the SQLCreator.   Schema Definition Name: `schema_from_query` I think the schema definition name refers to the attribute called `fme_feature_type_name` on the schema feature. This attribute contains the value `schema_from_query` when using the schema feature from the SQLCreator. I have also tried to leave the Schema Definition Name field empty in the settings of the dynamic writer’s feature type. In this case it defaults to `De

645
nielsgerrits
VIP
albinepro
Supporter
albineproSupporter
asked in Authoring
Multiple conditions for conditional user parameter

Is there any option how to set multiple condition for visibility of user parameter? I need some parameters to be available for two choices of another parameter. I could define another connection parameter but i have to use it in same readers and writers of workspace.- is there a chance for some workaround?I can’t merge these two choices, because there another flow for each one of these two.I know thers new feature in FME 2025, but we recently upgraded to last major 2024 version. Probably we’ll be waiting for another release of 2025.

503
albinepro
Supporter
gattogis
Contributor
gattogisContributor
asked in Authoring
Elevation gain along a line

I’m working on an analysis to determine the correct calculation for elevation gain and loss along a line representing a real-world route (such as a trekking, marathon, or MTB course). I’m using FME and have two source vector datasets: a GPX file that already contains Z values for each vertex and a PostGIS line to which I need to assign elevations from a DTM (Draper). Is there a standard workflow for this type of calculation?

352
gattogis
Contributor
vxn43
Supporter
vxn43Supporter
asked in Authoring
Update SharePoint List?

Hello, I have a SharePoint List that I am already using. Can FME be used to update this list? What Transformer(s) would I use? At this stage, I am looking for general information to help me get started, so anything you can provide would be excellent. 

302
j.botterill
Influencer
mr_fme
Enthusiast
mr_fmeEnthusiast
asked in Authoring
Update/Insert specifical attribute

Hi, I have one table that have attributes called months of the year, that begin in OUT_24, NOV_24...until SET_25.My workspace will run month by month by workspace runner. In my workspace sometimes the value is filled in OUT_24, in the next execution NOV_24...until the end. How my table can be updated if OUT_24 have a values only for example? I would like to ignore attributes with missing values. I try this code in SQLExecutor:  UPDATE ARCGIS.BTA_SAT_NDVI_pl SET MAR_25 = @Value(MAR_03) WHERE COD = @Value(COD) AND NEW_ID = @Value(NEW_ID); But don’t work for me...because I need to change SQL after SET to attribute with value. Thank´s

462
mr_fme
Enthusiast

Badge Winners

  • Welcome Back
    daposadikuhas earned the badge Welcome Back
  • FME Flow Certified Professional
    lubohas earned the badge FME Flow Certified Professional
  • FME Certified Professional
    lubohas earned the badge FME Certified Professional
  • Student (Grey)
    kevinkieshas earned the badge Student (Grey)
  • Teacher (Grey)
    kevinkieshas earned the badge Teacher (Grey)
Show all badges

Community Stats

31,486
Posts
119,359
Replies
39,104
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.