- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Authoring

Authoring

Creating and organizing workspaces. How to use Workbench.

3,034 Posts
12,549 Replies

When you subscribe we will email you when there is a new topic in this category

3034 Posts

Most replies

Most views

Newest first

stuarmitagehomeContributor

asked in Authoring

Oracle Upsert not working

Hi,I need to use Upsert to either Update or Insert features into an Oracle database.If I use Insert to add values it works a treat, so the connection to the Oracle tables is good.As the Oracle tables are large, when adding the writer I use Import from Dataset… This picks up the format of the date fields and all sorts. It works well for initially inserting the data.However, when dealing with deltas, which might be Inserts or Updates I want to use Upsert. I can test it on a filegeodatabase and it works perfectly. Taking that knowledge into the Oracle process like this: I use the NODE_ID as this is the unique identifier.However, this fails.So I have followed the guidance to implement fme_db_operation, I have created a new attribute field of that name, and used a FeatureReader, FeatureMerger, and then AttributeCreator to define whether the feature is classed as INSERT or UPDATE. All works well in the workspace, and a manual / visual comparison between Workbench and the Oracle table conclud

477

1 day ago

elysonmorfParticipant

asked in Authoring

FME Multiwriter (generic) configuration

i was reading on FME Form Advanced module, in Generic writing sectionand it has this part that mentioned : When you use the Generic Writer, it is sometimes helpful to pre-configure parameters specific to individual output formats. For example, you must specify a seed file to write a Bentley MicroStation Design file.To do this, add a writer to a workspace. This step causes Workbench to think that there is more than one output format and forces Workbench to create a Multiwriter for the workspace. The first writer in the multi-writer will be the Generic writer, and this one should have all the output feature types. The second writer will have no feature types but will be used to communicate any format-specific writer settings to the Generic writer when FME users that format for the Generic writer.Suppose you configure the Generic writer to write to a format requiring a filename as a dataset. In that case, the Generic writer will turn the output folder into a filename by appending a file e

110

1 day ago

ebygommSupporter

asked in Authoring

Warning message: Resetting a database that is still referenced.

Since upgrading to FME Flow 2024.1, we see these warning messages in the log files. Is there a way to get rid of them?

472

4 days ago

Jonathan SlopeContributor

asked in Authoring

Running workspace with "ignore failed readers" on gives error

Hi all, i've got a strage error. I have about 30 ArcGIS Online readers that i want to read, update and write back to ArcGIS Online. Now, the update part with the Changedetector workes fine. (Dont look at the mess ;). The problem:When i run the workspace, it gets all the 41K features that are in there. The other ones are skipped because it is not found. This works as it should work. After that it tries to search in groups accessible to the user, and then it says "error running translation”. Does anyone know how to fix this? I have attached the log file and the workspace. Thanks in advance!

4 days ago

nedwatermanContributor

asked in Authoring

S3 connector unable to download files

Morning,I have access to the bucket and can read files. However, when I attempt to download a file I receive the following error:My admin insists I have the correct credentials, and I can download this file using WinSCP. Are there are settings I might be missing on the connector?

4 days ago

0xbox0Contributor

asked in Authoring

FeatureReader

Hi,I would like to setup a FeatureReader to read all the XML files in a onedrive folder. My OneDrive (graph) connection works and I’m able to view the contents of my folder. I am able to select individual files to read in the FeatureReader parameters but I want to be able to read all XML files. How would I go about accomplishing this? Thanks in advance.

586

4 days ago

mariasContributor

asked in Authoring

Alternative way to assign PrimaryKey and Serial data type

Hello,Is there any way to assign Index “Primary key” to the field and Type “serial” somehow in another way rather than in Feature writer - User attributes? These options are not present in AttributeManager transformer, unfortunately. That would help me to reduce number of manual adjustments and use “Automatic” attribute definition. Because I have many FeatureWriter transformers in my workspace and I need to replicate it to read another data.

281

6 days ago

sussexpeteContributor

asked in Authoring

FME Workbench and other FME Form software broken by VMWare Tools

Since updating our FME Form host computer with the latest version of VMWare Tools, FME Desktop, FME Data Inspector, and all other FME Form GUI software does not run.We briefly get a spinner and then nothing. The problem was noted on FME version 2021 but is a problem with all version of FME Form up to the latest version FME(R) 2024.1.3.0 (20240927 - Build 24627 - WIN64).It is still possible to run Workspaces in batch mode.The issue seems to be with OpenGL as indicted in the log, below.I would be interested if others have the same issue and, if so, how the issue can be resolved.Here is a snip from the log file:VMWare Tools v12.5.0.24276846Faulting Module = vm3dgl64.dllWorking Version = 3.5.3.2Faulting Version = 3.6.0.0 Event Log:Faulting application name: fmeworkbench.exe, version: 2021.7.41.21614, time stamp: 0x60f7b7a5Faulting module name: vm3dgl64.dll, version: 3.6.0.0, time stamp: 0x66a16726Exception code: 0xc0000005Fault offset: 0x0000000000e3696dFaulting process id: 0x1becFaulting

187315

7 days ago

deanhowellEnthusiast

asked in Authoring

Hold Data from filter to be able to set projection

In the above image, I read a text file that contains lines of data where specific lines that start with an ID relate to different features.In the #1 category it contains the projection information but I want to be able to set the projection of the other output ports based in the information in that line.How do I hold and set the projection of the Lines, Points, etc?I was thinking that I may just need to read the text file twice, once to get the projection from Port #1 and then have a feature reader that can then set the projection before processing the other output ports.Is there a more efficient way of doing it?

171

7 days ago

matiassalinasContributor

asked in Authoring

Strange error on MacOs when trying to run workbench

Hello, Im using FME form on macSilicon and ran into an error trying to run simple workspaces: /Library/FME/2024.1/fme is trying to execute itself. Aborting to avoid infinite loop. I managed to solve it temporarily by reinstalling the whole package, but after a while it started giving me the same error.Ive tried different workspaces from the tutorials with the same result, I imagine is something about the setup. Any suggestions can help, thanks!

100

11 days ago

andrewj74Supporter

asked in Authoring

Esri Geodatabase (ArcSDE Geodb) Writer Parameters for updating metadata

Hi,I have seen a few articles about updating metadata using the ArcSDE writers, which involve writing data and adding metadata simultaneously. However, what I want to do is just add new metadata while leaving the existing data unchanged (without accidentally overwriting it with nothing). I already have my metadata and types formatted as described in the articles I’ve read.xml formatted for esri importHowever, I am struggling to determine the exact settings needed for the writer. Since we don’t have a test system, I want to ensure I’m on the right track before proceeding. That said, I can create some test tables to trial the process. This is a related article which also update the data: https://support.safe.com/hc/en-us/articles/25407507870861-Working-with-Geodatabase-Metadata-Writing-Updating-Metadata Any guidance would be appreciated. I also have an external list that matches my metadata GUIDs to the gdb tables, so my ultimate goal is to loop through all the layers and apply the metad

151

11 days ago

helmoetzContributor

asked in Authoring

Duplicate records reading from zipped open file gdb

Hi this puzzles me: using FME(R) 2022.2.3.0 (20230131 - Build 22789 - WIN64), when reading an Open File Geodatabase from a zip file, features are duplicated. I created and attached a template which demonstrates the error. The workspace uses two readers to demonstrate the phenomena, both of type File Open Geodatabase.The first reader reads from ..\test.zip\test.gdb The second reader reads from ..\test.gdbRecords on the first reader are duplicated. When reading from just test.zip the duplication does not take place. Is this behaviour as meant to be?

261

13 days ago

peteratqfesContributor

asked in Authoring

AttributeWriter and DataStreamer

Hi, If I’m writing a fme-binary attribute out to jpeg using an AttributeFileWriter is there any way to publish as DataStreamer on FME Flow?

222

13 days ago

fbastian73Contributor

asked in Authoring

sequentially looping a workspace using attribute values

Hi,I am wondering if someone can give me some ideas on how I could pass the result of a sql query from a sql executor so that the result or specifically an ID is passed sequentially so that each is fully processed before the next one starts. So the result is as shown below. The attribute I’d like to pass one by one is either the device_id or the row_index.I have had a look at this post iterating/looping a workspace using attribute values | Community but cannot formulate the workbench to do this task.Any suggestions very welcome.Thank you.fb

415

14 days ago

kalbertContributor

asked in Authoring

Replace JobWaiter with HTTPCaller

Hello,FME Flow announces the deprecation of the JobWaiter transformer:2024-9-2 10:59:42 | FMEFlowJobWaiter (ServerFactory): FMEFlowJobWaiter was deprecated in 2024.1.0. Its support lifetime is limited because the v3 FME Flow REST API will be removed in future FME releases. When the v3 API is removed, this transformer will stop working. Please update this workspace to use an HTTPCaller to call the relevant REST API directly instead.Question: Is there any ‘how-to’ with a sample workspace which REST call can be used to replace the JobWaiter functionalities? My sample scenario would be: You have 5 jobs running in parallel (wait to complete NO), JobWaiter polls every 20sec until all 5 job_ids are received and completed. all 5 jobs must have _status SUCCESS before Job #6 is called.I tried GET /transformations/jobs/id/{jobid}/result but it failed with 404. Any hint?thanksKlaus

15512

14 days ago

wilContributor

asked in Authoring

close connection to postgres db after query execution

Connection to postgres seem not to close after query execution to postgres db. We are here allowed to have 5 connections to the postgres db and with the SQLExecution for each feature entering the transformer, a connection is established but seem not to close after the the query has been executed. After 5 features have entered the sqlExecutor I receive an error message: Error connecting to PostgreSQL database.....................: 'FATAL: too many connections for role "xxxxxxx"Is there a way to close the connection after each featue that enters the SQLExceutor? We are using FME 2021.1

sterlaContributor

With a permanent licence fme desktop hit much engines do we have available ?

498

15 days ago

sterlaContributor

asked in Authoring

reutilization of permanent fme desktop Licence in new machine

Hello, In the case of having a permanent FME Desktop license, can it be reused on new machines ( i want to use it only in one engine so i would like to know is it possible to use it in anothe engine), or do we need to purchase new ones?

201

18 days ago

rzel24Contributor

asked in Authoring

GoogleBigQueryConnector Failed to Authenticate

Hello,I’m having a hard time figuring out why a json file created with a Text Writer is not accepted by the GoogleBigQueryConnector.I have an original JSON Key File downloaded from Google Cloud for the Service Account we are using to authenticate to BigQuery. This JSON file works fine and I am able to authenticate and select the Dataset I want to upload data as well as the table in that Dataset.The problem is that since I have to use a system environment variable and specify the service account key file location in that variable in order for the GoogleBigQueryConnector to be able to use Service Account instead of Web Connection, it seems the GBQC takes the project_id specified inside that json file and uses it as default project to log you in, which means that even if you have access to different projects in BigQuery you can only access 1 project per Service Account Key File.Here is an image of the error I get for when the GBQC tries to use the JSON file to authenticate into BigQuery:

505

18 days ago

stuarmitagehomeContributor

asked in Authoring

Flow - How do I configure a published workbench to read all files in a Resource folder

Hi,I have a workspace the reads json files: I need to publish this to Flow, and configure parameters to enable the user in Flow to read files from a certain folder. This will change several times, and I do not mind this part being a manual process.I am unsure of exactly how to configure this.I have set up a Folder and Pathnames user parameter:I have configured it to select Folders, and called this “SourceDataset_PATH”. I have then configured the parameter for the json reader to point at the SourceDataset_PATH parameter. I publish to FME Server, run the workspace: I have used “Browse Resources” to find a folder “Test 1 file” and hit Run.If fails after a few seconds:54 2024-11-13 17:17:27 | The file 'C:\ProgramData\Safe Software\FME Server\resources\data\WACSTEST_1_to_5\Test 1 file' could not be opened 53 2024-11-13 17:17:27 | Opening the JSON reader with source dataset 'C:\ProgramData\Safe Software\FME Server\resources\data\WACSTEST_1_to_5\Test 1 file' 52 2024-11-

274

19 days ago

georgiecContributor

asked in Authoring

Reader is making my schema lower case

I have a series of Feature Services in ArcGIS Online. Unfortunately they contain attribute names of varied case. This is proving difficult for me when I try to create a dynamic workflow that updates the data in ArcGIS online. When the Reader reads the source data (also of varied case), it converts them all to lower case.Therefore, when my workflow tries to write to ArcGIS online, it cannot find matching attributes to write to because the case is different.It is now too late for me to change all the layers on ArcGIS online to lower case because of downstream dependencies. Will I have to write a separate workflow for each individual layer and individually do the field mapping?Or is there a way around this ?

374

19 days ago

georgiecContributor

asked in Authoring

Dynamic Feature Reader - picking up schema for 1st feature type only

From a csv file, I determine the target layers that I wish to update on ArcGIS online.The following 2 transformers build the source layer name deriving it from the csv data.My source data name is an attribute titled “portalservice_andfolder”This is fed to a dynamic reader that reads my enterprise portal for each layer.There’s an issue with the Reader. Refer blue summary for settings.I’m getting all the features come through but only the schema for the FIRST feature type only.Refer the below image which is the result <Generic> port from my reader. The schema port has a count of 1 when there are actually 2 source layers.The image below shows that the fme attributes are missing for the second feature type.I tried throwing in a SchemaScanner after the Reader but still only arrived at one schema. The issue appears to be in the Reader transformer.What am I missing here ?

110

19 days ago

jdhContributor

asked in Authoring

Dynamic raster recoding

Hi,I have a scenario where I need to recode the pixels of raster, but the values are determined at run time.I have a list of from-to values, but what is the best way to implement that?The RasterCellValueReplacer will take attributes, but not a list. Is there any way other than looping through the list and recoding the raster one value at a time? There can be anything between 1 and 300 elements in the list.

494

20 days ago

pgammieContributor

asked in Authoring

Dyanmic ESRI File Geodatabase Writer: Drop and Create not working

I am writing to a file gdb, I will need to run my workbench to update this file gdb each month. The schema of my incoming tables may change so I have used a schema scanner with a dynamic writer.I want to use drop and create for table handling but it is not behaving as expected. Instead of dropping the existing feature class it just appends the entries to the existing table.I am not sure why this is happening. Of note, my feature classes are also within feature datasets. See attached screenshot of writer settings.

636

20 days ago

matiassalinasContributor

asked in Authoring

Esri Geodatabase (File Geodb Open API) in Mac arm64

I’m trying to follow the FME Form course from a MAC and one of the very first exercises is using a Esri Geodatabase (File Geodb Open API) writer. Unfortunately I’m getting this error on the platform. Is there any workaround for this?

543

20 days ago

Page 1 / 122

Badge winners

gabin.jubaulthas earned the badge 12 Days Participant (2024)
slawhas earned the badge 12 Days Participant (2024)
sagowanhas earned the badge 12 Days Participant (2024)
ebygommhas earned the badge 12 Days Participant (2024)
olpotosihas earned the badge 12 Days Participant (2024)

Show all badges

30,229: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.