- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Authoring

Authoring

Creating and organizing workspaces. How to use Workbench.

3,044 Posts
12,605 Replies

When you subscribe we will email you when there is a new topic in this category

3044 Posts

larueContributor

Inconsistent Format When Writing To Excel

Hello,I am struggling with a similar problem as this post (I think?). One of my attributes in the Workspace contains a 0 or 1 that is used as a Boolean. The value has been assigned the datatype ‘buffer’ in AttributeCreator and ‘string’ in the FeatureWriter, which outputs an Excel file. I am using a template, where the cell format is set to ‘General’.For some reason, the Excel file that is generated will give me inconsistent formatting of the attribute value: What is going on here??? As you can see, even though they all should be interpreted as strings, some of the values become numbers. The formula bar does not show anything different. I started using the Excel template in hopes of making the data format consistently, but even when I changed the cell format to ‘Text’ it still gave me issues when being read by Python. I would like to solve this issue before reverting to a Yes/No or True/False format. What could be causing this? Any insight is appreciated. -Thanks

886

1 month ago

vxn43Supporter

asked in Authoring

Writing to spreadsheet question

Hello, All my data is in Excel spreadsheets. All the schemas are the same.I have two readers:The Updates Reader includes the 3 records that have been changed. These 3 records already exist in the Address Reader spreadsheet.The Address Reader is the original spreadsheet that includes these 3 records before they were updated. I would like these updates written to the Addresses Writer which creates a new excel spreadsheet with the 3 records updated but no new records added. In my workbench here, I run it, and the results are the 3 records are added to the 95,393 thus the new spreadsheet has 95,396 records in it. Having the 3 records added results in having 6 duplicate records whereas previously there were no duplicate records. I need the Addresses output to be 95,393 records with the 3 records I mention previously updated. I have tried changing all the parameters in the Writer with no success. The results are always the same, 95,396.I know I can use FeatureJoiner/FeatureMerger, but is the

171

1 month ago

gisgeekContributor

asked in Authoring

Scraping data from a map

Hi there I would like to scrape the data from this page. So want the lat/longs of the pins on the map and the background water outage data. I can't find an easy way to scrape the data and am just going around in circles trying to extract the data. https://www.ccc.govt.nz/services/water-and-drainage/water-supply/maintenance-and-repairs/water-status-map/#12

604

1 month ago

fmebeginnerContributor

asked in Authoring

Adding dynamic date string suffix using BulkAttributeRenamer

Hello, I’m trying to dynamically add a suffix to selected attributes using BulkAttributeRenamer. I want the suffix to be the day the script is run and expressed in YearMonthDay.Example: the attribute is “addresses_count_“ and using the BulkAttributeRenamer and running the script on the 24.10.2024 I want it to be “addresses_count_20241024”.I tried using UserParameters. The first parameter I made was a Text Type Parameter where before the script is run the User needs to input by hand the Date. It has a few flaws. For example, the user may enter the wrong date, the date is not entered automatically by the script and will not always be processed correctly by BulkAttributeRenamer.The second UserParameters I made and think it is the right way to do it is a Scripted Type Parameter. Below you can see what I made.I have not been able to get this to work using the BulkAttributeRenamer. Even when I select the string to be a UserParameter it doesn't seem to add and generate a correct date string.

646

1 month ago

tvaContributor

asked in Authoring

Get authentication token via JWK/JWT

I need to connect to an api that requires a bearer token in the header for authentication.This token should be generated with a jwk. Example to request a token (there are public available examples from the service, so no secrets from my side):POST /op/v1/token HTTP/1.1Host: authenticatie.vlaanderen.beContent-Type: application/x-www-form-urlencoded grant_type=client_credentials& audience=8ed36a78-8443-11ec-b334-83e86b606670& audience=9e6a512c-8443-11ec-ae2c-8700eb2a0cde& scope=org_api_appread%20org_api_appwrite& client_assertion_type=urn%3Aietf%3Aparams%3Aoauth%3Aclient-assertion-type%3Ajwt-bearer& client_assertion=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiIyODM1ODgxNC01YzIwLTRjMTMtYmJmZi1kYjVkZDhjNGFlOTMiLCJzdWIiOiIyODM1ODgxNC01YzIwLTRjMTMtYmJmZi1kYjVkZDhjNGFlOTMiLCJhdWQiOiJodHRwczovL2F1dGhlbnRpY2F0aWUudmxhYW5kZXJlbi5iZS9vcCIsImV4cCI6MTU5MjIwODA2MCwianRpIjoiRGt6bmpzdTQzZHprZDN6amQ1IiwiaWF0IjoxNTkyMjA4MDAwfQ.3dPodaVhJ2d3cXWn0v2YGeZqs5XScJF2lm4MaweDnf4 the

Open multiple tabs in workbench

Hi FME users, I have only been using FME for a short while, so please bear with me if this question is very basic. I remember seeing in several example screenshots of the workbench having multiple tabs open rather than just the default "Start" and "Main" tabs. I can imagine it would be very usefull to be able to toggle between different workspaces in the same workbench but couldn't find how to do this. Could anyone please share any experience on this?

2433

1 month ago

vkiContributor

asked in Authoring

Error connecting to Oracle-DB, but only on FME Form (FME Flow ok)

We recently updated to 2024.1 (FME Form and Flow).We have some jobs, that run daily on FME Flow, that read features from an Oracle-db and write to a PostGIS-DB.I downloaded one of the workspaces to FME Form to change something. But in FMEForm I cannot connect to the Oracel-DB anymore. I get this error:Error connecting to Oracle database: message was `OCI_INVALID_HANDLE'. (serverType=`ORACLE_NONSPATIAL', serverName=`xy', userName=`xy', password=`***', dbname=`')I uploaded the workspace again to FME Flow and there it ran successfully.Any ideas, what could be the problem? Thanks in advance.Vera

WorkspaceRunner tutorial update

Hi folks, I think this very useful article on the WorkspaceRunner could use some love:https://knowledge.safe.com/articles/1469/batch-processing-using-the-workspacerunner-1.html"Article created with FME Desktop 2013"I believe FME has evolved somewhat since those screenshots were made :-)

1195

2 months ago

scarterContributor

asked in Authoring

Snap a point to nearest line based on shred attribute value

Hello Forum, I need to create a point layer of middle points of streets. I have a street network (lines) where each object is attributed with the name of the street. I tried coordinateExtractor, which does produces points on the line. However, in the vast majority of cases it selects the starting point. But I need the middle point of each line. So, I then used CentrePointReplacer to create the centre point of the each street’s bounding box. This works but it finds, unsurprisingly, the centre point of the bounding box. These bounding box centre points -unless rarely through extreme coincidence- are not actually on the street itself. I need them to be on the street. So, I now need to snap that point to the nearest street using the shared attribute value. For example, it look at the point record for Acacia Avenue in the bounding box centre points dataset and then snap to the nearest location in the street network where street name equals Acacia Avenue. I’ve looked at NeighborFinder and An

717

2 months ago

checcosisaniContributor

asked in Authoring

Web scraping

Hican you hlep me to understand if I can extract info from this webpage https://viabilita.autostrade.it/it/viabilita/previsioniWhat I need is the info in the blue boxthxFrancesco

Aggregator transformer issues when concatenating attributes with null or missing values

I'm using an Aggregator transformer to group by an attribute and concatenate many attribute accordingly. I'm having a problem with the attribute column containing missing or null values. The Aggregator will populate the attribute containing missing or null values with the separator character when it should stay empty or null. Is this a bug? I've replicated the problem in the screenshot below

2127

2 months ago

peteratqfesContributor

asked in Authoring

What is the most efficient way to find intersecting polygons for a bunch of points?

Hi I’ve got a bunch of points (1 to maybe 40+) that are changing regularly (live data), and I want to find out which polygons those points are intersecting. They are big polygons with lots of vertices. What is the most efficient and/or fastest way to do that?Should I:Have a SQL Spatial Reader and read all those polygons and use a PointOnArea Overlayer transformer. Use a FeatureReader with a Spatial Filter Initiator OGC Intersection and use a PointOnArea Overlayer. Should I use a SQLExecutor and rely on the database?I’ve tried the first two and I’m not sure which is best.Thanks

939

2 months ago

kanteyemaodoContributor

asked in Authoring

points isolés fme | Isolate Points in FME

j’ai deux couchesUne couche de points (ponctuel) et couche de lignes (linéaires).je veux vérifier les points isolés ou non connectés de ma couche ligne.solution svp.en pièce jointe les supports (points) à vérifier qui ne sont pas connectés aux lignes (tronçon). I have two layersA layer of points (point) and layer of lines (linear).I want to check isolated or unconnected points of my line layer.solution please.attached the supports (points) to check which are not connected to the lines (section).

9220

2 months ago

marchpirismObserver

asked in Authoring

Issue with Lost Progress in FME and Autosave Concerns

Today, when I opened FME, I was surprised to find that none of my recent progress had been saved. I’ve been working on this project daily, usually leaving my computer on standby overnight. Every day, the project would reload without any issues, and even when I manually closed FME, the recovery pop-up would appear, allowing me to restore any unsaved changes.However, today, FME didn’t offer the recovery option, and my workspace loaded without the latest changes. It was quite shocking. After some troubleshooting, I discovered that if you copy the workspace to a different directory and open it from there, the recovery option reappears. I did this and managed to recover my work, but I’m concerned that what I recovered might only be the most recent autosave, which was generated after I started investigating the issue.I'm wondering if there’s a solution to prevent this from happening again, or a way to retrieve the exact progress I lost.Additionally, is there a way to configure FME to automat

342

2 months ago

karnilContributor

asked in Authoring

localize data at any point in the script?

This is supposed to be a quality of life improvement when working with unreliable data providers or when you have unreliable internet connection. I hope this functionallity exists in FME already but I could not find it.I am trying to make a custom node that saves the data stream it intercepts locally and reads that data instead if the original source doesnt come through. There are two problems that I have been unable to solve. One is that i have to run the script with feature cashing to get it to save the files and there is an error upon saving, it does not seem to understande the grouping for some reason:localize_data_2_FeatureWriter (WriterFactory): Group 2 / 2: MULTI_WRITER: No dataset was specified for MULTI_WRITER_DATASET or localize_data_2_FeatureWriter_0_DATASET or FFS_DATASET So as the image suggests the custom transformer saves the data stream here at 3 points. It dynamically creates local files named by the customTransformer instance name and with dynamic schema.The second pr

603

2 months ago

conchContributor

asked in Authoring

HTTP call syntax to retrieve OSM data

HiI’ve been constructing http calls to download OSM data to a .OSM file, then reading the downloaded .OSM file via a FeatureReader to generate specific outputs (yes, I know there are downloadable OSM transformers but they don’t do what’s required here).The specific problem I’m having is, not returning way or relation items into the downloaded file (if this is possible).Looking for assistance regarding the http call syntax. Below is what I’ve tried but still only returning point features (same results for both).https://overpass-api.de/api/interpreter?data=[bbox];node[building];out;way[building];out;relation[building];out;&bbox=@Value(_xmin),@Value(_ymin),@Value(_xmax),@Value(_ymax)https://overpass-api.de/api/interpreter?data=[bbox];nwr[building];out;&bbox=@Value(_xmin),@Value(_ymin),@Value(_xmax),@Value(_ymax)

693

2 months ago

timwarfeContributor

asked in Authoring

SharePoint Online Migration

Has someone please done a file transfer migration from one Sharepoint Online location (Site) to another Sharepoint Online location (site) and also keeping the original file Metadata, including created date, etc.. Using FME Form?

211

2 months ago

lifalin2016Contributor

asked in Authoring

Python executable and site-package folder in various versions (e.g. 2022.2.6) ?

Hi.Is there an authoritative list somewhere of which versions of FME uses which versions of Python ?So far I have: 2020=3.7, 2021=3.8, 2022=3.9+3.10, 2023=3.11, 2024=3.12I’m assuming that the Python executable is located in [FME_ROOT]\fmepython###\python3.exe (or the dll’s). Is this correct ?And where is this executable’s site-packages folder located ?Is it at [FME_ROOT]\python ? Or [FME_ROOT]\python\python312 ? Or somewhere entirely different ?And is this location the same in an FME Engine for Server/Flow ?I’m contemplating adding a special Python package for use in both desktop and server.Cheers.

222

2 months ago

stuart_misoParticipant

asked in Authoring

Use existing Oracle table schema for writing into csv

I have a whopping great big table in my workbench with 2100 attribute fields in it! 😯The data originates from JSON files, and I need to write it into several csv files.The csv files need to pick up the schemas of tables in an Oracle db. These tables have a couple of hundred attribute fields / columns in, so many of my attribute fields will be dropped from the massive table in the workbench when creating the csv. This is good!The Oracle tables do not feature in the workbench at all, so I just need to grab the schema of the existing tables, bring them into the workbench, and use them in the csv writers.I’ve tried to use Schema Scanner, and Schema Mapper but with no luck. I am sure the answer must be really simple and I am doing something wrong.Any help will be much appreciated.Stuart

383

2 months ago

parke372Contributor

asked in Authoring

XLS->XLS - copy validation formulas?

I am looking to have a workspace run by a workspace runner to parse out some data to be grouped by individual tabs based on an attribute name.i have an excel workbook with a dozen or so sheets, each sheet is a type of mechanical system with 3 columns - Column A is BLD which is a string building name. Column B is System Type which had data validation in place with named table references and Column C is System Name which is a string value.i am using a feature reader with the read formulas checked:i want to have the workspace runner pass a value for BLD and search all of the sheets for matches - for instance, it looks something like this once run: The workspace is finished, except for the writer - i want to create a new workbook for each unique BLD feature and copy from an excel template that has the existing named ranges for the various data validation lists from the original read file - however, i can’t get the validation to copy, nor the sheet with the named ranges.my writer is set up

How to count FeatureWriter transformer's output into "Feature Written Summary" of the log?

Hi! I have a FME workspace using FeatureWriter to write record to some tables. When running it from desktop, it populates the tables as expected. However, if I look at the log after job is completed, the "Features Written Summary" section at the end seem to be misleading by show "0", while I know that there are actually features written.Do I need to do any change in my FME workspace to add the count to the summary? Thank you!Below is the summary part of the log:Below is the part of log for FeatureWriter, which does give the count:

10611

2 months ago

p15rajanContributor

asked in Authoring

Raster Image -- Radiometric Calibration and Atmospheric Correction

Dear All, Could you please let me know is there any transformer to do Radiometric calibration and Atmospheric correction in FME? Kindly let me know the details. Thanks, Siva

632

2 months ago

salvaleonrpEnthusiast

asked in Authoring

Creating an attribute that accumulates count of duplicate values (sequentially)

I was able to do a cumulative count of duplicate values (where duplicate is “-1” only) using a Group By on a Counter transformer shown below. (Added note: I should have added this to remove ambiguity - SORRY. The output as shown below in the Preview is the desired output. I only care to know the number of consecutive sequential values when the value is “-1”. If the pattern changes and another series of duplicate “-1” appears, the count starts with “1” again. I don’t care if the pattern for duplicate values are greater than “0”, like “2420” on the Preview.) Since I have more than a dozen of these attributes, I’d like to use an AttributeCreator instead but I can’t seem to use the CurrentAttribute() to accumulate duplicate values.In addition, everytime a sequence of “-1”s begin (as shown in row 143 above), count starts at 1 again.Any suggestions?

8910

2 months ago

scarterContributor

asked in Authoring

Finding and replacing a null value with a blank. Possibly with StringReplacer

Hello Forum, I have an attribute in a gpkg dataset containing year values (e.g.: 2016). Where a year is unknown the value is <null>. When this dataset is translated into tab or geojson any values of <null> get shown as -9999. I assume that's how the MapInfo tab translator sees <null> values. But instead of -9999 this I want any <null> value to be blank. With StringReplacer I know I can replace a value such as 2016 with 3016, not that I would want to do that!. But when I type in <null> as the 'Text to replace' and leave 'Replacement text' blank, the output still shows -9999 instead of it being blank. I wonder if there is a special way of specifying <null>. How do I effectively replace <null> value in an integer attribute with blank? I've seen https://community.safe.com/transformers-9/replace-value-with-a-null-1778 but that doesn’t quite cover it. Thanks,Stuart

6310

2 months ago

jp12212Contributor

asked in Authoring

How to print a raster view of a dwg surface isometrically as a png

Can you provide guidance on how to convert a DWG file to a PNG image and then embed that PNG into an HTML PDF using FME? Specifically, I'm interested in preserving the visual elements like colors, hatch styles, and line widths from the original DWG file.Here are my transformers.Thank you.

261

2 months ago

Page 3 / 122

Badge winners

gazmanhas earned the badge Welcome Back
miguelhacarhas earned the badge English Speaker
miguelhacarhas earned the badge Spanish Speaker
miguelhacarhas earned the badge Student (Grey)
miguelhacarhas earned the badge Expert (Grey)

Show all badges

30,351: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.