- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
General

General

A read-only category for lost FME Form topics. We hope to move them shortly.

4,032 Posts
13,815 Replies

When you subscribe we will email you when there is a new topic in this category

4032 Posts

I have a workspace that can sometimes generate some NaN-valued Real64 data types (from the surface draper specifically). I'm really struggling with how to handle these. FME seems very inconsistent with how I can test them. I would like to test for them and terminate the workspace if they are found. So far I have tried:Attribute Validator by type (numeric)Attribute Validator by 'Has a Value' Attribute Validator by 'Not Null' Tester by all of the above The only thing I was able to get to work is a tester using @abs(@Value(MyMaybeNANAttribute)) < 0.00000000000000000000001where I just used the number on the right as an arbitrarily small floating point number. This evaluates to True for my nan values, so I can filter them out. However, this is not a good workaround because I can have valid zero value in some cases. I have searched the forums and the articles and I have not had a good explanation of how NaNs are handled in FME. Is there a way I can catch these with a data validator or a

1380

1 year ago

klingdomContributor

asked in General

Does Dissolver Dissolve separated polygons?

We have short Workspace to update attributes and geometry (polygons) and added the Dissolver transformer, but when run the polygons are not Dissolved. When run we get more tract in the output than when in. Cannot see why this is not striate forward. Thx

Bson (Binary Json) to Json conversion

Hey Everyone,I am a newbie in FME wonderland can anyone help me out how can I convert bson to json. I am using http caller to get data from our asset management system named Alloy by Causeway. Al the data is in bson format and i don't know how can I convert that into usable format. All the data is sitting under _response_body. Let me know if anyone can help or want any more details :)

Polygons with touching rings -> row expansion in PostGIS

I’ve been wrangling a large number of Shapefiles recently (almost half a billion!), converting them to a PostGIS database. A small command file calling FME (with return code checking) was just the trick and, after several days of processing, the job was done. The problem is… my record count on one of the output tables is larger than expected. ☹ After some research and experimentation, I’ve discovered that if you pass a polygon with bad geometry (in my case touching rings, which is fine in a Shapefile), it causes multiple records to be written to a PostGIS table! So, if a record has a polygon with 3 rings, not overlapping but touching, it would be expanded to 3 rows in the output table. FME does not report this in its output summary, which makes be suspect it’s a PostGIS behaviour in trying to deal with the bad geometry. Fortunately, in my case, any additional rings are always artefacts in nature and can be discarded, so my main question is how can I set a polygon to be its first ring o

310

1 year ago

vkiContributor

asked in General

Most of our automations are started by a FME-Server Schedule-Trigger. I would like to make a list with all automations and their start-times. I can get a list of all automations with the REST API, but how could I get all the start-times? Thanks, Ve

Access Token Validation Failure - Invalid Audience error with SharePointOnlineConnector

Hello!I've been struggling with the SharePointOnlineConnector transformer for a couple days now. I have set up a web service following the official tutorial (first I've set up one for Sharepoint List, then an identical one from the Sharepoint Online template as well). When using a Sharepoint List Reader I can successfully access the lists, but I can't access anything from the SharePoint Online Connector. I get the following error: "SharepointOnlineConnector: Error making request to https://graph.microsoft.com/v1.0/sites?$select=id,webUrl,name&search=: Access token validation failure. Invalid audience." The app I've set up in azure has the following permissions (might be overkill, but I'm just testing for now):Microsoft Graph (5)Sites.Manage.AllSites.Read.AllSites.ReadWrite.AllUser.ReadUser.ReadWrite SharePoint (7)AllSites.ManageAllSites.ReadAllSites.WriteMyFiles.ReadMyFiles.WriteProject.ReadProject.Write What am I missing here?Thanks in advance!

2260

1 year ago

gogopotter90Contributor

asked in General

How to extract layer names and each tables name related to each layer from mxd file

I have mxd file and I would like to extract layer names and each table names related to each layer FME 2021 Thanks in advance

383

1 year ago

thomastupuivaoContributor

asked in General

Can FME read a file on a UNIX server file directory?

I have a text file that is created in an Oracle database and output to a folder on a UNIX server file directory. Can a FME workspace read a text file from this type of location?

210

1 year ago

graysonContributor

asked in General

removing typos & matching meter IDs from two different datasets

Basically, I want to match meter IDs from two different datasets: shapefile and excel file. Meter IDs in both datasets might have typos such as dashes, dots, letters, slashes, which I need to remove first. Then I want to match MTR_NO from Excel against Mother_1 , Child_3, & Child_4. My idea is to export an excel table that will include only matching meter IDs.

is there any reader where i read the Google analysis data ?

520

1 year ago

tb09114Supporter

asked in General

How to get complex annotations interpreted, or is there a possibility to (re)-create the 'labels'?

Within ArcGIS Pro 3.1 I am creating annotations with the help of Arcade (a lightweigth expression language). The outcome is as shown below, basically a fractionWhen I read the annotation layer from the file geodatabase, FME does not interpret the HTML tags in the text string, but counts them as part of the text.I there a way to make FME interpret these tags correctly? My final product should be a dgn file with a level holding these 'labels' and I was wondering if that is possible, and if I can achieve this with FME. The 'fracture' consists basically of three parts as I see it:nominator that is underlinedline breakdenominator without underline

251

1 year ago

markcoopersdcContributor

asked in General

Finding all date attributes in a table

Hi I am reading various tables from Oracle each of which contain many date attributes. Is there a transformer that will allow me to filter out all the attributes that are have a type of date as I want to check the dates make sense (I know there are some with some very dodgy data in and wont write out to a sql table) Thanks

100

1 year ago

gogopotter90Contributor

asked in General

How to find tables that has common id from oracle database ?

Hello , i have around 800 tables at my oracle database and I would like to ask if there is a method that I can find which tables has the same object id .i think ,if I read each table then use feature merger between one table and others and so on .it will take time is there a quick method that compare between all tables and eachother to find which tables has common id and show me the name of tables that has common id.my target to find the name of tables that has common id.FME 2021

3190

1 year ago

mattwilkieContributor

asked in General

How to control order of execution?

In Ideas @bilal said "One of the benefits of having a creator attached to such a transformer is the ability to define the order that the creators run in a workbench." https://community.safe.com/s/bridea/a0r4Q00000HbroNQAR/dont-require-creator-for-transformers-that-read-data How?

FME Server Run Workspace fails without error message

We are running desktop and server at version 2022.1.2.0 (20220831 - Build 22627 - WIN64). One particular workbench that we published runs to completion in desktop, but fails in server. I've checked some other cases and articles (such as this one), but none of the causes (including available memory) or workarounds seem applicable.When reviewing the job's log it seems to consistently fail at this step:156 2023-5-4 15:09:41 | AttributeFilter_NBI <MISSING> Transformer Output Nuker (TeeFactory): Cloned 0 input feature(s) into 0 output feature(s)157 2023-5-4 15:09:41 | AttributeFilter_NBI <NULL> Transformer Output Nuker (TeeFactory): Cloned 0 input feature(s) into 0 output feature(s)158 2023-5-4 15:09:41 | StringFormatter_NBI_Leading_Zeros_2 (TestFactory): Tested 7132 input feature(s) -- 7132 feature(s) passed and 0 feature(s) failed159 2023-5-4 15:09:41 | GeometryRemover (TeeFactory): Cloned 1238 input feature(s) into 1238 output feature(s)160 2023-5-4 15:09:41 | StringFormatter

FME Server Windows Single Sign-On

Hello, Recently we attempted to adopt single sign-on through our Windows AD. However, we are having difficulties getting it to work. I have followed the steps outlined by: https://docs.safe.com/fme/html/FME_Server_Documentation/AdminGuide/IWA.htm It worth noting that we have also switched our server to using HTTPs Whenever a user clicks "Use windows credentials" they get an error "Login failed, please try again". Its worth noting if a user manually inputs their AD credentials, the login is successful. When checking the fmeserver.log file I do see the message "Unauthorized request by user <User> due to lack of proper permissions or the object does not exist." I have also noticed that when using the generate token URL:https://<fme server name>/fmetoken/sso/generateI get an error 403 "forbidden" (this is the URL set in the propertiesFile.properties) Just to reiterate manually entering the AD credentials works without any issues, only whe

1110

1 year ago

jdhContributor

asked in General

OSM PBF reader Map Features vs Feature Types

I was experimenting with the OSM PBF reader, and I noticed that I get different results when I filtered on the Map Features vs the Feature types. In my sample data, if I selected building in the OSM Map Features, it read in 47691 features.If on the other hand I left the Map Features blank and selected building in the Feature Types to Read, only 45050 features were read in.Thoughts on why the mapping is different? I assume it has something to do with Multiple Map Feature Resolution, and I would expect extra features if it was set to Duplicate Features, but since it was Use First, I'm at a loss.

Need to extract date from DateTime field using FME but not working

The List Date in the bottom photo contains a field called ListDate which is stored in a SQL database. We're using their WFS to download the data however due to the validation in Pro we can't see any date fields so we're using FME. I'm trying to use the transformer 'date time converter' but I get the prompts asking which fields I want & as you can see the software is splitting out 1 field into several which are all 'missing'. Which list elements should I select? Also in the select list elements box what number should be entered there? I just need the date so can strip out the time element.

1967

1 year ago

albjohContributor

asked in General

Is there a similair function as DateTimeNow() which takes only the current date and not the time part? I know I can make use of Timestamper but I'm curious if there are other even more simple ways of naming by date in the writer using Date function

What is this error: '-2147216081'. The error message from ArcObjects is: {Invalid SQL syntax [[SAP AG][LIBODBCHDB DLL][HDBODBC] Syntax error or access violation;257 sql syntax error: incorrect syntax near "CONDITION": line 1 col 300 (at pos 300)::420

I get this error periodically when running a workbench copying from Oracle to SAP HANA. Only a handful of tables here and there, I've yet to establish a pattern. There are no issues with the permissions, and no queries left in the tables on the Oracle side, as far as I know.

Read data from a secured website

Hello,I have several website from which I need to read data, mostly stored in tables.For the public website, no issue as I am using I am trying to reader 'HTML Reader'.For the secured website, the sequence would need to navigate first to the login page, (https://members.embuild.be/fr/user/login)enter credentials, navigate to the secured page containing the desired table and read the html table.After reading several posts, my designed workflow would:HttpCaller URL: https://members.embuild.be/fr/user/login, method: POST with body 'Mulitpart / Form data' and the upload: Name - Type - Value = name - String Upload - my@email.com and Name - Type - Value = pass - String Upload - myPassword.HttpCaller (En Serie from the first one), URL: https://members.embuild.be/fr/chiffres-et-donnees/indices/cout-des-materiaux/indices-des-materiaux, method : GET, Save response body to an attribute....Unfortunately, I cannot go thru the first step. http status code is 200 OK, but the response

120

1 year ago

boubcherContributor

asked in General

Consume WebSocket stream from FME into Arcgis Geoevent

Hello there I have a published workspace that generates WebSocket stream, and I need to consume the data into ArcGIS geo event using input (subscribe to an external web socket for JSON ) I cannot figure out the URL structure that should be used to expose the WebSocket stream to an external app. This web socket configuration and this is the Geovevent configuration. Note: I need the correct URL to put in the (remote server websoket) filed

550

1 year ago

mattwilkieContributor

asked in General

How to interpret `_response_body` from http call as content?

The Reading JSON tutorial demonstrates using Feature Reader to fetch and parse data from a bare url. However I need to fetch from a url that requires a token in the http header. I've used HTTPCaller transformer to do this successfully and I have json data in `_response_body`. However when I feed response body to FeatureReader it treats that as a *path* and not *content*. (It took me hours to figure out this what the error message meant). How do I read the `_response_body` from the http call as *content*? https://community.safe.com/s/article/json-reader-configuration

Getting an error when passing an empty value to the Published File/URL parameter

I am updating an older FME script (2019) to 2022.1, and am getting an error when passing an empty value to the published File/URL parameter, even though it has not been checked as Required. The error message is: No CSV2 dataset name was specified (couldn't find a value for `R_2_DATASET' or `CSV2_DATASET'). This seems to be a new issue with 2022.1 version, as I am updating the script from 2019 version. Is there a way around it?

PythonCaller - variable as buffer

I would like to implement a variable as a buffer. However, once I define the variable, it does not get updated. For example: The variable has to act like a buffer.. At the moment, I have the variable implemented in the def but I think this is wrong. def buffer(feature): puffer = 'leer' for i in range(0,50): if puffer == 'leer': feature.setAttribute('value', value2) puffer = 'value2' else: feature.setAttribute('value', value3) For this example, I get always the Result from feature.setAttribute('value', value2). I have also tried to create a class withdef __init__(self) and Input and close.But I don't get a Result.The result should be written in the attribute table of a shapefile Can anyone help me?

160

1 year ago

Page 30 / 162

Badge winners

rwjbsnahas earned the badge Expert (Grey)
rwjbsnahas earned the badge Teacher (Grey)
rwjbsnahas earned the badge Student (Grey)
sam25has earned the badge Expert (Grey)
sam25has earned the badge Teacher (Grey)

Show all badges

30,386: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.