- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form

FME Form

A space to discuss FME Form

27535 Posts

Recently active

Most replies Most views Newest first

apence231

asked in Data

Always create excel file even if data is empty

I'm creating a new excel file nightly and some nights there will be no data to populate the excel file, but I need the file to be created anyways. Is there a step in the Excel writer that I'm missing to do this?

1016

5 months ago

sarah.h.aContributor

asked in Transformers

HTTPCaller - API Limit Reached!

Hi all, Yesterday this worked fine, but today its returning ‘{ "success": 0, "errorMessage": "API Limit Reached!" }’ in _reponse_body column? What do I need to do to resolve this issue? Thank you in advance!

FeatureWriter silently dropping bad features and total features written count is wrong

Hi,I'm using a FeatureWriter to insert data into a PostgreSQL database. When certain features can't be converted into the desired data types, FME drops them without terminating the translation.The logger gives a message in blue:"Value of attribute 'test' could not be converted to type 'bool'. Feature will be logged and skipped" However, the issue lies in trying to capture this scenario and terminate the translation.Despite dropping some features, the FeatureWriter when outputting the summary feature still contains the FULL COUNT against the '_total_features_written' attribute. I was intending on comparing this number to a count of incoming features to check for a difference. Now the only other way I can think of is querying the database immediately after and getting the written feature count that way. I guess I have two questions:1. Is there an inbuilt way to halt the translation when a feature is dropped like this?2. Is the _total_features_wri

16313

5 months ago

zentnerfabianContributor

asked in Data

Compare FileGeodatabase in FME?

Hi guys,is it possible to compare two filegeodatabases in FME? In each fgdb are 443 feature classes (points, lines and area feature classes). After some testing with the first vesion of the fgdb, we had to update the fgdb in some feature classes and changed some attribute fields and add some new domains and values. Is there any transformer which can show me the differences between both fgdb’s?Thanks for answering in advance.Cheers,Fabian

692

5 months ago

tcnkContributor

asked in Transformers

Can the TINGenerator be used with geographic coordinate systems?

In ArcGIS Pro a TIN can be created using the “Create TIN” tool. The usage notes of the tool say that it should be avoided to use a geographic coordinate system when creating the TIN, as the Delaunay triangulation might not work correctly when the coordinates are in angular units.The “TINGenerator” transformer in FME does not provide such a usage note in the documentation. Does this mean that the “TINGenerator” transformer can create a TIN without problems when the input dataset is in a geographic coordinate system or is it also recommended here to reproject the input data to a projected coordinate system first?

612

5 months ago

scarterContributor

asked in Authoring

Creating three output ports in one featurereader when reading in three csv files

Hi forum, I’m trying to do something I successfully used many times before. But for some reason it’s not working this time. I’ve delved into it and done research but I can’t work it out. It’s a really simple thing. I just need to read in three csv files with identical schemas into one FeatureReader. I have a Creator, connected to a FeatureReader. In the FeatureReader I’ve selected CSV as the format. In Dataset I selected the three dots (…), browsed to the data source location and then selected the three files. So, now in Dataset I have this: "E:\FME temp source data\Scratch\TestPoints\one.csv","E:\FME temp source data\Scratch\TestPoints\three.csv","E:\FME temp source data\Scratch\TestPoints\two.csv" In FeatureReader I have ‘One per feature type’ selected in Output ports. But, when this is read in, only one output port is created in the FeatureRader. That one output port is called csv and it includes all the records from the three inputs in the one output. How do I force it to create

825

5 months ago

stevenjhContributor

asked in Data

WFS reader truncates response and fails

I'm using a FeatureReader to read a wfs service and getting strange failures.The following error is being loggedHTTP transfer error: 'Failure when receiving data from the peer'XML Parser error: 'Error in input dataset:'https://data.linz.govt.nz:443/services;key=xxxxxxxxxxxxxx/wfs/layer-53382?SERVICE=WFS&VERSION=2.0.0&REQUEST=GetFeature&TYPENAMES=data.linz.govt.nz%3Alayer-53382&NAMESPACES=xmlns%28data.linz.govt.nz%2Chttp%3A%2F%2Fdata.linz.govt.nz%29&BBOX=-36.939824852066955%2C174.70954193086246%2C-36.91494916200109%2C174.76090622708065' line:1 column:121683 message:unexpected end of input'The XML Module halted on error, see the logfile for details<WFS> An error occurred while reading a GetFeature response, to ignore the error and avoid losing the previously read features, set the WFS "Ignore GetFeature Error" parameter. Total features downloaded: '0'A fatal error has occurred. Check the logfile above for detailsAccessing the link and checking the file manually

141

5 months ago

tschoppenhofContributor

asked in Authoring

Correct Settings and Parameters for Database Connection SAP Datasphere

I’m trying to connect to our SAP Datasphere but can’t establish a working connection. The settings and parameters are similar to the ones i used with were i could get a connection. There is a Proxy Server involved.Any ideas what i have to do different to get working Database connection?Not shown in the screenshot is the parameter proxyPassword

1292

5 months ago

bijantContributor

asked in General

12 Days of FME 2022 data lost

Not sure which forum to post this in, feel free to move it if not relevant here. I'm revisiting the 12 Days of FME 2022 challenges, which were great fun last year and i wanted to challenge myself again this year. (https://community-fme-server-support.fmecloud.com/fmeserver/apps/FMEUCCommunityCafe/12Days-Details/streaming/fmedatastreaming/12Days2022/ContestDetails.fmw) It seems that the datasets aren't available anymore though. Does anybody have the input datasets for each of the challenges that they could share please?

233

5 months ago

proteveContributor

asked in Data

after exporting shp to gdb features are missing from gdb

I have manage to export shp in file geodatabase with datasets but now it seems that i have a strange problem (or bug).every shp that i have exported is missing 1st entry in geodatabase. lets say a shp file has 10 points then i’ll get only 9 points in gdb and the one is missing is always the 1st pont in shp file. every shp file is missing that 1st entry.the strange thing is that fme shows in information that it wrote all entries that the shp files has but somehow 1 is missing.there is absolutly no error in logs. i get some info about some fields that i don’t export anyway. i really have no idea why this is happening.the shps are also exported with FME from othe types of data.for writer i use Esri Geodatabase (File Geodb Open API) with some schemas that i read from a template database with featurereader and join it on shps (no schema was readed).so what im doing wrong?why there is no error about the missing entries?

1479

5 months ago

bgeorgesContributor

asked in Authoring

Clipping large raster incomplete result

I am trying to clip a ECW raster by a rectangle polygon but the inside output is incomplete. Only a small slice of the ECW is in the output as you can see below.Is there something I am doing wrong? FME 2023.2Thank you for your help

653

5 months ago

mark2atsafeSafer

asked in General

The Twelve Days of FME 2020

Welcome everyone, to the Twelve Days of FME Contest for 2020. A series of challenges will appear over the coming month. The links are below. You can enter any challenge, all challenges, or none at all (though then you won't win any prizes). And there are a lot of prizes! We're not sure exactly what they will be, but I can guarantee prizes for each challenge. So take a look at the current challenge and don't forget to follow this page so you receive new updates! Challenge 1The Puzzle of the Extra Partner (CLOSED)Challenge 2The Puzzle of the Holidaying Lizards (CLOSED)Challenge 3The Puzzle of the Hidden Twitter Message (CLOSED)Challenge 4The Puzzle of the FME Art Gallery (Part 1) (CLOSED)Challenge 5The Puzzle of the Viral FME (CLOSED)Challenge 6The Puzzle of Santa's Sleigh (CLOSED)Challenge 7The Puzzle of the Obscure Transformer (CLOSED)Challenge 8The Puzzle of Santa's Faulty Warehouse (CLOSED)Challenge 9The Puzzle of the FME Art Gallery (Part 2) (CLOSED)Challenge 10T

257

5 months ago

spalkarContributor

asked in Transformers

Provide range to 'distance' parameter in NeighborFinder

Hi All,I am new to the FME Software and have a small question related to NeighborFinder.We have points and contour tables in Arcsde Geodatabase. We are finding points near contour by providing specific distance say 20 in neighborfinder In actual case distance is varies like in some cases nearest contour is at 30 , some contours at 40 etc. How do I tell to neighborfinder that select a point which is near by contour having distance in between 10 to 40 ?. In SQL if we use between operator then we are getting values so similar I want to use this for neighborfinder Below is the screenshot : What I tried so far : Creating Custom parameter On Web found below useful posthttps://www.baooytra.com/knowledge/questions/52143/using-neighbor-finder-with-condition-neighbors-att.html?smartspace=automations-fme-serverAny inputs/suggestion on above would be great !!thanks in advance !!

561

5 months ago

takanakaContributor

asked in Transformers

FeatureMerger turns nulls/missing into asian characters

Hi,Unfortunately i cannot provide the test data due to confidential data. I also cannot encode/dummify the data because then the issue no longer occurs. It is likely related to the large amount of data being processed. What I can include is the image you see here. My question is: how can the following happen? Is this a bug? I merge two flows, both have a lot of attributes. Requestor is 1.9m features. Supplier is 6k features. Supplier has only in ~1% of cases a value for attributes ‘X’ and ‘Y’ - the other 99% is <missing>. But supplier also has a lot of other data and attributes.After merging, for attributes x and y a lot more values are found. They are chinese or japanese characters. They are supposed to be numbers or english words.. Also I think they are getting also values from other attributes entirely, but then the actual value instead of random chinese or japanese characters. How is this happening? I am sure that: the attribute I test is the same (I duplicated the statistic

1246

5 months ago

jackydContributor

asked in Transformers

Customer transformer converting string to integer

I am using customer transformers in a work space, but they are converting a string value to integerThe values are 002 and 003, they need to stay this way for the http calls inside the custom transformer but are getting converted to 2 and 3 (without the 00)As read from dbAfter entry into the custom transformerAny thought on how to prevent this?I would like to have to avoid having do something in each custom transformer to revert the values back to the strings

372

5 months ago

ienesaglam60Contributor

asked in Data

Cut the fme polygon from fme aggregate

How ı Cut the fme polygon from fme aggregate?You can find the photo attachedturquoise color object is fme aggregate .purple colored object is fme polygon .I want to cut below the yellow line.

442

5 months ago

bayramContributor

asked in Transformers

shp to Citygml

Hello,I'm having trouble converting shp file to City Gml, can you please help?

1041

5 months ago

lorenrouthContributor

asked in Authoring

Should this be a Batch Process or...?

I have a large Workspace that processes multiple .dwg files along with a single Excel and .dbf file to generate one Excel file with multiple sheets. This works fine when I have feature caching on, but obviously takes a long time. When I try to run it without feature caching, the feature output is a fraction of what it should be, but still gets data from all the multiple dwg files selected, as opposed to grabbing from one file. The only thing that comes to mind is that without feature caching, it does not wait until all features are processed. So, what am I missing? Is there a ‘WaitUntilAllFeaturesAreProcessed’ transformer or setting? Or, should my approach be some flavor of batch processing? I haven’t seen anything in this forum that matches my situation. Any insight is appreciated. Thanks,-Loren

1084

5 months ago

nathan.levelingContributor

asked in Transformers

Removing Null Columns by geometry with dynamic output

Hello, I have an input dataset, that has numerous fields which are Null, and only a handful of fields that are useful. I want to completely remove the attribute fields that are Null, only leaving the useful data. Input is a geo-package, and output is a file geodatabase. I have actually achieved the goal to 90% but have hit a snag, which this post is about. The geopackage has numerous layer I am doing this for, but for this post I will focus on the OBSTRN layer. My current work flow is:Reader (OBSTRN) > NullAttributeMapper (Sets Nulls to Missing) > SchemaScanner (Removes Empty Attributes) > Dynamic Writer The dynamic writer settings: Feature Class/Table Name: fme_feature_typeGeometry: From Schema DefinitionSchema Source: “Schema from Schema Feature”Schema Def Name: fme_feature_type_nameAs mentioned , this output gets me to what I want about 90-95%. The problem is. Within the OBSTRN object class, there exists Points, Lines, and Polygons. I have noticed in other objects that have

685

5 months ago

bkggContributor

asked in Authoring

Utilizing Deployment Parameters in Form workspace

Hey ya'll, I've been playing around with deployment parameters in Flow and Form but I have been wondering if it's possible to use an existing deployment parameter in Form, without a database connection that has the same credentials? So for example accesing database X through deployment parameters without having database X defined in your local database connections. I've tried to but to no avail.

474

5 months ago

goldsteinContributor

asked in Data

Add Timestamp to text file, written using FeatureWriter

Hi,I am trying to add a timestamp to a file, which is being written using feature writer. The workbench is on a shared data directory with a Flow Environment.I have seen other options of using fanout option but seems like they are limited to writers only.I just need a simple timestamp on my text-file when its written so that I can keep records of what is being written.I also have made a timestamp attribute using DateTimeStamper and DateTimeConvertor but don't know how to add that to the file name.Any pointers will be appreciated.Thank you

harishContributor

I have Here Maps Data in XML format. I want to extract the data to CSV in FME. If I am directly adding XML there are issues in reading the file. Currently I am using an XML Flattener tool built using python. Is there any option in FME to do this?

333

5 months ago

ncc

asked in Transformers

Dynamically filter unique values? Attribute-based probability sampling?

Hi all, I am relatively new to FME, it would be greatly appreciated if someone can shed some light on a couple of problems I can't seem to figure out. 1. Is there a transformer similar to the attribute filter transformer but would enable me to route unique value to the output port dynamically? I understand that I can using the import value function to bring in the unique attributes values, but sometimes I would only like to only filter a portion (which could be about 50 unique values) of the total number of unique values. Inputting the required attribute value manually is laborious and prone to mistakes. What I would like to achieve is a 2 step dynamic filter of features, each feature has a Local Government Area (LGA), and a Suburb (suburb is a subset of LGA) attribute. Depending of the first LGA filter (ideally a check box list), the second transformer would route filtered features with unique suburb attributes to an output port. Is this possible? 2. I am currently trying

1893

5 months ago

robinso1Contributor

asked in Data

Creating header lines

I’m attempting to automatically add three lines to the start of a processed data set, in order to create a batch file.There is probably a very simple solution but any help would be appreciatedThanks

632

5 months ago

jennychuContributor

asked in Data

gml_id and geometry issues in extending citygml 3

Hello everyone,I am a beginner with CityGML and am currently trying to convert a dataset to CityGML 3 with generics extensions using FME Workbench. However, I am encountering a couple of issues:Warning about inheritance relationship: The output gives a warning indicating no inheritance relationship. I have used AttributeMerge to add gml_parent_id, but the system does not seem to recognize it.<GML_2 Writer> - '12482' orphaned features found, XML comments representing these features will be present in the output file: Geometry export issue: It does not export correctly after setting up the geometry. In the Inspector, the data appears as a table without geometry.Additionally, the original dataset complies with the CityGML 3 standard, and its geometry's encoding is Name (encoded: UTF-16LE). Could this encoding be affecting the process?My settings and the transformer export are shown in the attached image.I would g

200

5 months ago

1
...
37
38
39
40
41
42
43
...
1102

Page 40 / 1102

Badge winners

mikeinhamiltonhas earned the badge Teacher (Grey)
mikeinhamiltonhas earned the badge English Speaker
mikeinhamiltonhas earned the badge Student (Grey)
mikeinhamiltonhas earned the badge Expert (Grey)
mikeinhamiltonhas earned the badge Welcome Back

Show all badges

30,107: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.