A space to discuss FME Form
Recently active
Hello,I was hoping to get your input into how to speed up the following workflow:Read an Excel File with several sheets from a Network Share → Output each sheet to a different output port → Create a CSV file for each output port in a network share.I already have the above working, the problem is that CSV writer is taking a loooong time writing the files. My connection to the network is pretty good so it is not a matter of latency between my PC and the network share (at least I don’t think so).Does anyone have any idea on how to improve the writing speed of the CSV files or what to do improve the overall time it takes for the workflow to complete?.Thanks in advance.RZ.-
Hi,I have a dataset with Centerlines shown in blue, some lines contain too much detail which is not accepted as input for the LineDivider I use in the downstream pipeline.Is there a way I can smooth the blue centerline into something like the red line shown on the right?The Generalizer should be the way to go I guess but did not find the right settings yet.
Has anyone successfully created a workspace that can convert Ordnance Survey MasterMap data to dwg format? I understand the process would be quite complex, but it would be good to get an idea of what’s involved from anyone who may have done this.
Hi, I am trying to add Inspection attachments to the Inspections using FME Form.I have excel spreadsheet that have EntityUID, InspectionTemplateId, Observations Questions and Answers, and image links1 - to image link4(attachments)Each Inspection must have entity attach to it based on the EntityUID. Image as JPG extension located on the repository an each image have EntityUID in the image name.How can I attach image to the Inspection- that is first questionSecond question is that some Entities have up to 4 images related to them, that reference based on the different parameter (Image_link1, image_link2,image_link3, and image_link4) It is easy to create inspection, add entity, and populate Observations questions and answers but I am struggling to attach the images.
I am working to compare the geometry of two datasets and I am specifically interested in doing so with Vector Tolerance. For some testing purposes I have tried two different transformers to do so, namely the ChangeDetector and the Matcher. I added them in the same workspace with the same input data. For both I only checked the geometry (not the attributes), with the settingsMatch Geometry: 2D Lenient Geometry Matching: No Check Coordinate Systems: No Vector Tolerance: the same user parameter, e.g. set at 0.5 or 0.1. Always the same though.When looking at the documentation the vector tolerance seems to have to work the same for both transformers (https://docs.safe.com/fme/html/FME-Form-Documentation/FME-Transformers/Transformers/changedetector.htm & https://docs.safe.com/fme/html/FME-Form-Documentation/FME-Transformers/Transformers/matcher.htm).When running I noticed however that the output was different. I was expecting that my Matcher SingleMatched output port would give the same
I'm creating a new excel file nightly and some nights there will be no data to populate the excel file, but I need the file to be created anyways. Is there a step in the Excel writer that I'm missing to do this?
Hi all, Yesterday this worked fine, but today its returning ‘{ "success": 0, "errorMessage": "API Limit Reached!" }’ in _reponse_body column? What do I need to do to resolve this issue? Thank you in advance!
Hi,I'm using a FeatureWriter to insert data into a PostgreSQL database. When certain features can't be converted into the desired data types, FME drops them without terminating the translation.The logger gives a message in blue:"Value of attribute 'test' could not be converted to type 'bool'. Feature will be logged and skipped" However, the issue lies in trying to capture this scenario and terminate the translation.Despite dropping some features, the FeatureWriter when outputting the summary feature still contains the FULL COUNT against the '_total_features_written' attribute. I was intending on comparing this number to a count of incoming features to check for a difference. Now the only other way I can think of is querying the database immediately after and getting the written feature count that way. I guess I have two questions:1. Is there an inbuilt way to halt the translation when a feature is dropped like this?2. Is the _total_features_wri
Hi guys,is it possible to compare two filegeodatabases in FME? In each fgdb are 443 feature classes (points, lines and area feature classes). After some testing with the first vesion of the fgdb, we had to update the fgdb in some feature classes and changed some attribute fields and add some new domains and values. Is there any transformer which can show me the differences between both fgdb’s?Thanks for answering in advance.Cheers,Fabian
In ArcGIS Pro a TIN can be created using the “Create TIN” tool. The usage notes of the tool say that it should be avoided to use a geographic coordinate system when creating the TIN, as the Delaunay triangulation might not work correctly when the coordinates are in angular units.The “TINGenerator” transformer in FME does not provide such a usage note in the documentation. Does this mean that the “TINGenerator” transformer can create a TIN without problems when the input dataset is in a geographic coordinate system or is it also recommended here to reproject the input data to a projected coordinate system first?
Hi forum, I’m trying to do something I successfully used many times before. But for some reason it’s not working this time. I’ve delved into it and done research but I can’t work it out. It’s a really simple thing. I just need to read in three csv files with identical schemas into one FeatureReader. I have a Creator, connected to a FeatureReader. In the FeatureReader I’ve selected CSV as the format. In Dataset I selected the three dots (…), browsed to the data source location and then selected the three files. So, now in Dataset I have this: "E:\FME temp source data\Scratch\TestPoints\one.csv","E:\FME temp source data\Scratch\TestPoints\three.csv","E:\FME temp source data\Scratch\TestPoints\two.csv" In FeatureReader I have ‘One per feature type’ selected in Output ports. But, when this is read in, only one output port is created in the FeatureRader. That one output port is called csv and it includes all the records from the three inputs in the one output. How do I force it to create
I'm using a FeatureReader to read a wfs service and getting strange failures.The following error is being loggedHTTP transfer error: 'Failure when receiving data from the peer'XML Parser error: 'Error in input dataset:'https://data.linz.govt.nz:443/services;key=xxxxxxxxxxxxxx/wfs/layer-53382?SERVICE=WFS&VERSION=2.0.0&REQUEST=GetFeature&TYPENAMES=data.linz.govt.nz%3Alayer-53382&NAMESPACES=xmlns%28data.linz.govt.nz%2Chttp%3A%2F%2Fdata.linz.govt.nz%29&BBOX=-36.939824852066955%2C174.70954193086246%2C-36.91494916200109%2C174.76090622708065' line:1 column:121683 message:unexpected end of input'The XML Module halted on error, see the logfile for details<WFS> An error occurred while reading a GetFeature response, to ignore the error and avoid losing the previously read features, set the WFS "Ignore GetFeature Error" parameter. Total features downloaded: '0'A fatal error has occurred. Check the logfile above for detailsAccessing the link and checking the file manually
I’m trying to connect to our SAP Datasphere but can’t establish a working connection. The settings and parameters are similar to the ones i used with were i could get a connection. There is a Proxy Server involved.Any ideas what i have to do different to get working Database connection?Not shown in the screenshot is the parameter proxyPassword
I have manage to export shp in file geodatabase with datasets but now it seems that i have a strange problem (or bug).every shp that i have exported is missing 1st entry in geodatabase. lets say a shp file has 10 points then i’ll get only 9 points in gdb and the one is missing is always the 1st pont in shp file. every shp file is missing that 1st entry.the strange thing is that fme shows in information that it wrote all entries that the shp files has but somehow 1 is missing.there is absolutly no error in logs. i get some info about some fields that i don’t export anyway. i really have no idea why this is happening.the shps are also exported with FME from othe types of data.for writer i use Esri Geodatabase (File Geodb Open API) with some schemas that i read from a template database with featurereader and join it on shps (no schema was readed).so what im doing wrong?why there is no error about the missing entries?
I am trying to clip a ECW raster by a rectangle polygon but the inside output is incomplete. Only a small slice of the ECW is in the output as you can see below.Is there something I am doing wrong? FME 2023.2Thank you for your help
Welcome everyone, to the Twelve Days of FME Contest for 2020. A series of challenges will appear over the coming month. The links are below. You can enter any challenge, all challenges, or none at all (though then you won't win any prizes). And there are a lot of prizes! We're not sure exactly what they will be, but I can guarantee prizes for each challenge. So take a look at the current challenge and don't forget to follow this page so you receive new updates! Challenge 1The Puzzle of the Extra Partner (CLOSED)Challenge 2The Puzzle of the Holidaying Lizards (CLOSED)Challenge 3The Puzzle of the Hidden Twitter Message (CLOSED)Challenge 4The Puzzle of the FME Art Gallery (Part 1) (CLOSED)Challenge 5The Puzzle of the Viral FME (CLOSED)Challenge 6The Puzzle of Santa's Sleigh (CLOSED)Challenge 7The Puzzle of the Obscure Transformer (CLOSED)Challenge 8The Puzzle of Santa's Faulty Warehouse (CLOSED)Challenge 9The Puzzle of the FME Art Gallery (Part 2) (CLOSED)Challenge 10T
Hi All,I am new to the FME Software and have a small question related to NeighborFinder.We have points and contour tables in Arcsde Geodatabase. We are finding points near contour by providing specific distance say 20 in neighborfinder In actual case distance is varies like in some cases nearest contour is at 30 , some contours at 40 etc. How do I tell to neighborfinder that select a point which is near by contour having distance in between 10 to 40 ?. In SQL if we use between operator then we are getting values so similar I want to use this for neighborfinder Below is the screenshot : What I tried so far : Creating Custom parameter On Web found below useful posthttps://www.baooytra.com/knowledge/questions/52143/using-neighbor-finder-with-condition-neighbors-att.html?smartspace=automations-fme-serverAny inputs/suggestion on above would be great !!thanks in advance !!
Hi,Unfortunately i cannot provide the test data due to confidential data. I also cannot encode/dummify the data because then the issue no longer occurs. It is likely related to the large amount of data being processed. What I can include is the image you see here. My question is: how can the following happen? Is this a bug? I merge two flows, both have a lot of attributes. Requestor is 1.9m features. Supplier is 6k features. Supplier has only in ~1% of cases a value for attributes ‘X’ and ‘Y’ - the other 99% is <missing>. But supplier also has a lot of other data and attributes.After merging, for attributes x and y a lot more values are found. They are chinese or japanese characters. They are supposed to be numbers or english words.. Also I think they are getting also values from other attributes entirely, but then the actual value instead of random chinese or japanese characters. How is this happening? I am sure that: the attribute I test is the same (I duplicated the statistic
I am using customer transformers in a work space, but they are converting a string value to integerThe values are 002 and 003, they need to stay this way for the http calls inside the custom transformer but are getting converted to 2 and 3 (without the 00)As read from dbAfter entry into the custom transformerAny thought on how to prevent this?I would like to have to avoid having do something in each custom transformer to revert the values back to the strings
How ı Cut the fme polygon from fme aggregate?You can find the photo attachedturquoise color object is fme aggregate .purple colored object is fme polygon .I want to cut below the yellow line.
Hello,I'm having trouble converting shp file to City Gml, can you please help?
I have a large Workspace that processes multiple .dwg files along with a single Excel and .dbf file to generate one Excel file with multiple sheets. This works fine when I have feature caching on, but obviously takes a long time. When I try to run it without feature caching, the feature output is a fraction of what it should be, but still gets data from all the multiple dwg files selected, as opposed to grabbing from one file. The only thing that comes to mind is that without feature caching, it does not wait until all features are processed. So, what am I missing? Is there a ‘WaitUntilAllFeaturesAreProcessed’ transformer or setting? Or, should my approach be some flavor of batch processing? I haven’t seen anything in this forum that matches my situation. Any insight is appreciated. Thanks,-Loren
Hello, I have an input dataset, that has numerous fields which are Null, and only a handful of fields that are useful. I want to completely remove the attribute fields that are Null, only leaving the useful data. Input is a geo-package, and output is a file geodatabase. I have actually achieved the goal to 90% but have hit a snag, which this post is about. The geopackage has numerous layer I am doing this for, but for this post I will focus on the OBSTRN layer. My current work flow is:Reader (OBSTRN) > NullAttributeMapper (Sets Nulls to Missing) > SchemaScanner (Removes Empty Attributes) > Dynamic Writer The dynamic writer settings: Feature Class/Table Name: fme_feature_typeGeometry: From Schema DefinitionSchema Source: “Schema from Schema Feature”Schema Def Name: fme_feature_type_nameAs mentioned , this output gets me to what I want about 90-95%. The problem is. Within the OBSTRN object class, there exists Points, Lines, and Polygons. I have noticed in other objects that have
Hey ya'll, I've been playing around with deployment parameters in Flow and Form but I have been wondering if it's possible to use an existing deployment parameter in Form, without a database connection that has the same credentials? So for example accesing database X through deployment parameters without having database X defined in your local database connections. I've tried to but to no avail.
Hi,I am trying to add a timestamp to a file, which is being written using feature writer. The workbench is on a shared data directory with a Flow Environment.I have seen other options of using fanout option but seems like they are limited to writers only.I just need a simple timestamp on my text-file when its written so that I can keep records of what is being written.I also have made a timestamp attribute using DateTimeStamper and DateTimeConvertor but don't know how to add that to the file name.Any pointers will be appreciated.Thank you