Using transformers to modify data.
Recently active
The workbench I am putting together contains a feature reader to a dynamic write in several locations. The workbench itself detects shape files in a folder location, validates projection, geometry and AssetID attributes. Then writes out any identified errors to a shape file for upload in another step.The dynamic write of the "errors" shape file works however the dynamic write of the upload file encounters a warning where the below appears in the log: Cannot define schema for '@Value(ENCODED,fme_feature_type)' as the feature does not contain schema information. While we have the schema mismatch the remainder arrive correctly.The features arrive with the new layer name that I want to use. Testing my workbench I have found that the dynamic writer performs as expected (and outputs the shape file) for every stage up to exposing the fme_feature_type, mapping the new layer name and setting the dynamic reader to the new layer name.I have tested this in the latest version (20
Hello, I am trying to create a folder with a prefix of Run_ and have the current datetime as the folder name. I am very new to FME and I am not sure what I am doing wrong with the setup that nothings gets created in the path I have as destination (screenshot below). I appreciate any help.
I have a work bench that transforms data from multiple sources and then inserts only the new records from the combined data into a table using a merge transformer and Feature Writer. For auditing purposes I need to log how many records were written to a table in the same Database as well as pass that info back to FME Server to include in a email via automations. I am able to do this currently with the summary output of the Feature writer, however I would also like to pass the count of the existing records and also set the total written to 0 rather than the undefined that gets returned when there is no new records to add. I've tried using counters but either I'm using them incorrectly or I'm missing some steps as the flow doesn't continue down the path when there are no new records.
HelloI want to create a point in the middle of each line in my file. Each of these lines is made up of only 2 vertices. Can you guide me to achieve this. Thanks in advance
Here i have some Lines extracted from DWG and thought i set them to the correct projection. all seem right except for one file that is way off "Asbuilt - Sewer Existing" I noticed that the autocad_origion x,y are the correct extents but the geometry have different xy coordinates. any ideas on how to set this correctly would be appreciated. Many Thanks!
I'm looking for some advice to get me started on creating a workflow. I'm an intermediate FME user but this problem has got me stumped! I'm dealing with roughly 100 areas that require tree planting. Each planting area will be a different size depending on the environment. Once each area is planted, we need to monitor 20% of the area to determine the success rate. The monitoring plots are 10 x 10 metres, so area of 100 sqm. The plots need to be placed at random and I need to find out how many monitoring plots can be fit wholly within a planting area where the total area of the plots is at least 20% of the total planting area. For example, if the planting area is 3000sqm, I would need to assign 6 x plots.20% of 3000 is 600. 600sqm would be 6 x plots. Any help or advice would be appreciated.
Hi, When i try to connect open service: https://gis4.waimatedc.govt.nz/arcgis/rest/services/Public/RoadClosure_Waimate_Active_Planned/MapServer using "Esri ArcGIS Feature Service" reader, I get Python exception error. There is no authentication required as its open service. The fact that I can use HTTPCaller and get the data with query service tells me, this service doesnt require authentication. Am I missing something? I tried few other rest service from this council with no luck. Python Exception <HTTPError>: 403 Client Error: Forbidden for url: does this error means anything to do their IT system infrastructure? Any help would be appreciated? Cheers,
I want to read a Geopackage file, but when I run the FeatureReader transformer, it creates a new geopackage file with the name of "file name"_0.gpkg so as cannot be located. I cleared several times my temp folder with ClearTemp.cmd, also Purge temporary files in my FME-script. But still I have problem with temp-file! Can you guide me how can I fix the problem? Thanks I can read my file via Reader and there is not any problem, but when I read it via FeatureReader, I have problem with temp file!
I am in the process of creating an FME script to download photos as attachments features in ArcGIS Portal using the FME ArcGIS Portal Feature Service.The script runs fine from the ArcGIS Pro application using the interoperability extension.The only problem is that images from all the features is downloaded, even if only some is selected in ArcGIS Pro.
Hello I am a GIS analyst and I want to learn FME for the first time. I checked different parts of the website but still don't know completely how to start to learn here!
I have yet to successfully use dates as an axis in ChartGenerator. Ideally, I would like to be able to use more natural date formats e.g. %B %Y or %m %Y and set the scale accordingly based upon time increments. Is this possible (in Chart Generator or another transformer) ? Or am I going to need to take it out into PowerBI, Excel, etc?
I have a dataset from a spreadsheet that i have created a counter for each row successfully. The SQL table i am importing this dataset into has a primary key (highlighted). This primary key is not recorded anywhere in the database as a sequence number. I have added in a statisticsCaculator transformer to obtain the max number. I want to insert each row from my dataset (first screenshot) but i want to insert the LUPID as count + LUPID.max. so i end up with 1691+1 = 1692, 1691+2 = 1693, 1691+3 = 1694 etc for each row what transformer would i use to do this?
Solved with LISP (.lsp) and csv export. Read my last post I working on a script that need to test some parameters in a hundres of dwg files.Just to make it short. Autocad_layer_frozen and Autocad_layer_description are two attribute that I need to check and what I use in this example. However, the only way I have succeeded so far to get empty layers visible is to use a dwg reader and choose individual file types. B No data of course. Nothing is read since the layer is empty. Both DWG reader and feature reader can only read layers that are not empty. Feature reader and with format "Any schema" can read all layers, also empty layers, but does not contain the native autocad attributes like Autocad_layer_frozen and Autocad_layer_description. Is there any way to read empty layers to get all the attributes that exist in a autocad layer feature with only use of FME?
I'm wondering how to use the Python Caller transformer to run the arcpy.RepairGeometry_management geoprocessing tool. I'm working with some input File Geodatabase data that's getting re-projected and producing self-intersections. The Geometry Validator transformer is identifying these but not repairing them (i.e. they come out the Failed port, not the Repaired port). I confirmed that using ArcGIS Geoprocessing tools on the same machine fixes the self-intersections, so I wanted to use the Python Caller to do the exact same thing in the context of the FME Workspace. What I'm getting is a generic error though, see below. Maybe my syntax is incorrect but I've tried a few different ways and haven't had success. Any help would be appreciated! Python Syntax:import fmeimport fmeobjectsimport arcpy # Template Function interface:# When using this function, make sure its name is set as the value of# the 'Class or Function to Process Features' transformer parameter
I have a query relating to raster analysis in FME Form using the RasterExpressionEvaluator I want to extract the maximum value of each pixel from a multiband raster, so for example if band 3 has the maximum value compared to bands 1 and 2 for a particular cell, only the value for band 3 for that pixel will be extracted and used in the resulting single band raster. The syntax I believe should work for this is as follows in the attached image but I cannot get it to work. The "maximum/max" functions are unavailable in the transformer and I am thinking that this logic not be usable on data of this type or within this transformer. Can anyone confirm if maximum syntax is workable on this transformer or even have another method of how to go about this? Thanks Andrew
Hi, I'm recently working on a workflow that creates a customs IFC property set and pushes it back to an IFC file. I have gone through all the materials I can find online but still encountered a problem. The GeometryPropertySetter successfully outputs the traits I intend to set (see column 1&2 in the attached image) but for some reason they can not be written in the IFC file. I can supply more info if required. Does anyone know what is causing this? Thanks a lot.
Hi, I have a workspace that write to SDE using a dynamic schema. The schema is build from an excel sheet where I have the name of the field, the type and the alias. I manage to write to SDE with all the correct parameter: attribute{0}nameattribute{0}.fme_data_typeattribute{0}.native_data_type The problem is that I cannot find a way to write alias. Anyone know if this is possible within a dynamic schema? thank you!
Given a call to a stored procedure like this:declare @return_value intexec @return_value = dbo.myProcedureHow do I re-assign @return_value to e.g. an attribute or a variable?
Got a situation where I would like the store attribute values, @Value(attribute_name), in some HTML code which itself is stored in a SQL table. The idea is that the @Value(attribute_name) will be different for each of our clients, sending them a personalised email based on their own data. Currently FME reads the table in and keeps everything as plain text, @Value(attribute_name) does not get replaced with the appropiate attribute value. Is there a way to get FME to recognise the attribute names in the HTML code and replace it with the appropiate attribute values? if I copy and paste the HTML code into atttributecreator then it works as expected, however we would like to manage all this in SQL server - saving us having to update the workbench everytime there is a change required to the HTML Thanks
Hi, i have a problem where most of a large number of point clouds are missing the first number of the gps_time attribute, so "367091181.0231084" should be "1367091181.0231084". It is always a 1 that is missing at the start.What would be the best way to go about changing this attribute for every point in every pointcloud?The context for this is that the point clouds are data from lidar mobile mapping and need to be matched using the gps_time with trajectories in another software.Any help would be much appreciated.
FME(R) 2023.1.1.1 (20231011 - Build 23636 - WIN64) Hello As stated in the subject line, the Feature Caching icons can be seen in the "Main" tab but not showing in the "Custom Transformer" Tab at all. However the features are cached. So I think they are just missing. ThanksSameer
Hello, I would like to prioritize a layer using the AreaOnAreaOverlayer transformer, is it possible ?Thanks
Dear All, I am experencing the following problem on FME (FME Desktop 2022.1.0.0 - Build 22618 - WIN64) : when I work with PythonCaller, my workspaces randomly crash. For example, starting from empty workspace, I add a Creator followed by a PythonCaller ; run to the PythonCaller -> it works fine ; I add "import arcpy" in the PythonCaller and run -> it works ; I add "print("hello")" in any function of the FeatureProcessor class -> it crashes. Also, the crashes happen in an unpredictable way : sometimes, it crashes after having inserted "import arcpy" ; sometimes I can add 2-3 five more lines in the function of the FeatureProcessor and it works and then after 1 more line it crashes. By crashing, I mean the following : after clicking "run", the mouse cursor takes the form of a blue waiting circle during a few seconds and the window suddenly closes -> when it crashes, it seems that the translation never really starts (nothing ha
Hi, I want to amalgamate polygons from a map of natural environments to distribute it on a larger scale (1:5000 to 1:25000). For this I used the AreaAmalgamator tool with the settings that can be seen in the photo. I have 12193 objet in total. However, the software has been running for 10 hours and nothing is happening. Has anyone ever had this situation?
For instance, one 58 unit apartment results in 17 rows with variously 1-24 units added together. We can't explain why this is happening but need to fix it. Have also tried adding a dupliate filter and another aggregator but this didn't work. Any suggestions are appreciated.