Using transformers to modify data.
Recently active
I’m trying to make a KML from a CSV with Geometry in WKT. I have got up to the Extract Geomery transformer but keep getting the INVALID_GEOMETRY_VERTICES error. Example i’m trying to extractLINESTRING Z (212197.02298451745 6343709.643456226 -405.22127891605567, 212199.2655298651 6343696.0119692795 -406.87294763726277, 212201.50807521114 6343682.380482333 -408.246661504635, 212203.75062055816 6343668.748995384 -409.3429700220356, 212205.99316590338 6343655.117508436 -410.1623117274895, 212208.2357112494 6343641.48602149 -410.7050143686031, 212210.47825659852 6343627.85453454 -410.9712950336693, 212212.7208019459 6343614.223047592 -410.9612602385047, 212214.96334728913 6343600.591560645 -410.674905969057, 212217.20589263522 6343586.960073698 -410.1121176798006, 212219.4484379844 6343573.328586748 -409.2726702479159, 212221.69098332908 6343559.697099801 -408.1562278832371, 212223.9335286767 6343546.065612854 -406.7623439939325, 212226.01318177005 6343533.424279183 -405.22127891605555)
Hello, I was just wondering if anyone has successfully used the AutoCAD Dimension attributes to validate angles?I have a example drawing below where the angle of the lines is added as text in AutoCAD using the DIMANGULAR function in AutoCAD. When FME reads in the features, using ‘Explode Dimensions’ set to No, I get a series of attributes against the text point with the coordinates of lines used to determine the angle in AutoCAD. What I have found is that defpt2 to deft4 aren’t always in the order to create lines and test the angle between them and was wondering if anyone else has had success in validating angles from a DWG?
I’ve been successfully utilising the Microsoft Email Service via the Emailer transformer for sometime - I noticed last week that all emails scheduled to run via FME flow stopped working, and when I opened the workspaces to reauthorise Microsoft, I was met with the following error: “Unable to retrieve access tokenRequest to update access token failed. HTTP Error: HTTP/1.1 401 Unauthorized” My IT department can see on their end that the logins have been successful via FME Emailer Enterprise Application on Azure.
I have many SQLExecutor transformers and for any reason they use to lost the geometries.The visual preview nor the data inspector show any geometry, only a “There is no geometry in this view” message.When they should save the results in the next FeatureWriter (in a postgis database) only the alphanumeric fields are correctly writed, but the geom field is fill with nulls.When I execute the same sql sentence in QGis or pgAdmin I get the geom field with the correct geometries.I'm not be able to find the fix for this issue. Any idea will be appreciated. Thanks in advance.
Hi,I have an FMW (FME Form v.2023.2) with 4 datasets, and I would like to save the results as ArcGIS Portal writers. Each dataset could change due to modifications in the underlying databases or files used in the FMW. These changes may involve the deletion or insertion of rows, updates to attribute values, or, in some cases, no changes at all.I would like to run the FMW once a month without modifying the parameters for ArcGIS Portal.How should I configure ArcGIS Portal to capture all changes for these 4 datasets?When I used Insert for Feature Option and Truncate for Feature Type Handling 3 datasets where correct updated, the 4th dataset “Alle_Adr_Adkom” got:ArcGIS Portal Feature Service Writer: 0 features successfully written to 'Alle_Adr_Adkom', but the server rejected the 48751 features in the last request due to errors. See warnings above. Ending translationARCGISPORTALFEATURES writer: An error has occurred. Check the logfile above for details”I appreciate your helpElisabeth
Hello. I am running workspaces using FME Python API and the class FMEWorkspaceRunner, where I am currently using the method runWithParameters.I would like to know how can I change the Log file name (and path) when running the workspace in this way. I saw in the documentation that runWithParametersAndDirectives have an example about change the log name, but it is not clear for me.Thanks.
Hello,I was told that I can use HTTPCaller to automate some ArcGIS Online Admin workflows, such as creating/deleting user accounts.I found this ArcGIS REST APIs authentication document to guide me, but I can’t figure out how exactly. https://developers.arcgis.com/rest/users-groups-and-items/authentication/ Any help is appreciated! Nicole
I have a block sitting on a line and a block associated with a point in a DWG file. How can I save the label positions, including the rotation and alignment of attributes like 'ID', 'Slope', and 'IL_Out', using the CAD Feature Writer in FME?
I'm using FME Workbench version 2023.2.3. I have 2 datasets, 1 dataset contains around 2,5 million polygons, the other dataset is 1 polygon (a province in this case). I want to know which polygons overlap with the province (even if the overlap is small). I use a SpatialFilter for this, with the 2,5 million polygons as candidate and the 1 polygon of the province as filter. Below are the settings: Now I noticed some issues, where some polygons who do have an overlap, still end up in the ‘failed’ port. Like the example below:I asked some colleagues and they don't know what's going on here. Everything looks alright and we have no idea why this doesn't go in the ‘passed’ port. It almost seems like a bug. I use this SpatialFilter a lot, so I'm curious what's going on here. I hope someone can help me to figure this out.
I am using FeatureJoiner to combine polygons from different source data layer. They all work fine and get combined apart from the data coming from the MapServer reader, this one gets rejected in the FeatureJoiner and gives this information:I see that data has an extra attribute: ‘arcgisonline_type: arcgisonline_polygon’, and the others from other data sources don’t have that. I am using a CsmapReprojector and converting from SPHERICAL_MERCATOR to MGA94-55 (written as “_MGA94-55_0” for all other data, and as “MGA94-55” for the data that passes through the Reprojector, the one that is being rejected, I don’t understand why they get different naming).Any suggestion if I am doing something wrong and how can I have the data not rejected please?
Not really a question, but feel free to add comments or thoughts below.We are implementing pre-commit hooks and centralized Python linters in our git workflows, and for this we need to extract all Python code from workspace files pushed to git. Since we do not want to require a full FME installation for this, we’re parsing the .fmw files as text files using Python and extracting all the code blocks within, before passing them on to the linter as if they were stand-alone Python scripts.As code blocks are encoded in a somewhat non-standard way, I’m sharing a Python function to convert FME encoded strings to regular text, without resorting to any dependencies like an FME installation, (which would allow using FMESession.decodeFromFMEParsableText) or other third-party libraries.It can decode FME encoded strings on either formatimport<space>fme<lf>import<space>fmeobjects<lf>import<space>json<lf><lf&am
Hi there,last time, this community forum was so helpful and I hope someone can help me this time around too…I’m using the Clipper to clip polygons using the Group Processing feature. Only if the values of the attribute “att_1” are the same should the clipping occur. So far so good. However, it can be that att_1 is NULL (empty) and in this case, I would like to do Group Processing using attribute “att_2”. Is there a way to configure this in the Clipper directly?With my humble knowlegde of FME, I would filter for att_1 being NULL and have two Clippers (one for Group Processing att_1 and one for Group Processing att_2) and then merge the two data streams again. But is there a more elegant way?
Hi, This is defeating me!Any pointers sincerely appreciated.See attached spreadsheet, Where I have features with attributes having multiple similar IDs as well as a name attribute.I have added the columns _num and _page, that is the desired output I manually added in.I can achieve the _num output easy enough with a counter set to Local and group by the two Attributes Name and ID. I set the Count to be _num and Group ID to be _page. This works fine until the Name group changes and the _page will continue counting, See screenshot. However, when the new Name starts with B I want the _page to restart at 1. How do I set it? Thanks. Nic
I am a Chinese student who uses FME software to read shp files and create 3Dtiers files. There is a problem loading and displaying now. As shown in the video, there is an issue with zooming in and out.Others' 3dtiles were generated using other software and did not encounter this issue. I'm having problems using FME now, how can I solve this. Please help me. My English is not very good. Can you understand what I translated using translation software.I searched for some 3dtiles files and someone said it was a geometricError parameter setting issue.Where can i set the 3dtiles geometricError ???please help me .I am bad in English.my Emial 1985425275@qq.com FME USE THIS . Maxinum Number of Triangle Faces Per Tile Trying to set 100 and 1000 times, but it doesn't work。Where can I set parameters???Someone told me that there is a problem with the geometricError parameter and it needs to be corrected。Hom to ???
Hi there, I am trying to extract links from this page Mornington Peninsula Planning Scheme - Maps using the methods posted on this forum as well as from the official documentation HTMLExtractor (safe.com), however there is zero total features read, meaning no output. Would this be due to the way the site is structured? I am specifally trying to extract the urls for the PDF maps on the left, and output to a SQL table and link to our GIS, as these links change every so often.Regards,Josh
Hello, Am I the only one who is experiencing lately that if I have several models open and I do a purge tempory files in 1 of them then it then does the same in the others? The numbers remain in the other model but the green box to view is gone and I have to run the whole model again :-(I do that because sometimes I update a reader but then it won't run again without me doing that purge.
Hello everyone,I am currently making a script that looks for houses that have a garden. In my current script I have two datasets: 1) houses, 2) gardensI used for now the NeighborFinder transformer and I have a maximum distance of zero, since the gardens and the houses need to touch one another. So far, so good. However, now I get another problem.I have the following situation. You can see in the drawn example below that the garden and House 1 share a line, while this is not the case for House 2. However, based on my current settings in the NeighbourFinder, the garden is as well considered a neighbour for House2.How can I go about it, that House 2 is not included, since House 2 and the garden don't share a line, but only one vertex. Do I need to change some settings in the NeighbourFinder or do I have to go differently about it.
I need to dissolve line segments into long line base on some attributes. I tried LineCombiner and it doesn't work, still same segments in the result.
Is there an option or setting that I have missed?I have a reader pulling in data from a portal feature service. I set it to resolve domains.I have a field that, for whatever reason, the coded value is not being resolved so the “_resolved” field is being populated as <null>.Rather than having to add transformers to each of my workbenches to check each of my domain fields, I was wondering if there is a setting I am missing somewhere?In this instance, I would rather have the coded values populate the “_resolved” field rather than it show up as “<null>”. Is there an option that I can set in the reader (or somewhere else) to be able to do this? I am using Workbench 2023.1. This post indicates that there was no option 3 years ago… hoping there’s been an update made? Also, looks like no progress made on this request (from 4 years ago!) to at least add a warning in this type of situtaion. Please go upvote:
Has anyone experienced a workbench erroring when feature caching is disabled? For context I have had this workbench running through task scheduler for around two years (keeping it updated) and recently discovered an issue where it crashed at a specific transformer (feature joiner).In testing I have run the workbench with feature caching on (it worked fine) so I tested all the normal points - replace transformers, replace readers/writers, change user credentials. When I turned off feature caching is where the error occurs (in the same spot as when running it through task scheduler).The attached logs show where it crashed on the feature joiner, has anyone experienced this? My last step is to recreate the workbench from scratch and test that as well.
Hello, I am attempting to replicate the following PostGIS SQL code within an FME workspace: where ST_DWithin(property_boundary.shape ,restriction_area."SP_GEOMETRY",100) and ST_AREA( ST_INTERSECTION(property_boundary.shape ,restriction_area."SP_GEOMETRY"))/ST_AREA(restriction_area."SP_GEOMETRY") < 0.1 property_boundary layer is parcel data for an area. restriction_area is a collection of polygons where the same restriction applies but for different reasons which is listed in the attributes. If the above script is true for a given property an attribute is then applied. I am not very familar with PostGIS SQL, but from my understanding, this script is filtering for all property_boundary shapes that intersect a 100 meter buffer of the restriction_area. Then, it calculates the total overlap between each property_boundary shape, and each restriction_area shape. If the area of overlap for a property_boundary shape is less than 10% of the total for a given restriction_area it is selected in
Hi,In my workbench I’m trying to export points and labels from Oracle database to Geopackage file.So I’ve configured an Oracle Spatial Object Reader and a TextAdder. On the TextAdder’s output I can see points with labels. Then I’m adding a writer of type OGC Geopackage.But when I’m trying to run process, the result GPKG file contains only points (without labels).On logs there’s a information: “Unsupported geometry type Text. Downconverting to Point”If I replace OGC Geopackage writer with Bentley Microstation Desing (V8), then it works properly (I mean the result contains points and labels).How to export labels to Geopackage?
When a FeatureWriter fails for whatever reason, is the expected outcome that nothing is output from any of the ports, even if some or all other feature types are successful? In my example I have 2 feature types in a FeatureWriter and 1 of the 2 writes successfully, the other fails (I’ve forced it to fail to test this functionality). I want to be able to take the information from the successfully-written feature type further in the workspace for processing. Is this not possible? Currently I’ve resorted to 40 separate FeatureWriters for 40 different feature types in case 1 of them fails and the other 39 are successful. I do have Rejected Feature Handling set to Continue Translation. This is FME 2024.1.1.1 (B23620).Below is my example. The 312 features for for the one feature type successfully write to my database (ArcSDE GeoDB). I’m ok that the Translation Failed and is actually a good thing, I just want to use the summary and feature counts to write to log tables further along in the tr
Hello, I have multiple FBX surfaces with textures as external jpegs which are read in alongside the geometry and coloured accordingly. I need to merge these surfaces into one file using a deaggregator and a meshmerger which works, but when i write this to an FBX file, the jpegs or textures are all individual files which are retained from the original file. Also when i simplify the mesh, it also looses all colours. Is there a way of merging, simplifying a mesh whilst retaining all textures or appearances? Thanks,@takashi @nielsgerrits @hkingsbury @daveatsafe @david_r @ebygomm
I need to write datetime to a comment on a SQL table after my postgres SQL writer is complete.This can easily be done like when using a featureWriter like so:COMMENT ON SCHEMA "my schema" IS '@DateTimeFormat(@DateTimeNow(), %Y-%m-%d %H:%M)';This is not possible if i use a regular postgres writer. Only SQL functions are available. This alone is not enough to set a timestamp.Tiny but frustrating neuance between almost identical transformer/writers. What other ways can i inject a datetime into my comment on schema syntax?