Using transformers to modify data.
Recently active
Hi, I am using the RegxAttributeSplitter. My delimiter has to be digits followed by a whitespace. I have used the positive lookahead Regex (?=\\d(\\s)) but instead of splitting the string and keeping the delimiter in the first list, the delimiter moves into the second list. I need my delimiter to remain within the first list, I thought the answer would be to use Regex negative lookahead (?!\\d(\\s)) but the negative lookahead stalls the transformer completely and produces no result. Any clues what Regex I should be using? I have also tried using Regex in the StringReplacer but no positive results here either. Below is sample of the string.. H02.CCU066 Sluice (Shared 2,Rooms) H02.THD067 Treatment Area - 14,Spaces Yellow highlight is the delimiter moving to the second list
Hi everybody, I have written a very simple script that:Reads some ESRI-JSON placed in folder tree recursively (**/*.json)For every data which is in the same folder (= same type of data), gathers all entries in the same dataset and creates a new feature class with the name of the folder in an ESRI file geodatabase (having eliminated duplicates) Precisions:Every input json files in the same folder share the same schema. But in differents folders the schemas are not the same and there may be or not M values attached to the data. However, the field OBJECTID can always be found and that key is used to remove duplicates. Issue:I cannot find the way of setting the output port to retrieve the original schema which is the same of the JSON files the output dataset aggregates. When I check "Dynamic Schema Definition" I have no choice but to use fme_feature_type (the script fails otherwise) attribute but it represents the whole schema (since all files are ESRI-JSON); so there are lots of
HelloI need to create a polyline dataset based on a point dataset which contains a text string. The text attributes also contain the orientation. As I have 1 point for each text feature how can I either :- add another point at the end of the text string and then join the points together to create a polyline, or can I just create a polyline directly from the text string for the correct length and orientation. Any suggestions on how to achieve this would be welcome. Thanks
I need to find the width of many small hill like features. I have the base point on one side, but need to find the matching elevation point on the other side of the line and measure the distance between the two. The data is a series of cross section Shapefile lines draped over las . Points are also Shapefiles Is there a way to search the line to find the same elevation along the line as the base point? Thanks
Can I do this in one Statistics Calculator OR do I have to use a Statistics Calculator for each year? Thanks,Justin
I have a table and I want to build another table from it, e. g.values | types12 | house3 | car4 | boatto:house | car | boat12 | 3 | 4This works with the AttributeCreator (Input: @Value(types) / values), if you check the output with a Logger. However I can't see or use the result in other transformers, unless I expose the fields with the AttributeExposer, which defeats the purpose of the dynamic creation. Is there any way around that? The content of the table changes, so exposing manually is not exactly desirable. There's a custom transformer, AttributeTransposer, but it also requires exposing afterwards.
There is both a support ticket and an idea. When reading a large list of drawings from an excel list. you "must" know the entire list of layers you want to read. in the "Features Types to Read:" selection box. Several things are what i consider ambiguous.if you use the cached data selection and select layers from 1 data source (1 drawing only can be selected) and select a layer with a space in it and a layer with no space in it. it returns a text list of the layers with no quotations. however the layer with a spcae will not select any features.If you use the text editor and type your own list of layers and use quotations and commas (like I would do in an esri product) all of the layers with no spaces (and quotations around them) are skipped. If you read the list in a text editor and are trying to identify layers with spaces that need quotations, you are unable to determine which layers have spaces and which layers are simply the next layer in the list. If you desir
As the IFC property sets are configured in other systems i do not have prior knowledge of the attributes to expose these for the writers. I need to be able to feature attribute cleanup so that i can expose these attribute collections without prior knowledge of the feature information.I have successfully exposed the attributes from the collections as a feature attribute but these are still hidden from the writer. I am able to interrogate each feature and build a picture of those attributes in Python but cannot seem to expose these programmatically. def processFeature(feature): print("**Processing feature**") print(feature.getAttribute('ifc_property_set')) #ifcpropertieslist = feature.getAttribute('ifc_properties') print(feature.getAllAttributeNames()) i=0 attrNames=feature.getAllAttributeNames() elementCount = int(feature.getAttribute("_element_count")) print(elementCount) exposeAttrsNames={} for i in range(elementCount): attrname = "ifc_properties{
Sorry, not sure how to word this correctly. For example, I have 2 published parameters. First parameter is StateName and second parameter is Cities. If I pick a certain state in the first parameter, could the second parameter (cities) only display cities in that state from the first parameter?
Hello, I have ready procedures to transform from .gdb to .gdb format. They were made for version arcgis 10.4, but now I have version arcgis 10.0 and to work I have to reload the reader and writer. Since this is a lot of reader and writer I would not want to do the procedure again. Is there a possibility of automatically switching from a higher version of .gdb to a lower version of .gdb? Thanks in advance,
I'm trying to extract all unique combinations of a given datamodel. For example:Table 1.FRUIT COLOR TYPEApple Green Kanzi Yellow Jonagold Red Elstar Golden Fuji Pink Golden Delicious Royal GalaWith this given datamodel, I can make 30 unique combinations.Like this:Table 2.FRUIT COLOR TYPEApple Green KanziApple Green JonagoldApple Green ElstarApple Green FujiApple Green Golden DeliciousApple Green Royal GalaApple Yellow KanziApple Yellow JonagoldApple Yellow ElstarApple Yellow FujiApple Yellow Golden DeliciousApple Yellow Royal GalaApple Red KanziApple Red JonagoldApple Red ElstarApple Red FujiApple Red Golden DeliciousApple Red Royal GalaApple Golden KanziApple Golden JonagoldApple Golden ElstarApple Golden FujiApple Golden Golden DeliciousApple Golden Royal GalaApple Pink KanziApple Pink JonagoldApple Pink ElstarApple Pink FujiApple Pink Golden DeliciousApple Pink Royal GalaI made table 2 in excel with copy and pasting. The real dataset that I have has alot more columns and values. T
Hello,I am trying to generate a single SketchUp file having several layers, using several attributes and a GeometryPropertySetter such as sander described here. Thing is, by doing so, all the edges of my shapes are into the default Layer0 layer, while surfaces are in the correct layer :This is very annoying when I want to work with such files on SketchUp afterwards, any ideas about what is wrong here ? Also, some of my layers are set as such, but with the same method, I sometimes get my features into created groups, I really don't know how. Thanks in advance,Mickael
Hi,Please, any transformer suggestion about how transpose the Table1 into Table2 ? Table1ID Field2005 Field2006 Field2009 Field20181 10.0 28.0 23.8 -3.82 80.0 34.0 -3.8 40.0 Table2ID YEAR VALUE1 2005 10.01 2006 28.01 2009 23.81 2018 -3.82 2005 80.02 2006 34.02 2009 -3.82 2018 40.0 Neither of List transformers nor AttributeExploder + Aggregator transformers work in this case. I have been working with these examples [1] but I don't get exactly what I need. Before using PythonCaller I would like to inspect other transformer possiblities. So, any FME workpace example or transformer suggestion is apreciated. Thank you [1] https://community.safe.com/s/article/transpose-a-table-using-fme
I read in map drawings that have the coordinate system defined. There are many files so they have multiple systems (mostly state plane but still varied systems) I have opened the dwgs and they have a coordinate system defined correctly in AutoCAD Map 3D. I have also used the geomap command and they are all correctly located in the state plane cs they say they are in. I use the csExtractor then a test filter to test for whether there is a CS defined. Then near the end prior to writing to fgdb I have CsmapReprojector to reproject the data (with read from feature) to LL84. After the wb completes successfully i open the fgdb to find that (only some) of the data has been reprojected too far south of the US. In reality they are not IN south america. but they are south of Mexico in the ocean. (see screen shot)The only thing i can find going wrong is that the original cs is TX-SC which gets read in as TX83-SCF. so the nad27 gets read as nad83. but even creating a new wb and reading just the of
How could i force the shortest path finder to go through some specific points ? i have used 20 points (from to line ) , and my network .and 10 points,i would like the path to go through them if there is a path . i used the shortest path finder to find the shortest path and it works great but i have some points , in network .i would like to go through this point if there is a path . as example , i have Pt.a - Pt.b (i found the path in network between A - B) but i have some points inside the network as Pt.c ,i would like to check if there is a path through pt.c or not even if it is longer .so, if there is a path then the path will be A-C-B ,if not ,the path will be A-B .i think , i should add to cost attribute but i am not sure ,how could i consider the Points.Thanks for help .
I'm trying to convert GTFS transport data to Shapefile using FME 2020.0.0.0 (20200309 - Build 20200 - macosx) Quick Translator, but I get this exception: << FME 2020.0.0.0 (20200309 - Build 20200 - macosx) FME Home Edition (node locked-crc) Temporary License: 234 days left. Machine host name is: YOS0897 Operating System: Mac OS X Version 10.15.3 (Build 19D76) Copyright (c) 1994 - 2020, Safe Software Inc. Safe Software Inc.Creating reader for format: General Transit Feed Specification (GTFS)Trying to find a PYTHON plugin for reader named `GTFS'The workspace does not contain user Python. FME will attempt to use a Python 3.7+ interpreterUsing Python interpreter from `/Library/FME/2020.0/fmepython37/lib/libpython3.7m.dylib' with PYTHONHOME `/Library/FME/2020.0/fmepython37'Python version 3.7 loaded successfullyPython Exception <
Hi Guys, Is there a way to sort linear polygon features by spatial continuity and then merge then until they reach an specific size? I have the following features which are basically a polygon which was chopped into different parts by a specific length of its center line. To give you a bit of context, I am basically trying to build a workspace that would split linear complex polygon (as the one below) into parts with a maximum of 1km2. However, these parts have to be continuity and not be multipart as they will be used to make separate enquiries in a website. For example sorting by Easting or Northing wouldn't work here as I would end up with separate parts mainly in the top right corner. Is there a way to do this using FME? Thanks
I have an ArcSDE Geodatabase created and stored in a PostgreSQL 11.1 Server. There is a Feature Class within the Geodatabase that has attachments. I have a ArcSDE GeoDB Feature Reader Transformer added to a Workspace, configured to read the Feature Class and its attachments and it does not read the attachments.
I have a request to produce files in a custom format that is almost but not quite an esri ascii grid. The header is different and the raster portion is individually hex encoded. I can deal with the header easily enough, but I'm a bit stuck on how to produce the hex encoded body. I can write an ascii grid file, read it back in as a text file, strip the header and then hex encoded it but that seems a bit elaborate. The RasterExtractor doesn't have ascii grid as a format, otherwise I would use that. Thoughts? Ex snip of a file 512512200000200000-31500 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 6 6 6 6 6 6 6 6 6 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3 4 6 6 6 6 6 6 6 6 6 6 6 6 0 0 0 0 1 1 5 6 6 6 6 6 6 6 7 a 10 28 43 60 7e 9c b9 d3 ee fe ff ff ff ff ff ff ff 0 1 4 4 6 6 6 6 6 11 22 37 54 71 8e ab c9 e5 f1 fb ff ff ff ff ff ff ff ff ff ff ff ff ff 4 6 6 6 6 6 6 7 b 13 28 44 62 7f 9d ba d5 ed ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff 4 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 10 22
How do I georeference a set of lines in fme? I know how to geofence the raster. But without georeferencing the lines the overlay will not match up?
Hi list.I'm using a SQLCreator to read (!) some data from our administration database. The query fails, because FME wraps my query into a SELECT-INTO construct, that requires "CREATE TABLE" permission, which my task (of course) doesn't have.Q1: Why does FME wrap my query into such a construct?Q2: What other ways do I have to accomplish a guaranteed read-only query?Using 2020.1Cheers
Hi guys. I have created ca 40 000 annotations for a basemap im working on and some of the angled texts overlap. Is there a good way to displace them, like a "negative snapper"? thanks for all the help i can get!
I am trying to read an esri file geodatabase that is zipped but I get this error Geodatabase Error (-2147024893): The system cannot find the path specified.Could not open File Geodatabase dataset `C:\\Instaplat\\workspaces\\TexasWorkspaces\\INSTAPLAT_PROTOTYPE.gdb.zip' for readingA fatal error has occurred. Check the logfile above for details I have attached a workspace that produces this behavior, any help is appreciated.
Looking above my CurveFitter doesnt seem to consist of a set of lines which i could then test? How do I get the image to be a defined set of line data? My project is attached. I just want to get rid of all the small lines and dots present after the last CurveFitter transformer. But I'm not sure each line is its own 'object' so Icant get LengthCalculator and Tester to work?
After the workspace opens up, the transaction log has the following msg. Download Url: https://fmehubproductionopsworks-appstorage-c2mc055amzj1.s3.amazonaws.com/transformers/attachments/000/002/194/original/LRS_GeoCoder.fmx?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=ASIAT4A3AD75FEQRHJVX%2F20201030%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20201030T170608Z&X-Amz-Expires=10&X-Amz-SignedHeaders=host&X-Amz-Security-Token=FwoGZXIvYXdzEBoaDNAdOXY%2Fmce9HjxeDSKwARlqeDWTDavidSlzQqexSVkTvA%2Fswh3OYE9WVRa6y47V8FLQezq%2BafVcIY1JbYiH3OD3T5zL3xTAuhWbc2KGBSi0WCEb2%2BrPEX%2BLksw4Xj4pqZ7Yzd0mOX4nkOT8ceTN%2FuitVkGXmtogAtWWa%2Fa0J48uSXJk%2FcuAEvLW4OgpWC05FyeOFDrS%2BVPb4wZQHKD%2BoYr9Ymzcwucxn6Pz0ZOgRom0ktwjZZnigJf2mEmp5%2BcwKJ6N8fwFMi3CjZewOdIhYe9pw%2Fc0ZWWLbqRP7D9QPA%2FfTKLGR9KsYOAGZibclpitR0IAhr4%3D&X-Amz-Signature=05676cc34a9e93f6fb09515ff93d3f3ed18828825b8fc07686a01b95b7eff91f - FME Server encountered an error.When I click on the above url, I got This XML file does n