Using transformers to modify data.
Recently active
I have text where spaces between some words is missing. These spots are easy to find with regex because it is always something following by capital letter without the space. I can't workout how to add the space though. My String Replacer looks like this: @ReplaceRegEx(@Value(Speciality),([^ ])([A-Z]), \\1, \\2) The output it produces is:Anxiety, Panic & Phobia shildren & Adolescent selationships Outside work (ndividual counselling )eadership Original:Anxiety, Panic & PhobiasChildren & AdolescentsRelationships Outside work (Individual counselling)Leadership So it adds space, just not where I need it and removes the capital letter. I tried many variations, but none of them produces the needed outcome.
My flow includes a looping Custom Transformer that gets records from a paginated API until there are no records left to get - unfortunately the API doesn't have a "last page" flag or anything, so the only way to check that the flow should end is to keep trying until we get a 400 Bad Request status code with a message like "Request out of range". When this happens, the loop should break and output all the features that have been created up to that point. At the moment, the only way I can get this to break is with a Terminator, which is (a) making the flow look like it failed, and (b) not allowing me to continue with the next steps of generating a HTML report. Is there a more graceful way to exit a loop? The transformer looks like this:The relevant part in the flow itself looks like this. The Tester is doing exactly what it's supposed to, but it doesn't seem to be reaching the HTMLReportGenerator.
Hi FME Community,I have converted my Excel file into a CSV file. I would like the heading to be automatically deleted.In the picture I have shown with red marking which part has to be deletedI would be grateful if you could tell me whether there is a solution.Thanks in advance
Hi,I have a scripted python parameter which generates a unique id. This parameter is used in a lot of SQLexecuters to to create and insert into temporary with this id in the name of the table and such. When I run the workspace it works fine, but when I put feature caching on the value of the parameter seems to change each time it's used in a SQLExecuter. Is this a knwn issue? Is there a simple work around?I use FME 2021.1.3.0. I don't know if it worked before. Thank you,Arno
Hello, so I want to find a missing value as all the "Unit" must be in sequence in each floor.Here are my rules:All the units should be assigned sequentially to the corresponding floor, meaning 1/F: Unit = 0001, 0002, 0003, till to the largest number in the data2/F: Unit = 0001, 0002, 0003, till to the largest number in the dataI have "FloorNo_FromFloorPolyID", meaning the level of floors."Test_Unit_No" meaning the numbering of the unit.I want to find out the missing unit number of each floor as the input data will have a lot of floors in the future. As the sample shown below, Floor 10 is missing Unit 0001 to 0004.Could someone please give me a hand. Should I use python caller? Yet I have no clue how to write script ... please help.Thank you in advanced.
How convert to complex XML to creating relational database tables ? using xml hieararchy
I have xml file and convert relatinal database tables for using xml hierarchy(parent-child) so is there any automation tool for this process ?
Hi all!My CAD layer is a mapimport from shapefile. So, it basically still has attributes when I converted to a layer with point type. When I wanted to export again to shapefile through FME, I don't know how to retain those attributes. In CAD, actually you can use MAPEXPORT to retain attributes, but then it will be time-consuming if you need to export one by one when you have many. So guys, do you have a solution for me to solve this problem? Thanks in advance!
Hi all,I have a CSV which I read into FME desktop. It is bore hole data with attributes:site: Adepth: 0depth: 20depth: 30end depth: 35 I want to select the max(depth) for each 'site' and update that value to be 'end depth', then proceed with other transformations. Note sure what transformer to use to do this?I've looked at Tester, inlinequerier...help ? thanks
Hello everyone,So I want to do something similar to "IMDF Validator".My data format is "GeoJSON" in one single file. When I import the data, it will break into 4 feature types. I just not sure how to set up something similar to IMDF validator, with "Creator" at the front (just like the picture I uploaded? Also, the user parameter of IMDF validator is set default in ZIP file, yet I have to set it to geojson file.Should I use Create Custom Transformer? But I am not sure how to set the parameter. It is because my data will be getting more and more complicated. I have to make it more tidy first.Thank you in advanced. Zach
I'm trying to import a text file without headers to FILEGDB while using the SchemaMapper Transformer to rename the columns. I've followed tutorials and articles but am not successful. Columns aren't being renamed and when I run the workspace no features are written.Any tips would be greatly appreciated. Here are screenshots of my parameters and workspace: Schema Map (CSV):SourceAttribute,DestinationAttributecol0,TYPEcol1,STRAPcol2,SECTIONcol3,TOWNSHIPcol4,RANGEcol5,MAP_IDcol6,CONF_FLGcol7,ADDR_1col8,ADDR_2col9,CITYcol10,STATEcol11,ZIPcol12,DOR_CDcol13,SUBcol14,DSCRcol15,PLAT_BKcol16,PLAT_PGcol17,NH_CDcol18,PCT_SOHcol19,INC_FLGcol20,BASE_YRcol21,ASD_VALcol22,SOH_VALcol23,BLD_VALcol24,JST_VALcol25,TAX_DISTcol26,TAX_DISTcol27,TAX DISTcol28,MILL_CDcol29,SQFTcol30,ACREAGE
So I have multiple columns of data that return a yes or no value. I'm really only concerned with the yes value. When the value in the Cut Grass attribute is 'Yes' - i want to replace the Yes with say "cut grass to 100mm"Then i have another Yes value in Remove Flammable materials column and I want to replace the Yes with "remove materials". Is there a multiple string replacer transformer that I can use. I need to do this for approx 13 different attributes. I have read about string replacer or attribute value mapper. But whilst string replacer can replace multiple attributes to the same replacement text it doesn't allow for differing replacement text individual to a column.
I have set up a python script to run a workspace through the FME Python API using FMEWorkspaceRunner. Python is throwing an error called 'FMEException: 1: Failure running workspace "<my path.fmw>" '. I did some troubleshooting by removing the HYPER writer and replacing with a csv writer, then a gdb writer. Both of those writers worked fine. Also, the workspace works fine without going through the API. Something about the HYPER and the API. Any suggestions or known issues? Thank you, TylerFME 2021Python 3.7
I have time-series data collected at 5 minutes intervals and I would like to summarize or average it to the daily interval. How do I go about it in FME? Thanks
Hi all. I'm reading five feature types from Oracle using a Feature Reader and I want to suffix each of the attributes in each feature type with a text string. The reason for this is that I'm running some line on line and line on area transformers and the attributes from each feature type have identical names. The end goal is to generate a dynamic schema (with renamed attributes) on the output tables based on merged feature types from the transformers mentioned above. Is the bulk attribute remover the correct transformer to be using here? Thanks,Michael What have I missed?
Hi, I need to validade if the sum of the numbers is pair or odd. How to make this?
Hi FME Community,I would like to reproject my file into another coordinate system. I am looking for correct coordinate system. ArcMap gives me a correct result. FME gives me wrong coordinate after the reprojector.the pictures show which coordinate systems I used in FME and ArcMap. In addition, my file belongs to Germany. Thanks a lot in advance
I wonder if aynone has expericence with using asyncio in python FME?I've been trying to decorate with some asyncio.coroutine and do some async def, but I cannot grasp the whole picture on how to combine a syncronized FME project with an async library like asyncio.Anyone who would share their knowledge on this topic would be Awsome!Paal
Table1:table1_id:id-element-1.2.1.1.3(xml_id)id-element-1.2.1.1.4(xml_id)id-element-1.2.1.1.5(xml_id) Table2table2_id:id-element2-1.2.1.1.3.1(xml_id)id-element2-1.2.1.1.3.2(xml_id)id-element2-1.2.1.1.4.1(xml_id)id-element2-1.2.1.1.5.1(xml_id) I want this result:Table3:table1_id table2_id ..3 ..3.1 ..3 ..3.2 ..4 ..4.1 ..5 ..5.1 Thanks
Hi I have a polyline dataset with X,Y values but the Z field is empty. I'd like to generate the accumulating distance of each polyline vertex as the Z field. Essentially I'd like to just add distance as the Z value.
I am new to the i3s ESRI format and am wondering if there is a workflow or transformer or set of steps you need to take to convert OBJ to i3s?
similar post which describes better but there is no actual answer where /how to choose where data is saved on server. I dont mean the zip that works already I mean control where the files that user uploads will be saved. Is it possible to control where the Server App download service will download files? (safe.com) Using FME Data Streaming, the user selects one or multiple files to upload, processes those files and it works so the resulting report is downloaded through a zip. My problem is now what if there are multiple runs at the same time? I managed to use the FME_JOB_ID to create subfolders with my logs. for examplein my fme_server_data_reposatory however all files are always uploaded in some weird temporary guid folder.If I use "upload" files in my app, how can I choose where those "temporary files" should be saved? I then want my job submitter to use those folders to look for the data. This is to separate so the result logs for different runs doesnt read the
I don't know if this is already answered somewhere already but couldn't find it.This is in regards to my previous thread about aligning randomly distributed line geometry as per building footprints. Now, I could find GPS traces as point data to align my line geometry as per the points.In the image below: The black line is the approximate required solutionI tried using NeighbourFinder with 3m distance and then MeasureSetter for putting weights. Ideally, I wanted that points towards the center are weighted more than the outer ones. I have attached some sample data for the same. Could someone help me out with any ideas?Thanks.
I have groups of points (2D centroids) that I want to declutter by removing points so that there is a minimum distance between the remaining points whilst retaining the overall "shape" of each group. The PointCloudSimplifier seems to do this, but is there an alternative for 2d objects? If not, is there a way to convert regular ol' points to fancy point clouds? Or is there an another, better, way to achieve the desired result?
I am trying to do an insert to CARTO table. It is mandatory to not drop the table because it is necessary anytime a table is created to make a specific SQL statement. This table just has to have the last insert values so a truncate command is required. I have tried with a SQL Executor with two statements. Truncate and Insert. What SQL Executor does is a truncate for every insert. At the end I have a table with only one row, the last value inserted. Any ideas?