Using transformers to modify data.
Recently active
Hello,I've setup four Workbenches, which I successfully get to run in sequence from a "mother" Workbench, which uses a sequence of Workspace Runners, waiting for each one to complete before calling the next one.It works seamlessly when ran from FME Workbench. But, I really need to automate this (this is what it's all about - I can't always be around to press the "Run" button unfortunately...).This is my first attempt in calling Workbench(es) via command line, and I just try the obvious: fme "C:\Users\User.Name\Path\Projects Shared\Project_Name\configs\4_Workbench.fmw" I tried first with the "mother" Workbench, and it failed. So then I tried with individual work benches, and they fail too. I logged separate log files for each of the five Workbenches (mother + 4 called by the Workspace Runners), and the logs for the 4 Workbenches called have a similar error (I did change some names on purpose, to preserve names of people etc. in paths and file names): ERROR |FeatureReader_4(QueryFactory
Hello Thererunning a simple workspace with Mapnik, the input is a line but I am getting box, no idea why
Problem: I download rasters (satellite images) with differten extends (but overlapping) and different cellsizes. I can not get them to align, whatever I do. I tried: - setting the largest to 'nodata' and using the rastermosaicer. I get an error showing a different number of rows. I also tried it by setting all data to 0 and using the target raster in mosaicer with 'maxiumum' as setting.- The above for both rasters (I was running out of ideas)- Exposing the raster properties of one raster and trying to use the raster resampler to resample the second raster: I get a rejected raster with this weird error: @%0: Failed to obtain raster from feature. Only features with raster geometry are expected - Exposing the raster properties and using the raster georeferencer (the raster gets rejected INVALID_FEATURE_ATTRIBUTES) and many, many more things. I can not get them to align and could use some help FME version 2020.0.0.1
Is there a way to view the Message from SQL/SSMS after running a SQLExecutor on a stored procedure?Context:We have stored procedures written for importing and validating records. The validating stored procedure (which runs other individual stored procedures) returns a log/report of any issues with more of a textual format than a table.When attempting to expose the output message from SSMS in the SQLExecutor, the only option you have is to expose specific attributes. This doesn't work with the log format mentioned previously.I've reviewed other forums related to this topic where others have had to go outside of the norm to accommodate this, but I think this should be addressed within FME to relay messaging from SQLExecutor from theRelated Forums:https://knowledge.safe.com/questions/82948/sql-executor-run-a-procedure.html
I have some start and end dates for activities. The start dates need to be created in FME using the previous activities end date plus one day, however if this date falls on a weekend I need to tell it to return the next working day. It would be even better if I could also exclude bank holidays along with the weekends. Any thoughts or ideas on how to do this would be greatly appreciated!
Using Snipper with a geometry that is composed by a IFMMEMulticurve, The Snipper returns 2x the values expected (as the multicurve includes 2 IFMELines).Let's take a look to the example: this is how it is seen on the Data Inspector: IdValuea = 10b40c60 Something like this sketch is the result:the points that their measure are beyond the minimum/maximum measure of the line, are located at the beginning/ending of each segment. How could I manage this behavior?
Hello,I am trying to create what I would call a pivot chart in excel using FME, I have managed to input my data which represents the number of exports from a certain area of a building by date&year; (similar to below - however my table has a lot more rows as it runs to 2030).DateAreaNumberUnitsExported01/01/2020Area 1501/01/2020Area 2401/01/2020Area 31001/02/2020Area 1201/02/2020Area 2801/02/2020Area 31101/03/2020Area 1101/03/2020Area 2501/03/2020Area 38Basically I am trying to get my data to look like this:-Area 1Area 2Area 301/01/2020541001/02/2020281101/03/2020158so that I have the date running down the side, the Area Number as the table header and the units exported in the relevant cell corresponding to the correct area and date. I would then like to export this as an excel fileHow should I go about achieving this?Thanks,Tom
Essentially I want to use an Attribute Value Mapper against a list. I have a csv lookup table of old ID's and new ID's. Then in my workbench I have a json attribute of a configuration file, which I send through a regex string searcher to get a list of all the old ID's in the config. Is there a way to replace all the old values in the list for their looked-up values from the table, so I can then reinsert them in the config? Or should I just hand this step off to python? I have about 20 features going through the workbench and around 60 features in the lookup table. Each json attribute has anywhere from 5-50 matches feeding the list. I've also looked at the List String Replacer but it doesn't allow me to import the lookup table like the attribute value mapper does. I'm not seeing a way of doing this keeping the transformers under a handful. How would y'all approach this problem? Thanks
Hi group (especially @mark2catsafe I think).Is it possible to build a custom transformer with Python with multiple INPUT tags? Much like what's possible with a custom transformer in Workbench.I have the multiple OUTPUT tags option covered, but can't seem to find any examples of multiple INPUTs.I've scrutinized an FMW file with an embedded custom transformer with two input tags, but can't find anything relating to tags, just a bunch of TeeFactory's.Is it possible to make one such? And if so, how should one define them in the FMX file?Cheers Lars
Hi,I would like to extract the project listing as well as the corresponding Lat/Long from the map content together with its attributes such as Project Title, Location, Project Type, Status etc. from the project linkurl: https://iaac-aeic.gc.ca/050/evaluations/exploration?active=true&showMap=true&document_type=project Sample project url:https://iaac-aeic.gc.ca/050/evaluations/proj/80774 I have limited past exposure to htmlextractor, any assistance will be much appreciated.
Hello,I have two layer of networks, one is base (red line) and another is candidate (black lines). Want to populate ID in candidate layer as per connectivity with base. All first intersect of candidate layer should get ID 1 then remaining lines should follow the order. Any help? Thanks in advance.
Hi Folks,I got a set of 235 points and I need to cluster them, but based in two parameters. I need to spatial optimizer them in clusters of max 5 points and maximum distance between them of 15 km or in groups with less them 5 points and maximum distance between them of 15 km. I am trying to use a NeighborFinder approach, but I got strugle into points that could be in on or more clusters and because of this, I don´t know how to optimize them.Any ideas or tips?
Hi Everyone, I have quite an interesting question on how one can "Rate" your Input data in the FME workspace. The idea is to use some predefined questions, and then check the Workspace if the requirements are met. If the requirements are met, the Evaluated table gets a Rating/Value. Once this is done, an HTML page is exported with the rating. I have made an example, but I find the process to be quite tedious, and can be a bit overwhelming on bigger workspaces. My Question is: Are there better ways to rate tables and create ratings on quality of the input data? Or should I rather work with loggers? So in my example, I have a table to Evaluate. I am using three different "Codes" to use for my Rating system Using Statistical Calculators, Aggregators and FeatureMergers, I add the Rating "CODE", to my Evaluated Table. The Workspace: The final result is a HTML:
I have a sql executor using an ODBC connection with parameters in it. The params are fed by published params and an inbound reader [into the executor]Only a few small columns are returned and typically less than 200 rows.-When I run the query with params it errors about every other time. Not much detail in verbose just 'Error running translation.' Then it terminates.-When I attach a logger to the result of the SQL executor the translation never errors. -When I hard code the sql executor [just for testing with no params] it never errors. Unless I have nothing attached to the 'result'.- In short the translation works with a logger attached to the 'result' of the sql executor regardless of params or no params, it fails with nothing attached to the 'result' regardless of params, and it works occasionally with params and no logger attached. I can run the translation in production with a logger attached but why do I need to? And why doesn't it work without
Hi.I'm trying to find self-intersections using GeometryValidator but it just keeps passing all geometry. What am I doing wrong?Above is a zipped shape file which I've tried running through a GeometryValidator in multiple versions of FME. 2015, 2017, 2018, 2020. Checking for self intersections in 2D. Always passes no matter what settings I use. Here's a screenshot.It's originally a rectangle that I've twisted so that it self intersects in the middle. To me it should be obvious that there's a self intersection but as mentioned the GeometryValidator fails to detect it. Does anyone know what the problem is?
I've been experimenting with the chart generator transformer and can't seem to get the background color to change, even after I change the color using the "Background Color" parameter under the Style section. This is for a bar chart. No matter what color I change it to, it will only keep the default white color RGB(1.0,1.0,1.0). It won't change the color in the preview or after I write it out to a png. The documentation states: "This parameter sets the background color of the chart. The default background color is white, with an RGB value of 1.0,1.0,1.0." FME 2020.0.0.1
Hello everyone! There were two adjacent DTMs with different resolutions(one is 0,5m and the other is 5m.). I resampled them to bring together and mosaick at 1m resolution. There seems to be no problem with 0,5m res. area in the mosaicked image, but after the resolution is reduced for 5m area, defects like a stair steps appear in 3D view(as seen in the image). So, how can i get a smoother suface for the downsampled area from 5m to 1m. Which transformers or parameters should i use in my workflow. Thanks a lot. @daleatsafe @daveatsafe @takashi @jovitaatsafe @redgeographics @deanatsafe @rylanatsafe @hollyatsafe @lenaatsafe @annabelleatsafe @steveatsafe
Hi there! hope someone can help.I'm trying to convert IFC into DAE, but having trouble getting the IFC Global ID into the DAE Name and ID properties.Any suggestions?cheers,ronald
Hi, I need to find and extract numbers from a string of text, numbers and characters (see example below). The conditions needed are that the number string can only be between 8 and 14 digits long.I'm inexpericed with writing Regex but following some previous guidance from this wonderful FME community I did make a start (see below) however it's not doing exactly what I need it to do.Initally I thought I had solved this until I realised the data has number strings of between 8 and 14 digits/ I'm using the String Searcher transformer. My expression seems to be finding strings of 8 (or more) digits but only extracting the first 8 digits. This means that when the number string is greater than 8 it cuts the trailing numbers off (se below).The data I have been provided with is messy to say the least!In addition to the above question I'd like to ask if its possible to identify and extract, from results of the above, number strings of 8 digits that start with the digit '23&#
HiI am trying to filter a dataset to show a features that are in set of values . I am using the Tester transformer with the IN operator. If I were to do this in an ESRI product, I could select the field (attribute) I want to filter and it would list all the unique values for that field to enable me to chose the ones I require. However, I cant see a way to get that info in FME - I have to stick in another transformer and inspector and then copy and paste the values I want into the expression, which is far from an ideal workflow.Please could someone tell me if there is an easier way to do what I want to do? Many thanks
Hello Guyswe need to filter thousand of address into Odd and even number,we are using the test filter, I think we should use the reg expression for the condition,any idea how to write the expressionThanks
Hi, I have to fit the maximum number of polygon with specified dimensions into another polygon.I have to analyze two positions: vertical and horizontal and choose the most optimal placement (the largest number of polygons inside)for example:Do you have an idea how to do it in FME?
I have a floating point number (i.e. 41165.2823011227) that I need to convert to year, month, day, hour, minute, second. All I've been told is that the floating point number is the number of days since January 1st, 1900. After a little bit of research, it looks like you can convert these in Excel (make sure you have 'Use 1904 date system' unchecked under Advanced Options). When I enter the floating point number and format the cell to Date, I get 9/13/2012 6:46:31 AM which looks correct. Is there a way in FME to accomplish this same conversion? More info on the 1900 Date System here: http://support.microsoft.com/kb/180162
I have 2 tables say table1 with a geometry column geoloc, and table2 with a geometry column geom,. table1.geoloc in general contains table2.geom. I want to pick those rows where the condition is such, and combine the two tables and create a 3 rd table with both the details including the geometry colmns. I want to rename the columns before inserting into 3rd table
Hi, I see FME has an OSM XML data Reader. I wonder if its possible to have this reader/converter on the fly using transformers. I use the HTTPCaller to extract data via the Overpass API and I would like to convert the output XML into features, but that's not easy as I first tought because of the way OSM data is structured. Is there a way to convert the xml data returned by the HTTPCaller into FME features without saving the XML on disk and then using the OSM Data Reader? Thank you! Maxime Demers