Using transformers to modify data.
Recently active
Hi,I'm using the SQL Executor transformer to pull back the most recent records from a SQL server DB since the ETL was last run. The last run datetime will be held in in a Postgres table and pushed through as a parameter to the SQL Executor, the issue here arises when I push the datetime parameter through to the SQL Executor As a test and to trap the error I've used the attribute creator transformer to generate a datetime attribute which would mimic the last run datetime from Postgres, and hence push this through as a parameter. I've set the value = '2018-01-14 09:18:00'If I run SQL Executor with a set datetime ('2018-01-14 09:18:00') the SQL executor runs successfully and returns records. However if I run the same query replacing the specified datetime value with the the parameter I get the following error message, despite the value and format being identical?--'. Provider error `(-2147217900) Incorrect syntax near '09'.'The error message points to an issue with the time element of
Hi there,I'm trying to process an SQL statement for reading a ESRI filegeodb.I want to concatinate the statement in my first workbench and then give it to my second workbench via the WorkspaceRunner. - The first workbench aggregates distributors attributive with a seperator ",". So at the end there is for example a string '0781A21','0761A1'- My workbench2 should dissolves areas based on the distributors. My Reader where clause is actually: DISTRIBUTOR IN ('$(concat)') tried also DISTRIBUTOR IN ($(concat))$(concat) is the published parameter containing the statement. As an example the SQL statement I want to process in the reader of workbench2 should look like: DISTRIBUTOR IN ('0781A21','0761A1')How do I need to definine the statement in workbench1. The workbench2 is actually only processing the first distributor but not the second,third... translation log is --concat '0781A21' --'0761A1'Can find my mistake so I need
I am trying to make 1 tweet per hour with Tweeter using Decelerator, but I get this error with every second tweet:2018-04-05 20:32:30| 16.8| 7.4|ERROR |HTTP/FTP transfer error: 'Timeout was reached' 2018-04-05 20:32:30| 16.8| 0.0|ERROR |Please ensure that your network connection is properly set up 2018-04-05 20:32:30| 16.8| 0.0|ERROR |No proxy settings have been entered. If you require a proxy to access external URLs, please ensure the appropriate information has been entered 2018-04-05 20:32:30| 16.8| 0.0|INFORM|Updating access token for 'sami Google Gmail'
Hi,I always use RasterToPolygonCoercer to convert Rasters to Polygons (which, by the way, takes much much longer than the ArcGIS counterpart). However, RasterToPolygonCoercer no longer exports the raster values, although it did before. The Label Attribute no longer shows up in subsequent transformers.Is this intentional or a bug? If intentional, how do you extract raster values into polygons?
I have created a very simple list using the list builder that contains multiple values of the same key (stationId). the list looks like this in fme inspector: I want to pass all the statonIds in this station list into the sql executer transformer into my WHERE statement. The sql executer recognizes this list however, it only allows me to specify a specific element number in the list like this: where originstationId in (@Value(StationList{0}.stationId))The problem is I don't know how many values will be in the list each time so I can't hard code the list element number in it. I would like to pass all values in this list into my query.
Why doesn't this work?@Value(SP)=FD?@Value(PCT):0 If the value of attribute SP is FD, then use the value of attribute PCT, otherwise 0. I tried using 'FD' and "FD" too. 2018-04-05 22:58:55| 8.1| 0.0|WARN |AttributeManager_19: TCL Error Message: 2018-04-05 22:58:55| 8.1| 0.0|WARN | invalid bareword "FD"2018-04-05 22:58:55| 8.1| 0.0|WARN | in expression "FD=FD?10.0:0";2018-04-05 22:58:55| 8.1| 0.0|WARN | should be "$FD" or "{FD}" or "FD(...)" or ...2018-04-05 22:58:55| 8.1| 0.0|WARN |AttributeManager_19: Failed to evaluate expression 'FD=FD?10.0:0'. Result is set to null.
Hey guys!I'm having trouble with the RasterMosaicker not merging images very well. It's obvious to tell where the imagery is being mosaicked (please see attached image). Is there any way of getting rid of this? I was thinking (from previous remote sensing knowledge) that I could manually stretch the images to have them looking the same and then mosaic them, but I am unsure of how to complete this in FME. Help please!Sam
Hello,I am trying to export vertex coordinates from mesh to the attribute, but I am getting this error:TypeError: Failure to convert list values to native values.And here is the code:class FeatureProcessor(object): def input(self, feature): mesh = feature.getGeometry() vp = mesh.getVertices() feature.setAttribute('VertexPool', vp) self.pyoutput(feature)
Hi everyone,I would like to know because some logs in FME Desktop show me the message |Translation was SUCCESSFULBut there are logs that show the results but not the message Translation was SUCCESSFUL:2018-03-27 07:10:46|2344.9| 0.0|STATS |EstatisticaFluxo 11 2018-03-27 07:10:46|2344.9| 0.0|STATS |============================================================================== 2018-03-27 07:10:46|2344.9| 0.0|STATS |Total Features Written 11Both Log are workspaces that run properly.Thank´s
Hello,I have a network where this are many connected lines on nodes I wanna make from the ones having the same value of an attribute to get connected and became one feature. Is there any way to do it ? Thank you
Hi all,It's been a while since I've been working with this FME Desktop transformer. Today, I found something that woke me up and made me think HOW the "Inside Point" feature (one of the three options) is generated using this transformer. The situation is this one: Input: One polygon feature from a Shapefile.Using FME Desktop 2016.1 (tried older versions and same results)Image:I don't know if you can appreciate that the INSIDE POINT generated is in the same border of the polygon, so, after that, if I try to "Overlay" with other transformers like PointOnAreaOverlayer... it'd give me a non-overlay output.After all this description, I wanted to know "How" is generated this "point" output using the CenterPointReplacer transformer: Is there any potential parameters as could be Bounding Box, Number of coordinates, Multipatch feature... to be considered?Knowing that information, I could anticipate these situations and get it ready before
Hi,We have a proces, that converts some schema-less XMLs into MS/SQL. The output definition is set to "Automatic".It now seems, that later versions of the XML files include more attributes than the original versions. These new attributes are output as-is, but cannot be seen in the workspace.I've tried to update the reader feature types, but even though the attributes are present in the data files, they don't show up in the workspace.How can I by default remove all "unknown" attributes coming from the XML files ?Oughtn't the Attribute Manager have an option for this ?Cheers.
Hello,Can somepne please help me using the MRF2DIntersector ? I'am trying to remove overshoots but I got confused and lost within the transformer's parameters. Thank you in advance.
Hi,I've encountered a problem when using a GeometryReplacer With LineStringZInvalid WKT encountered: LINESTRINGZ(541502.5560000000 152585.6960000000 583.544, 541502.4660000000 152585.4560000000 583.775, 541501.2901908699 152581.1464218800 0.0)I do assume that LinestringZ is not an OGC WKT recognized format yet, although it is recognized as a valid OGC WKB format.http://portal.opengeospatial.org/files/?artifact_id=25355My goal is to check the geometry validity from my linestringz features before sending these to my postgis database.SELECT ST_ISVALID(ST_GeomFromText('LINESTRINGZ(541502.5560000000 152585.6960000000 583.544, 541502.4660000000 152585.4560000000 583.775, 541501.2901908699 152581.1464218800 0.0)'))Any idea how I could deal with this on FME 2018?
I have an UpdateDetector that compares incoming WFS records with a static table which then gets updated. I was supplying the Attributes to Match value from a user parameter. However, I was asked to make it work with a CSV file that supplies the required values. I was able to create a comma-delimited list by using a listConcatenator.However, I can't find any way to make the resulting attribute available to the UpdateDetector. I tried just passing it in to the Original node along with the records to be tested, but this always results in a spurious row appearing in the Delete port that just contains the attribute. As a work-around, I can filter out the unnecessary row to ignore it; however, this is a bit kludgy and I'm wondering if there is a better way to do it. I've tried inserting the attribute at other points in the work flow, but this either results in the attribute not being available to the UpdateDetector, or else the same thing happens. It seems like it should be possi
Hello, I have a shapefile where some connected lines have to get connected and merged into one feature. However, it seems like there is a problem in my use of LineCombiner and MRF2DJoiner.Here is my shapefile : https://drive.google.com/open?id=1Iwe0FDMePozczihABOvJ_PBlre7xRAisAttached : a picture of a linear feature who has passed through the LineCombiner but still divided in 2 llines altough there are both connected. Thank you.
I am having a problem with the TopologyBuilder transformer. I have "Assume clean data" set to "No", but it is not cleaning the data properly. Some of the edges are broken up according to the other lines, but others are not. These images are the result of my TopologyBuilder transformer, with the vertical line in the middle starting as one long line before being sent to it. As you can see from the highlights, some of the lines are not being split properly.I have zoomed in on these features as far as I can go with QGIS and I do not see a gap between them. I would assume that this is due to some imprecision in the snapping tolerance but I cannot find such a parameter to adjust.This is the transformer as seen in the workbench:
Hello, I have a problem with the LenghtCalculator transformer. The point is that, when I calculate distances of linear segments I expect that visually long ones have bigger distance values but it's not exactly what happend. I want to use it along with a TestFilter to delete lines of lenght below a value of my choice. Thank you in advance. Here is the shapefile I'm working in : https://drive.google.com/open?id=1-vycWGAvos7pjCxE7tLXHroA69G1M5-G
Hi everybody, ik am trying to read an url that gives me json-format answer.the url is like: https://geodata.nationaalgeoregister.nl/locatieserver/v3/suggest?wt=json&q;=Nieuwe Steen 1 Hoorni want to read the values of the attributes "type" "weergavenaam" "id" "score"regard,Bert punt
I am trying to convert a dataset from XML (KuntaGML) to shape but cant get it to behave properly. I am using a dynamic workspace and the output is 80:ish shapefiles. Everything exports but loses its coordinate system and gets is geometry from the first feature read. I have tried adding the desired coordinate system up in the left corner of the workspace but it only seems to be written to half, or so, of the files output. As for the geometry I have tried both "from schema" and "first feature defines geometry" none of them make any difference, everything is output as points, even though all geometries are in the XML. What am I doing wrong?
Hi,I am currently trying to get a PDF2D file with several layers (a background map and some additionnal information). To do this, I used a sorter, a PDFPageFormatter and a Geospatial PDF writer.Everything works fine, except for the background part. I use a JPG2000 reader. No matter how I try to make a PDF out it, it fails (by failing I mean, the pdf file is created but no background is visible or it even makes Adobe Reader crash). I have tried with only JPEG2000 reader and PDF2D writer or this some intermediate transformers, nothing seems to work.Are there any parameters I missed?(I use FME 2015.1.0.0 and Acrobat 8). Acrobat 8 always crashes when loading the resulting file. Acrobat Reader XI somehow manages to load the file, but even if the layers are there, the background layer is empty and so are most of the other layers)
I'm trying to calculate the percentage of null values per feature class in a dataset. Null values are defined by '-99999' or 'noinformation' or 'No Information'.I have hundreds of feature classes, each with hundreds of attributes named differently. So building a workbench calling out each attribute specifically would be very time consuming. This needs to be a dynamic solution.So far I've tried an AttributeExploder followed by ListSearcher, but I'm having trouble calculating totals based on feature class.
The attched FFS file contains multi-geometry objects where one or more of the parts are arcs. I need to do some checks on the parts that are not arcs. So far I haven't been succesful in getting only the non-arc segments out, so any suggestions would be very welcome.I tried the GeometryPartExtractor (checking for child elements of type IFMEArc) but that only selects the entire object, I want to break it up.And stroking the arcs is not an option...
Hi, I use XML flattener like this to expose an element. What I want, and what this does, is make a column with the element name as its name, and put the value of the xml element that was matched as its value. The problem is when "ElementToMatch" occurs multiple times in the XML file. It only makes one new column and puts the first occurring value that was matched inside. Is there a way to make as many columns as needed so that each found value ends up in the results? Order and empty values (if only one is found for example) don't matter.Thanks a bunch in advance.
Hi there,I'm looking for a way how to bring together these two data-sets. 1st data-set contains records with unique ID and several attributes: Connect_ID Facility TypeName 3 Cafe Ice-creamAAA 12 Store GroceryBBB 25 Store ElectronicsCCC 2nd data-set contains IDs, days and operational hours:Connect_IDDay of the weekOpensCloses3Monday8:00:0018:00:00 3Tuesday8:00:0018:00:00 3Wednesday8:00:0018:00:00 3Thursday8:00:0018:00:00 3Friday8:00:0018:00:00 3Saturday9:00:0014:00:00 3Sunday12Monday8:00:0017:00:00 12Tuesday8:00:0017:00:00 12Wednesday8:00:0017:00:00 12Thursday8:00:0017:00:00 12Friday8:00:0017:00:00 12Saturday9:00:0015:00:00 12Sunday25Monday8:00:0018:00:00 25Tuesday8:00:0018:00:00 25Wednesday8:00:0018:00:00 25Thursday8:00:0018:00:00 25Friday8:00:0018:00:00 25Saturday9:00:0018:00:00 25Sunday What I would like to do is bring these tables together, but they should have 1 row per ID, so the days and the opening hours should be transposed to