Transformers

I'm extracting data nightly from JSON services of which have no validation. These datasets have over 100 columns. Is there way to import a schema into the attribute validator so for every column it would test data type and max length? It would take forever to test data type, structure and max length for every column in every dataset, but my fme processes keep failing.

Hi,Is there an easy way way to mange the configuration files path? We are migrating our network shared drives where resides these configuration and we want to avoid to re-install FME Server. Regards.Etienne

I have a workbench that works for 300k entries but seems to run out memory for 1500k entries. The problem happens at the StatisticsCalculator level where I ask to calculte a mean using a group by an attribute. Does someone have an idea on how I can proceed in order to move further.. Thanks.

Folks,This is a question of cleanup and an answer here will decide what technology is best for dealing with this issue.I have a number of Mapinfo tables that should contain typical simple multi-SEGMENT polylines.However due to some sort of conversion or creation error some of the objects are mutli-SECTION polylines. For those unfamiliar with this object type what I mean is a series of LINES that don't perfectly start/end at the next line in the chain have been aggregated into a single object. For Mapinfo's pupose this looks like a single polyline but doesn't have the same properties. Each SECTION maintains it's individual "sub-geometry" within the multi-SECTION polyline.Now what's happening is that when these objects are converted via FME to DWG the only aggregate type DWG supports is a thing called a block. Now what I'm getting is few 100 blocks mixed with a few 1000 true polylines.As an aside the recipient of the DWG didn't know what these oddly

Is there a function or method for returning the date of the last Saturday of any given month? Input attribute would be formatted 'April 2018' or 'September 2019'. I'm currently doing this by manually inputting the correct dates in an AttributeCreator conditional statement. I'm looking for a method that would not require conitinual maintenance.

Hello,I meet with the problem.After I convert the revit rvt to rvz format,and then using FME to convert rvz to cesium b3dm format.The result can be view in cesium but the components are not separated but joined together.When I selected one of components of the model,the more components be selected.Therefore I want to know how to resolve this problem.Thanks a lot!

I have buildings with very complicated roof structures which I need to extrude to the terrain level to create new models.During the process I need to use the GeometryCoercer to convert them to fmepolygons. The process was unsuccessful as many surfaces were missing.This error message was indicated..GeometryCoercer: Cannot coerce from IFMETriangleFan to fme_polygonHow can I overcome this ? Takashi, can you help me?

In FME Desktop I have had succes connecting to a Dynamics 365 test instance using the 'Microsoft Dynamics 365' Web Connection and a simple username/password (and client secret etc. of course). But now I need to connect to our production Dynamics 365 which is set up to use SSO. No matter what username/password I use i the connection I get this error:Updating access token for 'remu01 Microsoft Dynamics 365'HTTP Error: 400 - Bad RequestHTTP Error: 400 - {"error":"invalid_grant","error_description":"AADSTS70002: Error validating credentials. AADSTS50126: Invalid username or password\\r\\nTrace ID: fc59aa9f-ed03-4503-b7f6-2efc7aa24c00\\r\\nCorrelation ID: efcdd9b0-3969-4107-9645-2a69a762f4b6\\r\\nTimestamp: 2017-12-05 11:19:54Z","error_codes":[70002,50126],"timestamp":"2017-12-05 11:19:54Z","trace_id":"fc59aa9f-ed03-4503-b7f6-2efc7aa24c00","correlation_id":"efcdd9b0-3969-

I have many faces that I want to rotate around 3 axis to make them as flat as possible. See attached workspace. I get the SurfaceNormalCalculator and CenterPointExtractor. And planned to use the 3DRotator or the 3DAffiner to rotate around the centerpoint of the object to get it as "flat as possible. However I can not figure out the correct calculations!Any help?

I am writing a routine to check an incoming dataset before loading. The first step is to make sure the dataset has all the required attributes, the second step is to make sure the values in the attributes are valid. I am using the AttributeValidator for this second step. Unfortunately, when I am validating a value, I have to hardcode all the values in the Rule Configuration box. I would like to be able to read a table and get these values and populate it in the Rule Configuration box. How can I do this?

HelloI have 123 CSV files as input with geometries written in WKT format. However, the names of the geometry fields vary as well as the geometry types. E.g. most of the geometries have name 'D_Position' (can be point or line), but there are also some called 'Location' (point), 'Boundary' (polygon) etc. I tried to solve this with several GeometryReplacer (one for each geometry type) as shown on picture below. I thought that it will be like an 'if else' statement. Try create geometry for D_Position, if not possible (rejected) try Location, if not possible next one etc. But this doesn't seem to work. I get 121 tables going through the 'D_Position' geom replacer, even tables that don't have D_Position field. The remaining two are going to the second replacer because the value of D_position was null. Any tips please?

Hi, I am trying to do the following:I have a total number of n adresses (points) spatially divided over a given area. I want to group them into x clusters using y members per cluster. This has to be as spatially optimal as possible.As far as I know, it should be something in the lines of a k-means algorithm.Actually, the Neighbourhood Aggregator comes close, but I want to set a fixed number of members per cluster, not a minimal.Anyone got any ideas? I already tried working with the cluster modeller, to no avail. Thanks in advance!Flip

Hello Kind People!I would like to create list of the final matches in my POI dataset. Currently I have table that contains pairs of duplicates (table on the left side). However, I would like to create final list, which says if POI where ID=1 is duplicate with POI (ID =2), and POI (ID=3) is also duplicate for POI (ID=2). Then it is obvious that POI (ID = 1) and POI (ID=3) also have to be duplicates.I would like to ask if it is possible to create this kind of list in the FME, if yes which tester can be used to do it.I will be grateful for all hints.

Hello, I had written some scripts on other platforms and ships count is one of them now I want to replicate that using FME but I have just started learning FME and due to lack of time I have to move faster so If you have the suggestion please reply to this question.

Hi All,  When i'm trying to export the Auto CAD landbase objects to Smallworld. Getting the following error. Please help me in this regard. Thanks in advance. Smallworld Translator Error: No URN handler for class unset

Hi, I am trying to georeference some ECW files. I have TAB files which contain ground coordinates of the ECW extents and I've been able to extract these using attribute expose, filter and string extractors. What I now need to do is get these values associated with the min and max extents of the ECW but i'm not sure how to approach this. The Rastergeoreferencer and Raterextents coercer looked promising but neither have the option to apply the coordinates ti the ECWfile. I wondered if featuremerger might help but not entirely sure it would. Any guidance/assistance/advice anyone has about this would be gratefully received. Thanks in advance, Jake

Hello: I am trying to piece my way through building a workspace to process surveymonkey responses. I'm using an HTTPCaller to get the results. However, I have roughly under a thousand responses and I have a max limit of 100 responses per page. I take the JSON results, validate then and use a Flattener to get the attributes I need. But I have to go grab the next 100 results, then next and per the SurveyMonkey documentation, I need to fetch 100 results with the resource url retutned in the links.next field (ex. https://api.surveymonkey.net/v3/surveys/{survey_id}/responses/bulk?page=2&per;_page=100). The issue I have is I need guidance on what's next. I added another HTTPCaller and added the above to it thinking it would get the next results but it's not responding correctly. I know I have to loop and the max will be the number of responses / 100. I could use a good push in the right direction if anyone has done something similar. Thanks in Advance

UnderGroundCable and OverheadTransmissionLine Line are two feature classes. some part of circuit A-B is UGC and and some is OHTL.Both feature classes are related with the Electric Line Table.In the ElectricLine table should be one record with the Circuitname= A-B and other common attributes and length should be UGC=OHTL .Relation is one to many by CircutName field.how i can do this by FME without creation duplicate record.Thanks & Regards, AZA

In ArcGIS there is a tool called "Hot Spot Analysis (Getis-Ord Gi)" under Spatial Statistics Tools > Mapping ClustersI am wondering if it is possible to replicate this in FME ? The example I have concerns "delay minutes" based on incidents on the UK rail system, so it is the "Delay_Minutes" value I wish to be evaluated.

Dear FME users,  I’d like to calculate the median of all overlapping pixel values from 24 input raster bands.  Do you have an idea how to solve it? Can I use the transformer “RasterExpressionEvaluator”?  Thank you very much.  Konrad

Dear FME Users,  I’d like to process 73 input NetCDF-files. The files describe 3 days (73 hours). Every single file stands for one hour. The NetCDF-files don’t include any useful time attribute.  What I need is the timestamp for every single input written in an attribute .The data type should be “date”.  In the following you can take a look to the assignments (input files -> time):  - HRES_ENS_2017062200+019 -> June 22, 2017 “07:00 p.m.” - HRES_ENS_2017062200+025 -> June 23, 2017 “07:00 a.m.” - HRES_ENS_2017062200+071 -> June 24, 2017 “11:00 p.m.”  What I can do in FME is to extract the substrings I need (e.g. “2017-06-22-19”).  I’ve tried following transformers too: “DateFormatter”, “DateTimeCalculator” and “TimeStamper”.  Do you’ve an idea how to solve it?  Thank you very much and best regards!  Konrad

Hello, I have a cad file that contains lines, points, poligons and surfaces and i want to filter the geometry and in the same time to merge all the line on a single feature class, the the poligons , points, etc . I haven't found any transformers that can help me with this. Can you tell me if there is any transformer like "Merge" function in ArcMap? I was using a model builder to merge the features after the translation. Also the same model was used to calculate fields or to add a new one. Is this possible in FME?