Using transformers to modify data.
Recently active
Looking to do histogram matching. From research, the preference is to be in a color space with intensity, therefore HSV or YCbCr. I've tried RGB matching but on the darker sets of satellite images, it does not match well when its 'brightness' increases. Is there something I can do/use in FME to convert from RGB to HSV ? Can I do this in python? Read in a feature and output a HSV image?
Hello - sorry if this is a very basic question but I'm struggling to convert a JSON response that is received from an API in to tabular data.The response is sourced as per the following:I've included two objects (apologies if 'object' is not the correct term) in the following .txt:I would like to generate tabular data from this response - i.e. based on the attached file I would like a new row for each 'object' (denoted by the "OrganisationID" value) with a selection of the values within this 'object' as attributes on the row.I've read the JSON tutorials and have tried various combinations of JSONFlattener, JSONExtractor and JSONFragmenter but with no joy.I would be extremely grateful for any advice that anyone can offer. Thanks in advance, Matt
hello , i want to design with sql statement on fme .i have coordinate system on a city and i want to know which cables are over lapped the border . if the cables are over lapped the border then change the colour of this cable .please if someone can tell me how can i do it .i will be thankful for him .Thanks
Hi there, I am a newbie in FME. So please accept my apology if my question sounds stupid. I want to calculate the year of the particulars date on FME. For example, I want to calculate the year of 31st March of the current year and next year. Similarly, I want to calculate the year of 1st April for the current year, and the previous year. These calculate years along with dates would be stored in columns. Looking forward for your guidance.
I am trying to determine which transformers to use in FME that perform the same tasks in ArcGIS. (I am working with the 2015 version.) Two polygon layers representing parcels and elevation are intersected to form parcel elevations. ArcGIS dissolve: to aggregate duplicate Intervals based on the Parcel ID.Select by attribute and calculate field: to select specific Intervals and populate a corresponding field with the calculated acreage. Example with just one record: Intersected Table: Multiple duplicate intervals.PARCEL_IDINTERVALELEV_00to01ELEV_01to02ELEV_02to03ELEV_03to04ELEV_04to05SHAPE_LengthSHAPE_Area1773860530R0-1 571.095248.081773860530R0-1 39.8619.241773860530R1-2 1313.8614638.281773860530R1-2 180.3964.991773860530R2-3 2376.0439618.101773860530R2-3 627.33130.581773860530R2-3 165.69952.031773860530R3-4 1208.5411412.151773860530R3-4 179.2648.361773860530R3-4 168.57554.171773860530R4-5 54.1963.211773860530R4-5 139.79612.06 Dissolved Ta
I've got a workbench setup that uses a preset xml to Post using HTTP Caller and retrieve an ID, see below:This works successfully. What I'd like to do is use an external CSV or XLS to loop back around and format the XML Templater with the new data for the next Post. I can't work out how to do this. I have looked at using XML Updater, but not sure I'm doing it right. Can someone help?See below of how I've attempted this.
I was trying to use FeatureReader to read an online zipped shapefile and it failed with the messageShape Reader: Failed to open dataset 'https://ecos.fws.gov/docs/species/shapefiles/usfws_I02T_I01_Cavaticovelia_aaa_current_range.zip' which is neither an existing file nor directoryHere is one of the link I use. https://ecos.fws.gov/docs/species/shapefiles/usfws_I02T_I01_Cavaticovelia_aaa_current_range.zipBelow are the parameters I set for the FeatureReader.The regular Reader worked just fine for the link Can anyone help me troubleshoot this issue?Thank you.
I have created a workbench to request an ID with a fake XML. This works for one ID. I've now added in an xls and an attribute manager to attempt to edit the XML that requests the IDs to request multiple ID's. This will not work, it keeps rejecting it. My XML is set to:Rejection:Please help me get this working.
Hello,I have a point dataset, and the attributes within can be summarised as per below:Point_IDArea_IDCategory1 AAZ2AAZ3AAX4BBZ5BBX6BBX I want to extract one point per Area_ID (I don't mid which), but it must assigned the the category attribute with the highest count within that Area_ID.Therefore, form the table above for Area_ID 'A' I would want to extract points 1 or 2, and for AREA_ID 'B' points 5 or 6. Any ideas? Thanks,RB
Hi,I'm experiencing an issue with SystemCaller when publishing to FME Server (2019.2 - build 19801 - 64-bit))We're using a SystemCaller to execute a program (with some parameters supplied) which is stored on a shared network, and it works successfully on FME Desktop 2019.2 (same build number as the Server instance). The Server has access (read/write) to the same network location, but when the published workspace runs, it just stops at the SystemCaller Execution. No error, no falling over...it just hangs. We left it overnight, but it was still the same the next morning.Things we've tried, to narrow down the issue:Ran the script in SystemCaller on FME Desktop - it worked in around 30 secondsRan the same script in the cmd prompt on the Server box (as svc_fme user) - it ran successfully in 30 secondsTried hardcoding the network location into Server (rather than using $(FME_SHAREDRESOURCE_DATA)) - this didn't affect the outcome at all - still hungThere are additional '/&
Hi AllThis is not a question, but some feedback/tips on how I solved this issue - hopefully it will assist someone that had issues with a similar project as well. I was trying to create a dynamic html dashboard that reads a bunch of real time values from database records and then display them with labels in an HTML table, the order of the values, layout and structure of which I wanted to format to my liking. The HTMLReportGenerator transformer did not give me enough control as to what I wanted to do, so I ended up using the XMLTemplater.If you want to create an HTML page using the XMLTemplater, you may find that the HTML code does not always parse correctly when running your workspace (the HTML is evaluated to ensure it conforms to XML standards). The reason for this is that some of HTML tags were not properly opened or closed. Since my HTML was still very valid, a workaround for this is to comment out (using "<!--" and "-->") those pieces of HTML code used i
Dear FME'ers, I have a question about the conflict resolution of SQLExecutors and FeatureReaders.I found the issue when I was reading data from a PostgreSQL database. Some of the initiator's attribute names where the same as in the result of my SQL. Therefore I used the option 'conflict resolution'. This because I supposed that the data of the initiator is then overwritten by the data of the SQL script (for the attributes with conflicting names).After that I tried to rename the output attributes with the help of a BulkAttributeRenamer but got an error. This is not the case when I set the conflict resolution to 'Use Initiator'. There is also no problem when I use a regular AttributeRenamer If I'm obliged to remove all conflicting attributes then what is the use of the conflict resolution? Or is this a problem related to the BulkAttributeRenamer? In attachment an example of my question with some extra info. I was able to recreate the issue by reading an Excel
Hello all,I am trying to automate the output of GIS data from PostGIS to Autocad DWG. The base data is in geographic coordinates (lat / long) and I have been able to successfully create the output DWG in GDA2020 UTM Zone 52, 53 or 54.The problem is that the end users need the data in ground coordinates not grid but I am not sure how to define a custom projection to either take it from geographic to ground or from geographic to grid to ground.I have been able to find the formula for the scale factor but this is something that will change for each extract of the data. Does anyone have any advice on the best way to create a new projection on the fly using the newly defined scale factor?
While running a translation on FME 2017, my workspace fails and log file shows this error.I believe feature merger transformer is failing here.But when I copied the same workspace on another system with FME 2018 everything worked out perfectly without any errors. What is the reason behind this and how it can be resolved?
I have a number of FME scripts launched by python scheduled task. Both 2018 and 2019 FME are on the server and the python is launching the 2018 FME which is making some scripts fail. How can I make 2019 the default version launched. Do I need to uninstall 2018? I have a number of 2018 scripts I have not saved as 2019 yet. Will that cause problems? thanks,
After I found out what was causing the crash (2 days and 50+ eliminated transformers later) I wanted to share.I had a couple of workspaces that ran fine in version 2018.0 that stopped working in 2019.2It came down to this - the Sampler transformer - set to "Process When Group Changes" and the sample type of "First N Features" and disabled will crash FME.exe on both Win7 and Win Server 2012 R2.The screen cap below contains a Creator, disabled Attribute Creator for a dummy Attribute, the Sampler and a closing disabled Inspector. Surprisingly, the Sampler never receives any features - yet seems to cause the crash.I hope this saves someone else some hair pulling.ThanksMike B
Hi there, I am trying to filter (using tester) the data on the basis of dates (i.e. month and Year). I have converted the dates into desired format using DateTimeFormat function. When I run the tester, it does not give the right result. In the passed data tab I could see the dates row that should have been in the failed data tab. I have attached the screen shot of my test parameter. Could anyone guide where am I making the mistake?
When I first started working with FME a few years ago, I basically only used the pattern:Reader = > Transformer = > Writer.Most of my work was around geospatial data. As I've dug in and had to decipher piles of legacy FMW's that my predecessors have built, I have learned about the power of SQL Creators and Executors, and non spatial SQL readers. What has been tripping me up with these is that I have a number of workspaces in FME Server that appear to complete successfully but when I review the logs, I realize that a SQL connection or SQL query failed, returning no results, yet the workspace completed. So I get no alert that the process actually bombed.What would be a good practice of wrapping these SQL connectors in a try/except block to catch any instances when the SQL call returns an error or zero feature because of an error or bad connection? Would love to have your 2 cents on this, so I don't have to reinvent the wheel. Thanks!
I have the following SQL being used by a SQL Executor; FME_SQL_DELIMITER ;DROP TABLE dbo.[PREMISE_CONTRACT_ROLLBACK];SELECT * INTO dbo.[PREMISE_CONTRACT_ROLLBACK] FROM dbo.[PREMISE_CONTRACT]; It runs successfully using the "Run" option when I'm accessing the transformer itself. However, if I just add a Creator > SQL Executor > Logger and run the workbench, the following error occurs;Microsoft SQL Server Non-Spatial Reader: Query failed, possibly due to a malformed statement. Query Text `SELECT * INTO #fme_tempAdoDataTypeTable_spatialReader FROM ( SELECT * INTO dbo.[PREMISE_CONTRACT_ROLLBACK] FROM dbo.[PREMISE_CONTRACT] ) AS customQuery WHERE 1=0'. Provider error `(-2147217900) Incorrect syntax near the keyword 'INTO'.'Microsoft SQL Server Non-Spatial Reader: Getting Custom SQL schema failed. Make sure all columns are named (any ambiguous columns, e.g. GEOM.STBuffer(1), must have an AS clause). If there is an ORDER BY clause, either remove it or add a TOP clauseIt looks like FME
Currently i am working for BIM and GIS Integration Project. My question is why we use FME Workbench to insert revit model in ArcGIS PRo? and Why we can not use direct Revit model inserting in ArcGIS Pro?
Dear learned friends, I am attempting to automate the cleansing of a polygon dataset that contains a large number of overlaps. I have managed to identify where instances or overlap occur by using the AreaGapAndOverlapCleaner transformer and then overlaying the output from this against the original data set.I also have a point geometry dataset that contains an attribute linking it to a parent polygon. Many of these points reside within the identified overlapping areas.I now need to 'cleanse' the overlaps within the polygon dataset, but need to apply some intelligence to the process so that the assets within the overlap instance are retained within the correct parent polygon.Hopefully the simplified attached picture will explain this - the red and the blue polygons are overlapping, and the point assets (black dots) within this overlap contain an attribute stating that they relate to the red polygon.Thanks,RB
I have some labels in an ESRI annotation feature class and I am trying to style the last line of the text differently than the rest of the text string, I tried using attributeSplitter, splitting the text at the new line symbol and then using the test filter to find the line of text I want to style differently. After that I am aggregating the text back together that I don't want to style differently. Then I used DWG styler to style the 2 text strings differently. The only problem is that they are not aligned after I split and then aggregate the text.I want to make the label like thisThe text string comes into FME from ESRI file gdb like this Has anyone done something like this before? I have attached example workspace of what I tried to do
Hello, I'm trying to create a few workspaces where I'm converting DWG and DGN to GDB. I've got my workspace up to:Pull blocks with attributes throughArea Builder to convert lines to polygonsJoins metadata from block attributes to featuresGeometry Validator to remove anything not requiredProjection (raw data is in Snakegrid and I convert it to OSGBGet Style Information:Gets line styles using String PadderCreate Fill StyleRemoves CAD Style AttributesThe Theme attrributesString SearcherList IndexerAttribute Creator to get single word level description for themeFinally I have tried these three transformers with no luck to convert the name of the Autocad_layer to Featureclassname using a lookup spreadsheet. This lookup has been simplified even by using just the example DWG as an exact translation, so it should be able to understand the lookup and convert the Autocad Layer name to the feature class name but it will not bring this through no matter what I try. The lookup has even
Source data: Lines and points near to the line I'm trying find the distance of each point to the line. I have tried using Nearest Neighbor but it doesn't work with 3D features.
I tried installing the safe.robj-detect-pkg in to FME desktop 2019.2 build 19801 and I got the following errorRasterObjectDetectionModelTrainer.fmx ignored because it was created with a newer version of FME WorkbenchI downloaded and installed 2019.2.1 build 19813 and the same error occurredTransformer safe.robj-detect-pkg.RasterObjectDetectionModelTrainer version 1 in file C:\\Users\\apadilla\\AppData\\Roaming\\Safe Software\\FME\\Packages\\19813-win64\\transformers\\safe.robj-detect-pkg\\RasterObjectDetectionModelTrainer.fmx ignored because it was created with a newer version of FME WorkbenchTransformer safe.robj-detect-pkg.RasterObjectDetectorSampleGenerator version 1 in file C:\\Users\\apadilla\\AppData\\Roaming\\Safe Software\\FME\\Packages\\19813-win64\\transformers\\safe.robj-detect-pkg\\RasterObjectDetectorSampleGenerator.fmx ignored because it was created with a newer version of FME WorkbenchTransformer safe.robj-detect-pkg.RasterObjectDetectorSamplePreparer version 1 in file C