Using transformers to modify data.
Recently active
I have a simple FME Workspace which runs perfectly. However, creating then running the associated TCL file (via .BAT file) is for some reason adding the source-directory parent-folder to the destination directory. This does not happen when running the .fmw alone. FMW Example: Reader Source - "C:/Temp/SourceData/" ; Writer Destination - "C:/Temp/OutputData/" ; Run TCL - adds "SourceData/", thus saving writer results to "C:/Temp/OutputData/SourceData/". Note: the TCL runs successfully, however the results are being written into this subfolder. I can only guess that the TCL file is including code which adds the parent folder...? (The workspace is not doing this.) Any ideas? Thank you!
I am using Kafka connector in my FME job to consume data from Kafka topic. On this job uses this particular consumer group. In case of restart scenario, I want to run the job configuring kafka connector to read from a specific topic. While I do that I need to mention partition number in Kafka connector. My topic has multiple partitions. So how would I tell Kafka connector that it should consider all partitions for restart.
Hi, I am trying to run an SQLExecutor transformer with the following SQL:FME_SQL_DELIMITER ;UPDATE "PROJECTS"SET "TBL_REFRESHDATE" = '16-JAN-2020', "TBL_REFRESHUSER" = @Value(REFRESHUSER);COMMIT;When I run this I get the following error message|ERROR |An error occurred while accessing a table result for feature type `'; message was `Execution of statement `UPDATE "PROJECTS" SET "TBL_REFRESHDATE" = '16-JAN-2020', "TBL_REFRESHUSER" = TEST' did not succeed; error was `ORA-00904: "TEST": invalid identifier'. Where TEST is the value which is currently in the TBL_REFRESHUSER column in the table, not the value which I am trying to populate the column with (ie: 'test_user').However, when I run the following SQL, replacing @Value(REFRESHUSER) with a hard coded string of 'test_user', the script works:FME_SQL_DELIMITER ;UPDATE "PROJECTS"SET "TBL_REFRESHDATE" = '16-JAN-2020', "TBL_REFRESHUSER" = 'test_user';COMMIT;What do I need to do to get the attribute values to be read properly i
I have a workbench that creates an ECW wind heat map from a TIFF file. I have now created another image (png, JPEG or BMP) as a legend that I want to place on top of the ECW heat map, at a specific location. I was unable to find a way to do this, but may be missing an easy way to do this? Two steps are required.1. Place the legend image on top of the ECW heat map.2. Place it at a specific position and at a specific size before finalising the ECW image. Any help on how to do this would be much appreciated.
I have a FME-script with several Python callers. To avoid duplicate code in the callers I want to write a general python class that I can instantiate in the callers. In short I want to be able to access object methods to set specific object variables. Finally I want to call a main-method on the class to do the real work. Where should the Class be placed? In the startup script? In another caller or elsewhere?
Is it possible to get label without point? My final format is .kml Thanks
polygon overlaping
Hi, how do I keep adding records (In red) until I hit 2025 - 12 - 12?Thanks in advance!
I am trying to extract text from a table in a PDF image using the TesseractCaller. But only part of the table values are being returned. The text for the document is the same font and size and the contrast is the same for the entire document. Does anyone have any hints or tricks to get tesseract to return the complete table?
Hi All, We are trying to transpose some data and have run into a little issueWhen we go to aggregate the data back, we get almost the correct data but we are aggregating by time so we get hourly data in columns broken down by hour in the following require format: Times Mon 01/01Tue 02/01Mon 08/0101:00-02:0043302:00-03:00333 The data is coming out exactly how we want however if we have duplicate days and we are using a group by on aggregation by time, it is missing where we have duplicate days like the above two Mondays in the concatenation on _attr_value as we cannot separate the times on the two Mondays.We just end up with 5 comma separated values instead of 6 in the concatenation.We followed this guide to transpose our row data to column data - https://knowledge.safe.com/articles/31701/transpose-a-table-using-fme.htmlAny ideas would be appreciatedCurrent example input_attr_value time uid98 22:00-23:00 17A95 23:00-24:00 17A94 05:00-06:00 17A92 23:00-24:00
HelloI have point layer and related table in ESRI SQL data base. I need to bring it into FME to do some calculations and reporting.But once i bring both of them in FME feature Merger is not working for me. I am using ESRI GlobalID field. I am not sure if that is causing any issues? I don't have any other unique id in both tables. Please let me know if anybody used global id for feature merger or feature joiner? Or any other ideas?any help is welcome!ThanksNikki
Hi FMEers~ Curious around FME's capability of enabling image classification with trained samples, just like the way that ArcGIS/Erdas Imagine do. Having discussed with the Safe technical professional, there is no such transformer developed (yet).Just wondering if any professional has come across a great workaround of doing it in FME. CheersDavid
HiI am a GIS Manager working in a police force in the UK. Our crime analysts use ArcMap and use the "directional distribution" spatial statistics tool (toolbox) to look at directional distribution of crime.see link: http://desktop.arcgis.com/en/arcmap/10.3/tools/spatial-statistics-toolbox/directional-distribution.htm We would like to create those as an output of a workflow which would be automated on a large scale and on a regular basis - however i can't find anything about that kind of spatial statistics tool in FME on the web.At the moment we have an alternative using HullAccumulator to create a area shape from key locations eliminating outliers... but we would like something a little bit more ellispoidal.Apologies but i can not send sample data etc. as senstitive information. Just wanted to know if any of you had some ideas on what is the equivalent FME transformer.THANK YOU ALL.
Hi everyone, the following screenshot is my custom Python Interpreter:This command is what I used to use to install external packages for Python 2.7: python -m pip install <package_name> --target C:\\Users\\tngo\\Documents\\FME\\Plugins\\Python But it doesn't seem to work anymore. I also get this error when running PythonCaller: The User-specified library C:\\Users\\tngo\\AppData\\Local\\Programs\\Python\\Python37-32\\python37.dll could not be loaded Thanks for helping in advance.
I have a dataset where features contain two attributes - Month and Provider. What I want to do is create a table wherein the Months of Feb to Aug inclusive run along one axis, Provider along the other and the cell contents are a count of occurrences of features per Provider in each month. I've achieved this using a fairly roundabout method - which was ok given that the range of variables was fairly small; however, I can't help but feel that there is a simpler way, presumably using StatisticsCalculator or AttributePivoter...?
I read this https://knowledge.safe.com/articles/45314/working-with-soap-services.html to try to wrap my head around SOAP (yes, its a horrible technology!)I`m testing against: https://www.atb.no/sanntid/#collapse-article_2 And the stopmonitoring: http://st.atb.no:90/SMWS/SMService.svc?wsdl I use the SoapUI to generate the request: <soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/" xmlns:siri="http://www.siri.org.uk/siri"> <soapenv:Header/> <soapenv:Body> <siri:GetStopMonitoring> <ServiceRequestInfo> <!--Optional:--> <siri:ServiceRequestContext> <!--Optional:--> <siri:CheckStatusAddress>?</siri:CheckStatusAddress> <!--Optional:--> <siri:SubscribeAddress>?</siri:SubscribeAddress> <!--Optional:--> <siri:ManageSubscriptionAddress>?</siri:ManageSubscript
I am trying to find the elevation of the most prominent "peaks" in an area, but am stuck. I have used a number of polygons to Clip a selection of mountains. These are in a raster DEM format. Now I want to find the highest point on each mountain, along with it's position. This will later be saved as a point feature. Using the RasterCellCoercer results in an insane amount of data. I have tried to filter out the highest values before I proceed, but have not yet figured out how to do so. The RasterBandMinMaxExtractor with a ListExploder gives me the highest value for each raster area, but I also need the position of this pixel. Any suggestions on how to proceed? How can I get both the highest value, and it's location , without turning my computer into a toaster?
I have prepared a mosaic data-set that was created from a previously downloaded set of images. I would like to clip this mosaic data-set with a CAD file polygon to select a small section.I've tried using Clipped but it seems like the mosaic data-set has NULL geometries, so it fails.Is there a way to clip the data so I end up with only a small section? I've attached the mosaic data-set, the CAD boundary and the Workbench for your consideration.
When reading data from an Oracle database where the table holds timestamp information then I am getting the errorError converting from OCI datetime to C character string : `ORA-01805: possible error in date/time operation' (serverType=`ORACLE8i', serverName=`***', userName=`***', password=`***', dbname=`')In FME Desktop 2018.1.0.2 can I reproduce the error in OracleSpatialObject reader and in SQLExecutor. The error does not occur in FME Desktop 2017.1.2.1, neither does e.g. DBeaver has a problem to read and show the timestamps.I checked in FME Desktop and in DBeaver with select * from v$timezone_file what timezone_file is used, and in both cases it is timezlrg_18.dat
Hello all,I am trying to create an XML file that has a structure where there is a single plan, non-spatial, that has one or more polygon features(parcels). Each polygon feature is made up of multiple line which in turn is made up of multiple points. The plan is a database table without any geometry so I have done a feature merge using the bounding box of the parcels. I then chop the parcels into points and lines and feed the three outputs into the XML templater, using the plan as the root feature.What I am trying to acheive is the following PlanParcel 1Line 1Line 2Line 3Line 4Parcel 2Line 5Line 6Line 7Line 8 Point 1Point 2...Point n but what is coming out is a list of all lines rather than just the lines for the individual parcel. PlanParcel 1Line 1Line 2Line 3Line 4Line 5Line 6Line 7Line 8Parcel 2Line 1Line 2Line 3Line 4Line 5Line 6Line 7Line 8Line 5Line 6Line 7Line 8 Point 1Point 2...Point n I have tried grouping but that then seems to have affects on other features.Attached is my X
On FME server i have a job that has a User parameter. Is it possible for someone else in our organisation, whithout any rights, to run this job and browse to his data (user parameter) and the job continues . In FME server there are url`s to share the job, but the user must have rights to use/access FME server.
Hi guys,I have 02 shapefiles (point and line), I want to find the nearest line for each point [relation 1 (line) to many (point)] inside a diameter of 15m and to find the relative position of those points. Thanks for help
Hi,I have a series of regular expression and new string pairs.If the regular expression gets a match I don't just want to replace the characters that match I want to replace the whole matched string with the new string.As an example;If the old string is - CAROLA 1.6ABCThe regex is - C[AO]?[CR]R?O?O?L?L?L?LI?A?The new string needs to be - COROLLATo make matters more difficult, there are about 400+ unique pairings. Thanks in advance
Hello, I am reading in 2 feature classes into a Spatial Realtor transformer. I need to be able to automatically determine which feature class has the higher number of records/features and which has the lower. This will then determine the Requestor (feature class with higher number), and Supplier (feature class with lower number of records) for the Spatial Relator. More like an if statement, if feature class A is 10 and feature class B is 5, then connect A to the Spatial Relator requestor, and B to Spatial Relator supplier. I don't want a new attribute to be created within feature class A or B. How can I do this?
I have a geometric network of connected wells, pipelines and facilities. The wells act as the source nodes, the pipelines act as the links and the facilities act as the sink nodes. I also have a point feature class at every pipeline junction section already created from a different script. What I'm trying to do is use FME to create a new point feature class (call it Attribute_Flagger) at any pipeline junction for the pipelines that connect at a junction but have a mismatch in the MOP (Max Operating Pressure) or H2S fields. Below is a diagram I created to understand this relationship better. Does anyone have an FME solution to this problem?