Using transformers to modify data.
Recently active
We are trying to set up an AWS SQS and are hitting an issue when trying to send a message to the queue. The following warning is being displayed "The request must contain the parameter MessageGroupId". We have tried adding this in to the message attributes along with the value we have but still no luck. We can manually create a message using the AWS console and can also get a response in FME using the SQS Message Counter so credentials etc. are correct. Has anyone hit this issue before? Any help would be appreciated.@olivermorris
I've never used the ListBasedFeatureMerger before, the documentation suggests it might be what I want but it isn't working as I thoughtI'd assumed that if the Requestor had a list that looked likelist{0} = applelist{1} = bananalist{2} = cherryand the supplier had an attribute with value banana there would be an output via the merged port. Is this not correct?
What am I missing here?I'm using FME 20180926 - build 18552 if that matters.I want to merge two data streams in the Feature Merger and I know that there are duplicate suppliers so I've marked the "Process duplicate suppliers" option. Still the complete merged data isn't output on the "Merged" port as it should be. Here's an example script.Here's my example data:Here's a screenshot of the script after I've run it once:Here's a screenshot of the transformer settings:What exactly am I missing here? I've tried both with my regular data that I want to handle and this example data and I just can't get it to work as I expect. As far as I can tell none of the settings under "Process duplicate suppliers" matter when you're only using data and no geometry.
I have been using the pointonlineoverlayer to split lines when they are at the endpoint of another line. I use the coordinateextractor and vertexcreator transformers to create the points. While this works in general, I’ve noticed that in some cases the break in the split line is not at the same location as the enpoint of the other line. I am using snapper before this process, and plan on using snapper after it hoping it will put the points together. I am wondering if my pointonlineoverlayer settings are the cause. The settings are:
I'm building a flow that needs the total amount of (external) parts in a geometry feature. I need the total amount of parts from a single (thus 1) or multi-part (2+) feature for further statistical analysis. To get this i used the PartCounter that would give me the _part_count which returns the number of parts in the geometry. For multis and aggregates, this is the number of parts, and for paths, this is the number of segments. Otherwise, it is one.I would expect that, when using this on a single feature (donut). It would return the value 1 but in the attached example, and all other donuts that i tried, it returns the total amount of donuts + total amount of external parts. Would it be possible to get the partcount without the inner boundaries with another transformer without needing to fill the donutsholes with a DonuHoleFilter? or just get the outer boundary part count?Filling the donuts is quite time and CPU consuming (example for 10k objects but sets with x million could also b
Hi,Is it possible to set RasterReplacer raster format from attribute value ?Raster format has already been detected and saved in an csv file with raster filename.i want to read this csv file resample raster and save it.thanks in advance
Has anyone done any scheduled routing using GTFS data? I've been tasked with determining the length of time it takes to get to a specific location using public transport, from about 5 thousand starting points.
Hi, I am trying to apply texture for the building , it looks fine in FME inspector . If I try to open in FZK Viewer texture is not applied to the building. I also set the texture property in FZK viewer to "Entity".Please find the relative snapshots.
Hello there II have an attribute with the values like this (24 16 17.2) or this ( 25 7 17.2) we need to replace the first space with a letter A and second space with letter B and add letter W at the end we should get a result like this (24A16B17.2W) and this ( 25A7B17.2W) for the second caseAny idea, please Thanks
Hello, I have an entrance like this. I would like an exit like this. How to do it ? with the transform AttributeSplitter ? Thank you
I am reading a CSV file and need to change the values of one of the attributes according to the count of these values. The values are typically in the range of whole numbers 1 - 6 (might be more) with various total counts. I need to change these values so the most frequent gets a value of 1, the second gets 2, third gets 3 and the rest is deleted. In the example below: 6 is changed to 1, 4 is changed to 2, 1 to 3 and 2 is deleted. If the counts of any values are equal I should get an error. Attribute name6666444112 Thank you for your help.
Hi, I try to repeat this sample of LRS-Tasks on my data:Probably a beginner-question: How can I set/transfer the attribute 'von_km_l' as startvalue in my MeasureGenerator? After the five line segments are joined in one NLE(network linear element), I got the attribute on the treats: As you see, the needed value is avaliable within the trait-attribute. But how to set it as startvalue in the MeasureGenerator?Thanks and best regards from Berlin,Christoph
Hi,Is it possible to use FME functions like @DateTimeFormat in SQL Editors ?I would like to use the "SQL to run before write" field in my writer to create a backup of the destination table whose name contains the current date as suffix.Example:create table myschema.mytable_@DateTimeFormat(@DateTimeNow(), %Y%m%d)) as select * from myschema.mytable; But this doesn't work, even with single or double quotes around the FME functions... Thanks for any help,Christian
Hello.I have two entries : a rectangle and a numeric raster. The bounding box of the raster is included in the rectangle.I wouldlike to create a new raster with a bounding box corresponding to the rectangle (area outside the initial raster filled with nodata).The clipper can be used for such operations when the raster is wider than the rectangle but in my case, the clipper result bounding box is an intersection of the inputs.Do you know another way to proceed ?Thank you in advance.Paul
I have a problem with geting the backupConfiguration.fmw to work and have now looked into this problem alot. The error message I get is: HTTPCaller(HTTPFactory): HTTP/FTP Transfer: Failed to create file 'C:\\ProgramData\\Safe Software\\FME Server\\resources\\backups\\' for resource download ''url'' The below feature caused the translation to be terminated Storing feature(s) to FME feature store file `C:\\ProgramData\\Safe Software\\FME Server\\resources\\logs\\engine\\current\\jobs\\229000\\job_229856_log.ffs' (This logfile does not say anything more than the info above) There seams to be a problem accessing resources\\backups, but the user have this access and fmesuperuser role .If I use the url and token in a browser I get the backupfile. Anyone knows about this? Best/Johan
FME(R) 2017.1.2.1 (20180117 - Build 17725 - WIN32)I have a data set in SDE that contains multiple records for a single pipe segment. Pipe size (CONDUIT_WI) is an attribute that can change in these records. Below is the transformer configuration that I have attempted to get the max value of the count attribute. But I keep getting empty results. I have tried different configurations with no success. Any Help is much appreciated.
I want to launch Command Prompt from within FME Specifically, I want to actually launch the command prompt screen. If I put "cmd.exe" (or a variation) into the SystemCaller, it just runs and logs the text you would see in Command Prompt I actually want to launch command prompt. It needs to be launched as it requires user interaction that is not present in the workspace and cannot be fed by a parameter
I have a dataset with various depth zones that I am trying to process by running a DonutHoleExtractor, then removing some of the polygons that I don’t want based on certain rules and lastly rebuilding it all with a DonutBuilder. This works fine for the depth zones but some of the areas that are land, white in the maps below, get turned into depth zones. This is not surprising, but I would like to find a workaround. I looked at using the holes from the DHExtractor to punch holes in the last step, but the ”land holes” get the attribute data from their surrounding depth zone, so I have not found a way to single them out. Any ideas to how exlude certain areas when extracting donuts? Or maybe you have a better idea for a workaround? Please note that this is a follow up question to, https://knowledge.safe.com/questions/81896/selecting-square-ish-donuts.html The brown map is the original data and the green one is after DonutHoleExtractor
I have a very simple workspace. A DTED reader which is set to read a few thousand .dt0 files. This feeds into a Sorter transformer, which sorts alphabetically on fme_dataset, and finally outputs to an Inspector When exactly 506 features have entered the Sorter, all subseqent features gives the errorERROR |DTED Plugin: Failed to open file Z:\raw\Elevation\Global\DTED0\dted\e016\s05.dt0.WARN |MULTI_READER(DTED_1): Skipping to next Readerand only the first 506 features are output from the Sorter. This happens regardless of which .dt0 files are read, the limit is always 506 features.This seems like a bug in the DTED reader to me, because a DEM reader does not give the same error.I'm using FME 2018.1.0.0
Hi,When trying to write I am receiving"The error message from ArcObjects is: {Number of parts in shape is incorrect for its geometry type}"FME 2018.1, Postgres 9.5.9, config keyword: PG_GEOMETRYIsn't multipart writeable?Same input data written to file geodatabase and copy/pasted to sde with arccatalog works.Regards,Richard
I am reading a large ECW file and clipping out a section then writing it to ECW again. Does anyone know how FME manages ECW compression. The writer by default is set to 75% compression but the ECW file is already compressed. Does the writer honour the original compression settings or is it further compressing a compressed file? Should I set compression to 0%? Also I can't seem to find a concise answer on whether FME now handles ECW v3 images?
I have a google sheet I am trying to read in that has Timestamp as an attribute, mm/dd/yyyy hh:mm:ss. I want to only read in those features that fall between provided dates and time - say the records between 09/22/2018 12:00:00 to 10/22/2018 12:00:00. This time range will change each month. This all feeds to a monthly report but the google sheet is cumulative.Is there a way to create a user parameter to read in only the dates wanted?The other problem I have is that the reader does not appear to be reading the Timestamp as a date-time format although it is formatted that way in the sheet. Right now I am using a Tester after the reader and set the mode to date/time. When reading the data, the Tester shows "Unable to do a date/time comparison... Comparing as strings instead". None of the records pass the Tester, 74 of them should have passed. How can I set the Timestamp attribute to be read and processed as date-time?
We are syncing data of Smallworld with GSDS (Geo Spatial data Store) which is an oracle database, reprojection is taking very long time to process. It takes more than 2-3 hours to process the same number of records which used to get processed in half an hour before August 2018. We have custom coordinate system defined for reprojection. What could be wrong here? how can this issue be fixed. Please help
I would like to filter a view based on the current time -1 day. I have the correct date format working in FME, an attribute creator returns the right value - in the format SQL Server requires.Unfortunately it appears that the string is being parsed. MS SQL Server Spatial (JDBC) Reader: Executing SQL: SELECT [title], [user_email], [LOGIN], [COMPANY], [request_date], [theme_id_list], [age_min], [age_max], [request_area], [download_status], [ROW_CREATED_DATE] FROM [dbo].[V_SELF_SERVICE_ACTIVITY_REPORT] WHERE [request_date] > CONVERT(DATETIME, '@DateTimeFormat(@DateTimeAdd(@round(@DateTimeNow(),2), -P1D), %Y-%m-%d %H:%M:%S)', 102)com.microsoft.sqlserver.jdbc.SQLServerException: Conversion failed when converting date and/or time from character string. The where condition:[request_date] > CONVERT(DATETIME, '@DateTimeFormat(@DateTimeAdd(@round(@DateTimeNow(),2), -P1D), %Y-%m-%d %H:%M:%S)', 102) In the attribute creator which returns correctly it is:@DateTimeFormat(@DateT
I've got a table with POSTCODE_FROM and a POSTCODE_TO attributes, constituting several alphanumeric ranges, for example:(from) 7887AA (to) 7887AA(from) 7887AB (to) 7887AC(from) 7887AD (to) 7887AJ(from) 7887AK (to) 7887BBEach feature has a FROM and a TO value and I would like to determine all in-between values, e.g. 7887AE, 7887AF, 7887AG, 7887AH, 7887AI. Does anyone know what (sequences of) transformers are capable of doing this?