Using transformers to modify data.
Recently active
Hi, I have created a view in SQL and brought that on as a reader to FME. The SQL view has done all the filtering and grouping that I need and usually provide more than one row of results.When I attach this reader to an Emailer directly, as you know it will send an individual email per row of data. I tried to add an aggregator, but it needs grouping which has been done on the SQL side already. Is there anyway that I can email out the result of this SQL view, in a table format with all the rows included?
Hello all, I'm trying to get a json templater setup so that I can use an API to ingest some data. The challenge is syntax related, but perhaps I'm not organizing things quite correctly. I have some nested structure, and I've attempted to use sub templates for those parts. I've got body of those three expressions in the three attached text files matching the sections. error message is: 2023-02-22 13:28:33| 0.1| 0.0|WARN |JSONTemplater (XMLTemplaterFactory): The following error occurred near line 29, column 17 of the query:2023-02-22 13:28:33| 0.1| 0.0|WARN |JSONTemplater (XMLTemplaterFactory): invalid expression: syntax error, unexpected ExprSingle (missing comma "," between expressions?)2023-02-22 13:28:33| 0.1| 0.0|ERROR |JSONTemplater (XMLTemplaterFactory): An error occurred while parsing the ROOT template2023-02-22 13:28:33| 0.1| 0.0|ERROR |JSONTemplater (XMLTemplaterFactory): An error has occurred. Check the logfile above for details
Hello,I want to know what features from the little red diamonds feature class don't match the big red triangle's number (seen in FME1 screenshot). FME2 screenshot shows the null attribute values for the little red diamonds that should read T-9623 from the big red triangle. These features participate in a geometric network connected by line segments. I'm trying to do QA/QC to clean up the data but first need to filter out the incorrect values.
If I am not mistaken there is no direct FME reader for XYZ tiles in FME Desktop. Do you see a convenient method for reading raster data being served via an api looking like http://<url>/{z}/{x}/{y}.png ?I need to read such data on the fly. These are Terrain RGB files which I need to convert into some GeoTIFF DEM format for different resolutions.What are possible workarounds or solutions? Could a HTTPCaller help in this case?Thanks!
I'm trying to convert a CSV file of MULTILINE STRINGS for 'road centerlines' to Geometry. I've been able to do so for the 'address points' using "stringsearcher + vertex creator" but am struggling with the 'roads' as there are multiple pairings of coordinates; MULTILINESTRING ((-41.2762718167 173.2862863, -41.2762702333 173.2867388167, -41.2762720167 173.28681425))
Hi, trying to manipulate points components in a points Cloud with PythonCaller to make some calculation but can't find any method to reach components like classification or user_components. Is there any way to make it? Thx Nicolas
Some features got invalid when using FME File Geodb Opeam API to import to PostGIS, while they are valid using the GDAL OpenFileGDB. These features are arc circles. When using FME File Geodb Opeam API, these features become NAN, eg with some coordinates being null. Is there any way to fix this issue when using the ME File Geodb Opeam API to import to PostGIS?
Hi,I´ve created a point-based dataset which includes an attribut (value, distance in meter from the point to a school using OSM routecalculation). I now want to create lines between the points with the highest value (if that makes any sense) adding up to some kind of "service area" to the school (how much area does the school cover if the distance is max 2500 meter). Is that possible and if so, how can it be done? Regards Christian
In SQL, it's possible to select all your data starting with "2023" like this : -------------------------------------SELECT *FROM mydataWHERE date LIKE "2023%"--------------------------------------Is there a way to do it with FME? I have already apply a "DateTimeConverter" to convert my data in FME format (20230223). I see on FME Workbanch that there is a "SQLCreator", but I need to import my data from a url and not from an DataBase like PostGIS
I had a solution to this problem using a FeatureJoiner and a Test Filter that worked for smaller data sets (previous solution below). But my datasets have grown and this process is too slow now. I tried InlineQuerier but couldn't achieve success. I suggestion was to write a python program to do this but I am not experienced enough with python. Is the a way to join to tables as described in the title of the message? https://community.safe.com/s/question/0D5Dm000006cuXDKAY/categorizing-data-based-on-external-table-with-unique-lookup-minmax-values
Please can someone help me to group points and assign a unique ID to each cluster? I have a large feature containing several groups of points taken from a line (see attachment) but I would like to rebuild the line and make sure they don't all join up together.So far, I am using a vertex extractor to break the line into points. I have played around with neighbourhood finder and it's telling me the distances between points in proximity, but I need to group them to result in something like the attached image.Thanks in advance
I'm working with American Community Survey (ACS) data and would like to rename the attributes in a demographic table with the corresponding values in the metadata table but I'm at a loss. This seems like something that should be less complicated than I'm making it so I'm looking for any thoughts or guidance.
When I add a shapefile reader or DWG reader in the same manner, it takes very little time to navigate my way to the shapefile location. I do not understand the difference. If they all took the same amount of time I might conclude it had something to do with my directory structure.
Hi,We have noticed a difference of behaviour in the GeometryValidator transformer in FME 2020.1 and 2021.2 without upgrading the transformer. A sample geometry in WKT : LINESTRING (45.02687462450092 0.06721615791320801,45.025979838437365 0.06841778755187988,45.02593434046724 0.06878256797790527,45.02601017039738 0.06899714469909668,45.02638931854123 0.06853580474853515,45.02621491070693 0.06806373596191406,45.02639690147848 0.0685572624206543,45.02660922331399 0.0685572624206543,45.02700353320486 0.06818175315856933) The transformer is configured as such :And we have the following results in FME 2020.1/2021.2 :In FME 2021.2, the geometry fails OGC Simple while it doesn't in FME 2020.1. One of the issue with that, is that the geometry is being repaired in FME 2020.1 but not in FME 2021.2. I have noticed that version 8 of the transformer made the OGC checks stricter, but the transformer was not upgraded and is still at version 4. Is there any way to restore the old behaviour?
I have two shapefile data, and one label which I created through MapTextLabeller. I have then in DataInspector the view with these 2 shapefiles and text above them. The question is can i generate raster tiles from it, and store it as GeoTIFF?
Hello, couldn't really describe the problem in the Question field but to sum it up, I have a table of X/Y/Z that represent contours (see on photo)Meaning that between the "*" there is an independent contour, first one having 5 vertices, next one having 7 and so forth. Now I want to enter these vertices into a contour generator, but in the way that that Transformer creates separate contours from the "*" grouping, instead of a whole binge of criss-cross connected lines. Probably best way to do this would to give each vertex group a common ID and then run contour generator with Group by "ID". But how on earth do I group based on the logic:if X is within two * then it belong to the same group, then after the latter * there is a new group with a seperate ID and so forth? -Please send help :D
I have been asked to convert network vector data to raster tiles using the MBTiles writer. For my specified dataset zoom levels 5 - 10 have been requestedProducing this hasn't been an issue but the problem is that the requestor wants a single MBTiles file and my workspace outputs 313, the number of rasters generated.How can output a single MBTiles file that still contains all the zoom_level, tile_column and tile_row attribution required to use the raster files in a leaflet map?
We are currently using FME to run the process to convert GDA94 Zone 55 ( EPSG : 28355) ECW file into GDA2020 Zone 55 ( EPSG : 7855) , the output ECW was projected to the right location, but the CRS was not recognized by QGIS or other GIS platform. I have the FME bench as attached for your reference, could you please let me know if I missed any configuration settings or should use different transformer?
I am trying to project a .ecw file from LL WGS84 to a custom local coordinate system. Using the ESRI reprojector I am able to select the custom output coordinate system (it is Nad27 UTM feet) and the proper geographic transformation. The log file of the result seems to indicate that the process is using the correct parameters, however the resulting dataset is UTM meters and has an EPSG 26717 code (even though I explicitly set the parameter to 'Never use EPSG code' for the projection). It seems to always revert to ecw format of 2 so I'm not sure if this has anything to do with it. Many thanks for any assistance.
I'm looking for some help to use SQL in 'where clauses' for FME Readers.I'm trying to read from an ArcSDE database, using SQL operations like GROUP BY or DISTINCT. But I am under the impression that ArcSDE is not compatible with more complex statements than the simple terms like: equals/is null/not null/ in range / and so on. On the documentation page I read however: "Enter any SQL where clause that constrains the attributes of the layers selected in the layer list." I have found the SQLCreator and SQLExecutor transformers, however these do not support ArcSDE format. I'm starting to think that the ArcSDE format simply does not suppport 'advanced' SQL querying in FME. Is this correct? So far I have found 1 alternative: a PythonCaller using these ArcSDESQLExecute functions from ArcPy. Could someone tell me if this is indeed the only workaround? Are there other workarounds? I've not found any further documentation on this topic, perhaps someone e
We have two FME server with same version.The .fmw are the same. We translate file from gml.zip to fgdb.zip.But the output of 2 zip files are difference in sizeThe files size in fgdb folder are the same.How can we set the FME server in order to get the zip file with same size
Although the IMDF writer has a fixed schema, the option to copy attributes from another feature class is still available and will preform the action. However, when I try to copy attributes from any other dataset or feature type in the reader, they will appear as being added, but when running, they do not appear in the GeoJSON. Does there need to be some other process that will tell the IMDF writer to accept these attributes?
Another post: https://community.safe.com/s/question/0D54Q00008is1jiSAA/why-is-the-download-url-not-being-returned-in-an-fme-server-app has already asked this question, but to date there was no definitive answer yet on that forum. I included the "data download" during publish, so that is not the issue. It's just weird that the download link is not available in the workspace app, but is available when running the workspace from the workspace repository. Does anyone might know what the cause of it is?
I am building a simple regex expression which extracts the letters of the alphabet including the letters with accents. What I am having trouble with is using FME's regex editor vs the online one and the conflicts. The example below I have screenshots of regex101 online and FME regex editor and they both show different results for the expression:[a-zA-Z\\sčćđšž]+ I need help understanding why is this and what to do to get around this issue?Also, how do you apply regex flags?
Hello. I'm thinking about how to solve a filter that is defined on this data:- KASON DJL ?IBABA ?LUKID ?DIPIR ?KELUK ?KOVAR ?PAS PADCA NIFKU BANKO - applies here if the name starts without "?" (KASON) and somewhere in the string a name appears with a "?" (e.g. ?IBABA, ?LUKID.. ) and at the same time the end of the string is a name without "?", so remove "?" throughout the chain. The result is this KASON DJL IBABA LUKID DIPIR KELUK KOVAR PAS PADCA NIFKU BANKOThere will be more such definitions and combinations, does anyone have an idea how to solve it? A regular expression? Or a combination of some transformers?Thank you