Using transformers to modify data.
Recently active
Please can someone help me to group points and assign a unique ID to each cluster? I have a large feature containing several groups of points taken from a line (see attachment) but I would like to rebuild the line and make sure they don't all join up together.So far, I am using a vertex extractor to break the line into points. I have played around with neighbourhood finder and it's telling me the distances between points in proximity, but I need to group them to result in something like the attached image.Thanks in advance
I'm working with American Community Survey (ACS) data and would like to rename the attributes in a demographic table with the corresponding values in the metadata table but I'm at a loss. This seems like something that should be less complicated than I'm making it so I'm looking for any thoughts or guidance.
When I add a shapefile reader or DWG reader in the same manner, it takes very little time to navigate my way to the shapefile location. I do not understand the difference. If they all took the same amount of time I might conclude it had something to do with my directory structure.
Hi,We have noticed a difference of behaviour in the GeometryValidator transformer in FME 2020.1 and 2021.2 without upgrading the transformer. A sample geometry in WKT : LINESTRING (45.02687462450092 0.06721615791320801,45.025979838437365 0.06841778755187988,45.02593434046724 0.06878256797790527,45.02601017039738 0.06899714469909668,45.02638931854123 0.06853580474853515,45.02621491070693 0.06806373596191406,45.02639690147848 0.0685572624206543,45.02660922331399 0.0685572624206543,45.02700353320486 0.06818175315856933) The transformer is configured as such :And we have the following results in FME 2020.1/2021.2 :In FME 2021.2, the geometry fails OGC Simple while it doesn't in FME 2020.1. One of the issue with that, is that the geometry is being repaired in FME 2020.1 but not in FME 2021.2. I have noticed that version 8 of the transformer made the OGC checks stricter, but the transformer was not upgraded and is still at version 4. Is there any way to restore the old behaviour?
I have two shapefile data, and one label which I created through MapTextLabeller. I have then in DataInspector the view with these 2 shapefiles and text above them. The question is can i generate raster tiles from it, and store it as GeoTIFF?
Hello, couldn't really describe the problem in the Question field but to sum it up, I have a table of X/Y/Z that represent contours (see on photo)Meaning that between the "*" there is an independent contour, first one having 5 vertices, next one having 7 and so forth. Now I want to enter these vertices into a contour generator, but in the way that that Transformer creates separate contours from the "*" grouping, instead of a whole binge of criss-cross connected lines. Probably best way to do this would to give each vertex group a common ID and then run contour generator with Group by "ID". But how on earth do I group based on the logic:if X is within two * then it belong to the same group, then after the latter * there is a new group with a seperate ID and so forth? -Please send help :D
I have been asked to convert network vector data to raster tiles using the MBTiles writer. For my specified dataset zoom levels 5 - 10 have been requestedProducing this hasn't been an issue but the problem is that the requestor wants a single MBTiles file and my workspace outputs 313, the number of rasters generated.How can output a single MBTiles file that still contains all the zoom_level, tile_column and tile_row attribution required to use the raster files in a leaflet map?
We are currently using FME to run the process to convert GDA94 Zone 55 ( EPSG : 28355) ECW file into GDA2020 Zone 55 ( EPSG : 7855) , the output ECW was projected to the right location, but the CRS was not recognized by QGIS or other GIS platform. I have the FME bench as attached for your reference, could you please let me know if I missed any configuration settings or should use different transformer?
I am trying to project a .ecw file from LL WGS84 to a custom local coordinate system. Using the ESRI reprojector I am able to select the custom output coordinate system (it is Nad27 UTM feet) and the proper geographic transformation. The log file of the result seems to indicate that the process is using the correct parameters, however the resulting dataset is UTM meters and has an EPSG 26717 code (even though I explicitly set the parameter to 'Never use EPSG code' for the projection). It seems to always revert to ecw format of 2 so I'm not sure if this has anything to do with it. Many thanks for any assistance.
I'm looking for some help to use SQL in 'where clauses' for FME Readers.I'm trying to read from an ArcSDE database, using SQL operations like GROUP BY or DISTINCT. But I am under the impression that ArcSDE is not compatible with more complex statements than the simple terms like: equals/is null/not null/ in range / and so on. On the documentation page I read however: "Enter any SQL where clause that constrains the attributes of the layers selected in the layer list." I have found the SQLCreator and SQLExecutor transformers, however these do not support ArcSDE format. I'm starting to think that the ArcSDE format simply does not suppport 'advanced' SQL querying in FME. Is this correct? So far I have found 1 alternative: a PythonCaller using these ArcSDESQLExecute functions from ArcPy. Could someone tell me if this is indeed the only workaround? Are there other workarounds? I've not found any further documentation on this topic, perhaps someone e
We have two FME server with same version.The .fmw are the same. We translate file from gml.zip to fgdb.zip.But the output of 2 zip files are difference in sizeThe files size in fgdb folder are the same.How can we set the FME server in order to get the zip file with same size
Although the IMDF writer has a fixed schema, the option to copy attributes from another feature class is still available and will preform the action. However, when I try to copy attributes from any other dataset or feature type in the reader, they will appear as being added, but when running, they do not appear in the GeoJSON. Does there need to be some other process that will tell the IMDF writer to accept these attributes?
Another post: https://community.safe.com/s/question/0D54Q00008is1jiSAA/why-is-the-download-url-not-being-returned-in-an-fme-server-app has already asked this question, but to date there was no definitive answer yet on that forum. I included the "data download" during publish, so that is not the issue. It's just weird that the download link is not available in the workspace app, but is available when running the workspace from the workspace repository. Does anyone might know what the cause of it is?
I am building a simple regex expression which extracts the letters of the alphabet including the letters with accents. What I am having trouble with is using FME's regex editor vs the online one and the conflicts. The example below I have screenshots of regex101 online and FME regex editor and they both show different results for the expression:[a-zA-Z\\sčćđšž]+ I need help understanding why is this and what to do to get around this issue?Also, how do you apply regex flags?
Hello. I'm thinking about how to solve a filter that is defined on this data:- KASON DJL ?IBABA ?LUKID ?DIPIR ?KELUK ?KOVAR ?PAS PADCA NIFKU BANKO - applies here if the name starts without "?" (KASON) and somewhere in the string a name appears with a "?" (e.g. ?IBABA, ?LUKID.. ) and at the same time the end of the string is a name without "?", so remove "?" throughout the chain. The result is this KASON DJL IBABA LUKID DIPIR KELUK KOVAR PAS PADCA NIFKU BANKOThere will be more such definitions and combinations, does anyone have an idea how to solve it? A regular expression? Or a combination of some transformers?Thank you
Hello dear FME community members, I use the HTTPCaller with an output in HTML. From that output I want to get values from the HTML and get them exposed as attributes. Therefore I use the HTMLExtractor to extract the values of the CSS selector and return the output als a List Attribute.The result is that I see one feature with several listattributes. After that I want to explode the list with the ListExploder. The strange thing is that the ListExploder dies not see the List attribute. When I use a AttributeExposer and expose the list (list{}) then the ListExploder sees the list...a strange behavior!?!? In several examples on the community the AttributeExposer is not mentioned or used to expose the list afther the HTMLExtractor, see an example: https://community.safe.com/s/question/0D54Q00008EcEOlSAN/how-can-i-isolate-html-table-values-td-based-on-attribute-name?t=1676911484807 I expected that the ListExploder sees the output list made in de HTMLExtractor. Is this a wrong assumption on
I have pull and transformed a series of table from a MS SQL Database. I am now trying to using FME to enter them into a specific sheet starting as a specified cell. I feel like this should incredible simple, but I struggling to get it to do what I need.
If I have addresses in an address field formatted for example:1234 Elm St ...and I want to remove all spaces to change the field value to look like this:1234ElmSt What Transformer and Parameter would I use?
Hello,i would like to transform a .csv list which contains adresses with a given latitude and longitude to dxf/dwg file into my local coordinate system (AUT-GK31-5). The exported dxf/dwg should contain a point with the transformed coordinates. thank you for your help - i am working on FME workbench 2019.0 input: (wish) .csv or excel lat: xxxlong: xxx(text: xxx) output:dxf/dwgpoint: (correct transformed coordinates - AUT-GK31-5)(point-text:xxx) Christoph
Dear Altruists, I am trying to convert NetCDF evaporation data to further processing, e.g. aggregate by month or calculating average value etc. However, I am struggling in the basic steps to unfold the multidimensional variables. When I am reading the data in NetCDF reader, it returned some attributes where I cannot see the lat/long or date file. But after using AttributeExposer to get the netcdf_subdataset_name; there I see lat, long and evaporation (apet) name but not sure how to get the values of these variables. I am given a python code in which the developer wrote a function to process the .nc data. Can anyone kindly tell me what FME transformers I need to use the replicate the python process as below: def funt_1(fileName, points, var): nc_fid = netCDF4.Dataset(fileName, 'r') prbc = nc_fid.variables[var] lats, lons = nc_fid.variables['lat'], nc_fid.variables['lon'] time = nc_fid.variables['time'][:] # Convert time to Julian Y = int(nc_fid.var
Writing to an Esri Geodatabase (File Geodb Open API) fails with this error: ‘Geodatabase Error (-2147219115): The row contains a bad value. There's an empty table created instead of a point layer.The error suggests that something's wrong with the schema, but I can't find the cause. The issue stays even with only one feature and limited number of attributes.Writing the result to a shapefile or to SQL works fine. FME version is 2022.1 Anybody had similar issues with the Esri Geodatabase (File Geodb Open API) writer and knows how to solve this? Thanks, Ruth
Hi all, I have an "issue" that is frustrating me to no end (probably because the answer is more simple than I'm making it), so I thought I'd run it by the community. I have a workbench where I am taking AGOL features and converting them to a dwg. The AGOL geometry that is giving me issues are the AGOL polygons after they are sent through a CLIPPER: I understand why the 'RESULT' is passed through the CLIPPER and spit out as polygons still. And I have them also going through a GEOMETRY COERCER (to fme_line) and even a LINE ON LINE OVERLAYER -- all good to this point. What I cannot figure out is how to remove the unwanted lines to obtain the "DESIRED RESULT", which would just be lines once they get into AutoCAD. There doesn't seem to be an attribute that I can use to differentiate whether the line came from the original polygon or if it is a result of the CLIPPER 'changing' the geometry (all geometry has the attribute "_clipped"
From Attribute Manager I have about 150 columns on which I have to run a series of condtitional query's to populate them. So far the only way I have found to do this is to open each "else if" option individually and adapt the text contained. The change could be easily done whith a simple "search/replace" process within a text editor such as Notepad++. The attached image shows the text circled in red that needs to be replaced with a another constant value. Unfortunately I can't find any way to make those changes within FME's "text editor" in the Attribute Manager".
Hello, I regularly save a file in a GDB (GDB-Name\\Topic_<date>) and want to display the differences a week later. Manually - I enter the file names myself - this works wonderfully, but it always requires a manual intervention to enter the correct names. Now I would like to automate this work. For this purpose, I calculate a variable using the transformer "DateTimeCalculator", which calculates the date of the last execution of the script (-5days). Afterwards I want to read the last table (GDB-Name\\Topic_<date - 5days>) from the GDB using the FeatureReader. My problem now is that I do not manage to specify the correct table within the GDB, or the correct number of features is output at the Generic Port, but without geometry and attributes. So my question is, where can I specifiy the correct tablename? Could someone please help me to solve this problem?
Hi there, I am trying to publish from an Enterprise geodatabase layer into an existing AGOL feature service however get the following error. I have tried setting the projection, used the Reprojector and Esri Reprojector but cannot seem to get past this issue. Any pointers? Thanks!