Using readers and writers to extract and load data.
Recently active
Hello community,I am trying to combine 2 different images. DSM (GEOTIFF) : Band 0 (Real32) as heights 50 cm GSD Orthophoto (JP2): Band 0 (RED8), Band 1 (GREEN8), Band 2(BLUE8), Band 3 (UINT8 - NIR) 10 cm GSD My workflows looks like this: with following settings Unfortunetly there are some pixels where values get lost, so when I add an RasterBandAdder, there are holes in it.Unfortunetly I dont know a solution where I can add those two images into one without loosing informations.
I’ve seen both examples of creating KML:https://support.safe.com/hc/en-us/articles/25407754952717-Creating-KML-Folders-Through-KML-IDshttps://support.safe.com/hc/en-us/articles/25407609389453-Creating-KML-Folders-By-Feature-Type-FanoutI’m able to create folder structure:When I tried to add placemarks under subfolder, my folder structure gets overwritten. Subfolder has ID in the form of State and AssetType (minus spaces and special characters, you can see the ID below in folder name). Example, Alabama’s only plant asset has parent ID Alabama01Plant.What am I missing? Have latest FME 2025.1 Form.
Normally I use FeatureReader to import my datasets. This time I am dealing with a 4.5 GB GML dataset. What are the best settings to improve reading speed for my FeatureReader? Just like a general approach to use, reading GML file is just an example. I also other formats like .gdb, xml, json etc.I try to use the SpatialFilter when possible which makes the reading already more targetted. Hence, its switched this time also using my study area as Initiator.
I need to write my data into an MSSpatial database with a spatial index. However, when setting the SQLSERVER writer to the following then I do not get any spatial index generated. When I now go into SSMS to ‘clean up’ after FME Form then I face the issue that I have a column id of type identity, but it isn’t a PrimaryKey. Looking into the possibilities to set an index in the attribute definitions I can see that I set the index to ClusteredNotNull. I can also see there is no possibility to generate a ClusteredPrimaryKey, as it is necessary to create the spatial index. I assume I am going somewhere wrong here and would like to hear how I get my spatial index generated and applied when I am writing the data, instead of following up in SQL.
Is anyone else encountering vertices that are not displaying when Mark Coordinates is turned on in the Data Inspector? The coordinates are in the feature record, and display when I select them. Currently using FME 2025.1The features I’ve noticed this in have been donuts, and it’s the inner ring that is not appearing.
Hi,I’m struggling with reading JSON as a flat table, which I could use in GIS.I have the following JSON: I enabled option “Flatten Nested JSON Values into Attributes” but that produced one row with many columns. In some other post someone proposed a query json["collection"][*], but that also didn’t work.What options should I use to produce a flat table with JSON attributes as column names?
Hi there,I have created a Mosaic Dataset in ArcGIS Pro from downloaded 1m DSM GeoTIFFs. This displays fine in ArcGIS Pro. The boundary of the mosaic is clipped to the extent of the data I want to analyze. I need to convert this to LAS to run some ArcGIS GP tools. So I have done this using the Mosaic Dataset as an input in FME:Esri Geodatabase Raster → Point Cloud Combiner → LAS WriterThe output shows some incorrect data striping and looks like it missed some areas. In ArcGIS Pro:In FME Inspector:I don’t see any out of memory errors or issues with reading the Mosaic data in the FME logs.Any ideas?Thanks,Marc
Hi all,I am working on a script to replicate a set of feature classes from one enterprise geodatabase that we use for transactional editing purposes to another enterprise geodatabase that we use for publication purposes for the organization. This replication script would be scheduled in FME Server to run on a nightly basis.The issue is that the feature classes I plan on replicating have several domains and subtypes applied to them that don’t translate correctly.I’ve been advised to use the ‘Resolve Domains’ functionality and change the configuration from ‘coded domain’ type to ‘char’.My test workflow involves the below:Copying the feature class via the ‘Import Feature Class’ tool in ArcGIS Pro into the target Enterprise Geodatabase to have the feature class available in both geodatabases With FME:Selecting the ‘Resolve Domains’ checkbox in the Writer at the outset, and using the ‘Insert’ and ‘Truncate Existing’In the Writer configuration, changing the ‘coded domain’ type to ‘char’ and
Hi, I have a dxf file with objects in it, their representation is fine, I’m happy with it.However I need to filter these object using an polygon extent. So I read the dxf file using and Autodesk AutoCAD DWG/DXF reader and then lose the linetypes.The information seems to be read because an inspector shows me that the attribute autocad_linetype is correctly read (e.g. symbolLayer1), so it feels like the problem is that the style is not defined and thus FME uses CONTINUOUS in the end. Colors seem fine though. Is there any way to keep these types without recreating everything in FME? FME versions:Form 2023.1.1.1 Best Regards, Julien
Hi all,I have a CSV file containing stops with fields stop_lon and stop_lat. I’m trying to turn them into geometry and reproject them so I can use them with other layers.My workflow looks like this:CSV → Tester → VertexCreator → CoordinateSystemSetter → Reprojector In VertexCreator I assign X = stop_lon, Y = stop_lat. In CoordinateSystemSetter I set the source coordinate system to EPSG:4326. In Reprojector I reproject to EPSG:7856 (GDA2020 / MGA Zone 56). After running this, the points don’t land in the right place compared to my suburb polygon layer (which is already in EPSG:7856). In QGIS, both layers line up fine (on-the-fly reprojection), but in FME they don’t.Clearly I’m missing something in how I’m handling coordinate systems — but I can’t see where the mistake is.
Hi, I have a polygon that looks like it has some floating point issues in measures around 0. What is the best way to fix those values without affecting the legitimate values.I’m thinking extracting the measures as a list and then editing the list in python and resetting all the measures from the new list, but that seems a little convoluted.
I converted the fbx model to citygml format and opened it in KITModel Viewer, but encountered an error and the model did not display。
I'm trying to create a custom transformer 'FeatureCountLogger' which logs the number of features inputted into this transformer. The custom transformer contains a PythonCaller with the following code: import fmeobjects class FeatureProcessor(object): def __init__(self): self.featureList = [] def input(self,feature): self.featureList.append(feature) def close(self): logger = open(FME_MacroValues['Summarylog'], "a") message = FME_MacroValues['Message'] + str(len(self.featureList)) + '\\n' logger.write (message) logger.close() I want to use the logger multiple times, so I created a published parameter 'Message' in the custom transformer, so I can submit the text logged to each instance of the transformer. When I'm running this I get the following error: Python Exception <KeyError>: 'Message' It seems like the PythonCaller can't a
Hi,I am looking for a writter that will allow me to save blob data in FME Flow. On FME Form I am using AttributeFileWriter that is working completely fine
Hello Am struggling to combine geometry of an object . I should have 19 objects there is only 1 object which just doesn’t want to combine any unknown reason…..don’t know why ? Any suggestion / idea would be much appreciated. The reason i am combing objects is to extract the face of each object and then obtain FACE centre point for further analysis. thank in advance
Greets,I have two question: First one: how can I clip the green polygons based on the reds one with the same ratio?Second one: is there any way to move the red polygons to match the border of the green polygons. The Red and green polygons not in the same layer
In the stand-alone FME Form my FME script works well. However, using the same script in ArcGIS Pro faced error saying Esri Geodatabase Writer: Feature Type Definition … was requested, but not defined. A possible reason is that you may not have permission to create the Geodatabase. The error number from ArcObjects is: '-2147467259'. The error message from ArcObjects is: {}FeatureWriter or classical Writer, there is no difference. With other FME scripts (created by others) a fgdb can be created. Why not the mine?
Hi there,I have 2 parcel datasets, a master copy and a weekly update copy that I need to process into the master copy. Each parcel only appears once in each dataset and has a unique parcel ID so matching is fairly easy. I’ve used a change detector to flag any parcels with geometry updates, but now I need to identify the type of change that has taken place. This could involve parcels being split, merged or just the boundary being updated. What is the best way to do this? The logic in my head is this so far:Split parcels - Either, mutliple new parcels being inserted within the boundary of one that has been deleted OR Parcel boundaries shrinking and new parcels being added within boundary of originalMerged parcels - New parcel being inserted that takes the place of multiple deleted parcels OR Parcel boundaries growing to cover extent of deleted parcels
I’m able to write dynamically to a file geodabase using the GEODATABASE_FILE writer with the following setupHowever, trying to do the same in a FeatureWriter fails with a cannot define schema errorSame behaviour seen in both FME 2024.1 and FME 2025.1Is this a known issue?If i try to set schema definition name to fme_feature_type_name in the Feature Writer it’s not possible, only fme feature_type is available for selectionThe only way i can seem to get the FeatureWriter writing dynamically to a File geodatabase is by adding the schema attribute to all features
Hi FME folks,I'm trying to reproject these coordinates: SRID=3857;POINT(530385.593659309 6910697.223221438) into a EPSG:28992 point.I notice the result FME gives me differs a lot from other tools / methods - the difference is about 12 cm.My method:1: Scraping JSON: "geometrie": "SRID=3857;POINT(530385.593659309 6910697.223221438)"2: CoordinateSystemSetter: EPSG:38572: Use regex to extract Lat / Lon.3: Create point using VertexCreator4: Reprojector: Source: EPSG:3857 | Destination: EPSG:28992Results FME:POINT (112820.96207905837 513493.7654737713) Other tools used:Internal geocoding tool: POINT (112820.87254041698 513493.83730794006) ChatGPT conversion: POINT (112820.87254041698 513493.83730794006) Google Gemini conversion: POINT (112820.87254042 513493.83730794) Grok conversion: POINT (112820.87254042 513493.83730794) Python conversion: POINT(112820.873 513493.837) SQL conversion: POINT (112820.87254041698 513493.83730794006) So now I wonder, why is FME saying A and all the other tools
Hello,I’m using a Python Caller in an FME workspace. In the python script I’m trying to read in a gpkg file using the code below: #import geopandas as gpdimport pandas as pdimport osdef FeatureProcessor(feature): path_gpkg = feature.getAttribute('path_gpkg') print(path_gpkg) print("file exists - ", os.path.exists(path_gpkg)) gdf = gpd.read_file(path_gpkg)However, I get an error saying:Python Exception <DataSourceError>: '/xxx/abc.gpkg' does not exist in the file system, and is not recognized as a supported dataset name.It is strange because the line ‘print("file exists - ", os.path.exists(path_gpkg))’ returns True.Has anyone come across anything similar?Thanks :)
We are upgrading from 2019.2.1.0 to 2023.1 I have many AGOL feature services with attachments that we read and then write to a local database for archiving.For example, I have a feature service that has about 50,000 point features. Only 4 of them have attachments (500K jpegs). I have it set to read in batches of 1,000.In 2019, if I read this feature service with Attachments = Yes, it takes about 1 minute to read everything. If I open the same workspace in 2023 and run it without updating the reader, it times out every time. Sometimes it doesn't even log that it reads the first 1000 before timing out in about 7-10 minutes. Other times it has read for over an hour but still times out. If I disable attachment reading, it reads quickly in 2023. If I upgrade the reader to 2023, the reading still times out when attachment reading is enabled. The same is true for FME server. On our old 2019 server this workspace runs in about 2 minutes, but it times out every time on 2023. Help, pleas
I feel like I must be missing something obvious but so far have not been able to resolve. I have published a Web Layer from Arc Pro to our organizational AGOL account. This Web Layer feature service contains three sub-layers. I’d like to update only one of the sub layers using FME. This works fine if I publish each layer as its own service, but if published as a single service with multiple sub-layers, I can’t figure out how to target only a single sub-layer. Publishing these as a single multi-layer service has the advantage of keeping them ordered together on AGOL.When I open FeatureWriter to set parameters, I can select the overall feature service, but not an individual sub-layer. I suppose I can run it without specifically identifying which of the sub layers I am targeting but am a little hesitant as I’m not sure how it would know which of the sub-layers I’m attempting to update. Here is screen shot of my FeatureWriter interface below. Road Rock is the feature service contain
Dear FME Community,I’m trying to cut lines with segment delimited by start and end point and all works with my method and with the transformer Snipper, but it doesn’t works with line who have auto intersection like a loop.With a “normal” line I’ve this result :But with a line who have a loop I’ve this result :The result should be this :I know how to isolate lines with loop but I don’t know how can I treat them.Can you help me ?
Hi,So I have a DGN. I am reading it in (not exploding cells so its just one point) and then changing its coordinate systems. I want to then reexport a dgn. The problem is if I want the cells to show up in the output DGN I need a cell library. Is there a way that I can just use the definitions of the cells in the original file (without having to make a cell library every time out of it) when I write it? Like you can with the DWG writer. They are exactly what I want.I know this question has been asked before, but that was 10 years ago and there was a few changes to the writer a few years ago.At the moment I am limited to what is in version 2023.1Thanks