Using readers and writers to extract and load data.
Recently active
I’m working on a flood-affected buildings project in St. Pauli, Hamburg, using FME’s SpatialFilter transformer. I uploaded an image of my setup (see attached). Almost all buildings are being rejected, and I’m not sure why. My buildings are the "generic object," and the flooding areas are the clipped ones.
I want to re-project an image file into CRS EPSG 20047 BCSG2020But that CRS is missing from my drop-down list.I am running FME Desktop FME(R) 2022.1.3.0 (20220928 - Build 22630 - WIN64) Is CRS EPSG 20047 BCSG2020 available in a more current version?
I know I that you cannot delete feature under DWG, but what if you want seleteed a few because one of them is bad. I am GIS Specialist and I have the DWG files here… The DWG I have is a campgound that somebody worked on it and gave it to use and as I prepare to make a map for that campground and discovered that one of the entity I think “X” is out of place.What I was trying to open the 2024.1 Data Inspector and bring that Dataset into the View to see it andI use the X to turn it off and use the Save As as a new Dataset without the “X” layer . When I save it and it still comes with it every time. I tried to use different method.here is the screen shot I have here. The one I want to remove this X layer under the DWG Layer is “X” . The Red line I drew is that one that I want to delete it. I don’t have the latest version to 2025 yet… Can anyone tell me if there is another way around to fix this ?
Hello, I'm currently working with FME 2022.1 on NETCDF files from https://daac.ornl.gov/cgi-bin/dsviewer.pl?ds_id=1851 The files are .nc4 and when I try to open them on FME Workbench I have this warning. (on picture) It seems that FME can't link the dimensions defined in the file with its own "lat/lon and time functions" I tried opening these files on ArcMap 10.8.1 and the dimensions are immediately recognized correctly. How can I make FME understand that lat = lat, lon = lon and time = time ? Or how can I set it when reading the nc4 file ?
Hi everyone,I'm working with a topologically accurate line network in FME 2023.1.1.1. I have:Two source points located at the start points of some lines (also refer to pipe-network_plus_point-features.png)→ the blue rhombusValves represented as point features, located somewhere along the lines (not necessarily at endpoints)→ the magenta colored pointsMy goal is to identify all topologically connected lines starting from each of the sources and continuing until the valves are reached. Each group of connected features should be treated as a separate subnetwork. In this case, I expect to identify two distinct subnetworks, one for each source. Also refer to desired_result.png and the detail 1 and 2.Has anyone tackled something similar? I’m looking for a solution that ideally avoids using Python and relies on standard FME transformers (e.g., using loops or topology-based logic).Any suggestions or best practices would be greatly appreciated!Thanks in advance
We've set up a process for a client that takes data and writes it to CSV. That CSV is then loaded into a data warehouse.That CSV conforms to the official CSV standards and thus the last line ends with a CR/LF:Shown here in Notepad++. This means there's a last, empty, line in the file. The data warehouse system apparently cannot handle this. Is there a way to remove this last CR/LF from the file? (post-processing python, probably).I must admit I am not convinced this should be fixed on the FME side, but trying to get the data warehouse developers to move on this is not going to happen.
The scenario is The ask how can i eliminate to read from row 1. The attributes that I intend to process is No, Name and ID
I would like to publish the app so that the end user can optionally select a variety of filters including:date ranges static attribute fields (A or T) dynamic input fields (for example if a new business code is added to the source data)I have been able to publish the user parameters in the app but the data does not filter from the results set.
Hi All, I’m having an issue writing out to GDB with a schema dataset. The workflow extracts multiple GeoJSONs from some GSI open Datasets (example path below), clips them to an AOI and extracts them to a GDB. There are around 50 datasets in total .The actual reading of the data seems fine:data features = Geojson format read through a feature reader schema reader = Schema Feature (Any Dataset) format reading the Geojson (n.b. when reading using the schema port of the feature reader, I can’t get it to read schema from multiple datasets, hence why have this separate)I am writing through a FeatureWriter - see settings in screenshot below.The annoying thing is that sometime it works, then I select a new set of features and then it doesn’t, and I can’t seem to find a pattern. However checking the input table before the Writer, everything (I think) looks ok. It feels like there must be something that is not right, but just can’t seem to pinpoint it. Any ideas would be greatly appreciated 🙂?
Hi All,I am trying to reproject a .tif file with the xy coordinate system NAD_1983_UTM_Zone_16Nto WGS84 and vertical coordinate sytem EGM08.I downloaded the aditional .grd files from FME and saved them under C:\Program Files\FME_2022_1\Reproject\EsriPEGridData\vertical\egm\egm2008-1.grdI created a .gcs file which is located under C:\Program Files\FME_2022_1\Reproject\GeoidHeightGrids\World\egm2008_1.gdc and looks like this: ..\..\EsriPEGridData\vertical\egm\egm2008_1.grdI always get the following error message: CsmapReprojector (TeeFactory): CsmapReprojector: Reproject: Could not reproject the geometry of the preceding feature: CS-MAP Reprojector: Unable to load geoid height grid 'C:\Program Files\FME_2022_1\Reproject\GeoidHeightGrids\World\egm2008_1.gdc'What am I doing wrong?Any help very much appreciated.
Hi,I would like to save a copy of Map Image Layer from Esri Portal into gdb. Esri ArcGIS Portal Feature Service does not recognise raster layers and ArcGISOnlineConnector does not recognise geomety. What is the way around?
Hi all,I'm working on a workflow using FME where I want to use the SQLExecutor transformer to query data from a File Geodatabase I've set the input to point directly to the FGDB file, and tried several SQL queries — even very simple ones like:
We have several Database Connections for our workflows, and most of them are for our county ArcSDE geodatabases. Each one has a Default version and a Sync version for editing, and we have all of the connection strings saved with the Sync version.We use FME through a Data Interoperability license, and after FME updated to 2025.0.0.0 (with the ArcGIS Pro update to 3.5 from 3.3) the Version Type is now set to ‘NONE’ for all of them instead of ‘Version from SDE Connection’ like it was before, and the Transactional Version is set to Default automatically. Plus, it seems to us that our connections strings have changed too. We found this the hard way, after changes were written straight to Default.So I guess I’m writing to see if anyone else had this problem, or to see if we’re missing something - I haven’t found any posts or fixes in the changelog about it yet. And, are there tips for how we should be storing these database connections? (I am aware it could just be a Data Interop issue - we’
Hello to all,3 months ago, kailin told me that the 2024 version did not allow writing zones. I would like to know if it is the case now. If not, what is the planned schedule because for the moment we are blocked for the enrichment of our modelsBest regardsBruno
i have an excel sheet and want to make some sums and write them in another new attributei want to sum row O from start to line above an attribute in row M wich is VU or VD...so e.gsum 1 = light bluesum 2 = light blue + dark blue and so on till the next line which is one above a line with VD or VU…...i hope i have explained it not to difficult…...i think the hard part for me is that i need always a sum from the beginning again Thank you and greetzfranco
I have a point location and I would to find the 20 mile extent from that point across a road network. Effectively, I want to create a 20 mile buffer around my point but it must use the road network to determine the distance in all directions. I have tried creating distance isolines using the NetworkCostCalculator and ContourGenerator but this didn’t seem to work very well with a large distance specified (contour interval of 20 miles equivalent). Does anyone know how I might be able to do this?
Hereby a short description of my workflow with the questions at the end. I have created a TIN from points. (TINGenerator)Then clipped it with polygons (water area). (Clipper)The water polygons have been lowered to -1 meter with the 3DForcer.With a Junction I collect both the water (3D Polygon) and the TIN (surfaces). Here are my questions:how do I properly merge those geometrytypes together? how do I fill up the (vertical) gaps between the lower water and the surface.I tried many transformers and different steps, but as you can guess, with no results. Using: FME2024.1
Hello,I am trying to string together attributes. The difficulty is that the attribute names can vary by dataset.Generally what i am trying to do is that may look something like this:DEPTH [m] Measurement 1 Measurement 2 Measurement 3 Measurement 4 0.5 <NULL> 1 4.5 2.1 1 <NULL> 2 2.3 2.2 1.5 3.5 1 1 2.1 2 3.0 1 4.5 <NULL> What I am trying to accomplish is something like this DEPTH [m] Measurement1 DEPTH [m] Measurement2 DEPTH [m] Measurement3 DEPTH [m] Measurement4 <NULL> 0.5 1 0.5 4.5 0.5 2.1 <NULL> 1 2 1 2.3 1 2.2 1.5 3.5 1.5 1 1.5 1 1.5 2.1 2 3.0 2 1 2 4.5 <NULL> Depth and measurement values can be tabstop, space ore comma-seperated, doesnt really matter. In a later step I want to route all Measurements into different features using the AttributeExploder and Aggregator while still keeping the depth information. I realise this could be easily done using the AttributeMa
Hi ,I'm building a workspace in FME where I need to copy multiple tables from an SDE geodatabase to a File Geodatabase (GDB). I use an Excel file to map the source and destination table names.Excel structure:Tablename Destination SDE_TABLE_1 GDB_TABLE_1 SDE_TABLE_2 GDB_TABLE_2 Workflow: I read the Excel file using a FeatureReader to get the list of tables. For each row, I use another FeatureReader to read the source table from the SDE using the Tablename attribute. I then use a FeatureWriter, setting fme_feature_type to the value of the Destination attribute so it writes to the correct table name. The problem:The destination tables are created with the correct names in the GDB, but they do not contain any attributes from the source tables only OBJECTIDs. What am I missing here? My tables are in Excel and will be dynamic, so I can't simply explode all attributes manually.I have a solution using a PythonCaller, but I'm interested in a more native solution using FME transfo
Is there a way with an ArcSDE Reader with an archived clause to expose the attributes GDB_FROM_DATE and GDB_TO_DATE ?Thanks
Hello,I need to make a model but I honestly don't really know how to start it. I will try to explain.I need to create groups of “municipalities” whose data should be published together. I already have a list of which municipalities is intertwined with which municipality based on geometric overrides but the same municipalities may be intertwined with another municipality, which in turn may also be intertwined with another etc....Eg Municipality 1 should be charged together with municipality 3 and municipality 4. I have this list, but then I also have to search in the same list if municipality 3 should also be charged with other municipalities, in this case yes, together with municipality 6 and municipality 7. Then I have to do the same for borough 4 and borough 6 and borough 7 and so on until I have everything and can then make it 1 group. Is this clear? Can somebody help me with this model or give me a tip how to start it. I attach a sample of my starting table “Samen publiceren”I alre
I wonder if anyone knows a knows what would be a good format to write out solid geometry. I have worked with filegeodatabase but that is multipatch. I need spatial indexing to be able to use a spatial intersect with a feature reader. So a big dataset with solids where we often only need a few of.The multipatch feature class (FGDB) kind of works but then I need a solidbuilder and that takes a lot of time.Thank you!
Hi FME Community,Our team is looking to connect with users who have working experience with the Protobuf reader. If you’ve used it in your workflows or projects, we’d love to hear about your experience!We’re especially interested in:How you’re using the reader in real-world projects Workflow examples or use cases Performance insights Any challenges or suggestions you may haveIf you're open to sharing your thoughts - or even jumping on a quick call - please comment below or send me a direct message.About ProtobufProtobuf is a compact, open-source format developed by Google for serializing structured data. It is widely used in APIs, messaging systems, and IoT applications where efficiency and portability are important.The new reader supports .pb (binary) and .json data files defined by .proto schemas. It works with Proto2, Proto3, and Editions 2023. Geometry is not supported.Available in build: FME Flow 2025.1 (Build 25587+)
Hello everyone! I'm a novice in FME Form/Flow. Maybe somebody can help me.I have a workspace that has multiple PostgresSQL readers, and these readers have a reference to the User Parameter in the WHERE clause.This workspace is published to FME Flow and triggered by an Amazon SQS trigger. The SQS message content is a JSON with parameters that are required for the readers in the workspace.My question is, how do I pass/parse incoming content to separate parameters in the workspace?
I have generated a raster that has integer data values between 1 and 6 and needs a nodata value. As the RasterInterpretationCoercer has a “Data Interpretation Type” of “Int8” I thought my task would be as simple as:Use the “RasterBandNodataSetter” to set the Nodata Value of -128. Use the “RasterInterprationCoercier” with the Data Interpreation Type of “Int8”. Use the GEOTIFF writer to output a tif file.When I try this type of workflow and then use FME to read the generated tif file, I find that the raster band is written with the type Uint8 and that my data value has been changed to 128. I am using FME 2025.0.3.Is it possible to get the GEOTIFF writer to write raster data with the datatype of int8 and a negative Nodata value? If not, which raster types in FME will allow this?