Using readers and writers to extract and load data.
Recently active
Earlier I asked about writing out DGN files with coordinate system.That's apparently not possible until now. But I would like to know how I can use seed files to get at least the symbology of a seed file into the DGNV8 writer. I referenced the seed file in the settings part of the DGNV8I reference a cell file in the settings as well I read my data in, define the level names in an AttributeManager based on the input data, use the PROJReprojector, to adjust the input data to the coordinate system of the seed file, and connect to a dynamic DGNV8 writer. In the DGNV8 writer I am missing the possibility to state that colour, style and weight will be used on the level, and not the individual object in the level. The level and level overrides section in the writer I cannot understand. My output dgn consists of multiple levels, yet the settings seem to point at one level only.Hence, I do not know how to configure the writer correctly.Leaving the level settings part undefined, but setting
Hi all,I’m trying to read a shapefile that is stored inside a ZIP file which itself is embedded inside another ZIP. I want FME to read it directly from the download URLI tried with https://url/data.zip[shp.zip] but did’nt work. any idea if its possible?Thanks
Hi Everyone,I’m new to FME. Currently, I use FME to convert IFC4 LOD 300 to CityGML 2.0 LOD 4. It happened that a long railing can make the size of one CityGML feature exceed 1 GB, and it’s challenging to import it into 3DCityDB. I have to divide the railing into pieces so that each CityGML feature won’t exceed 200 MB. As shown, the railing has 1270 parts of MultiSurface. I’m thinking of splitting it into 1270 CityGML objects.First, I tried the “Deaggregator” transformer. But when it is written to CityGML with other feature types, the divided geometry cannot be viewed. The file size is small, so I believe the divided geometry wasn’t written into the CityGML file. However, if I only convert the divided geometry into the CityGML file. The file size is 1.4GB, and it can be viewed in FME Data Inspector. Here is the screen capture of my workbench.I have no idea what was wrong. I was thinking it could be due to the geometry structure being changed. Originally, it was Geometry->MultiSurfac
Would be great to be about to output Dynamic blocks to AutoCAD, things likeVisible states and Flip setting would be great, Distances for stretch, rotation and Alignment parameters might be a bit harder to achieve.
I am trying to read in non-spatial data from Microsoft SQL Server. I need to read in three Tables and three derived Views. I have set up a connection using the Microsoft SQL Server Spatial (JDBC) format, and I have the connection to the main folder in the database working fine. In the Parameters > Constraints, I am only offered the option of ‘Tables’, and this does allow me to read in the three tables in the database perfectly. However I cannot find a way to access the Views which are in a different folder in SQL. Is Reader limited to just reading Tables? The FME documentation says “The Microsoft SQL Server Spatial (JDBC) reader and writer modules provide FME with access to spatial and attribute data held in Microsoft SQL Server database tables.” - with ‘tables'; being specifically mentioned, rather than all folders within a database.Is there another way of reading in Views? Or do I need to go back to the database creator and get him to do something else.
We recently migrated to FME 2025.1.2 / ArcGIS Pro 3.5.3Now I need to update some records in a point featureclass in SDE so I created a new workspace with a Creator, a FeatureReader, an AttributeCreator and a FeatureWriter.Reading the data from SDE works as expected. But when I try to write the data, I get the following errors:2025-10-22 13:12:21| 2.0| 0.0|ERROR |Esri Geodatabase Writer: Feature Type Definition 'd_y_n' was requested, but not defined. Please visit https://www.safe.com/support2025-10-22 13:12:21| 2.0| 0.0|ERROR |GEODATABASE_SDE writer: An error has occurred. Check the logfile above for detailsNot writing anything dynamic. Just point to the correct featureclass and go.I think I’m now pretty much out of options, because I upgraded my ArcGIS Pro.The only way to get it to work again is to remove ArcGIS Pro 3.5 and install a version which does work with an older version. I came from 2021.2.6 so I know that works, but I would prefer a more recent version.So my question is
I have a Geopackage, 458.761 polygons. Using a FeatureWriter, type Geopackage, I tried to store this. Unfortunately I get this error and could not found any logic behind this one:OGCGEOPACKAGE writer: Feature type 'Road' has geometry type 'geopackage_multipolygon' and cannot accept the current feature with a geometry of type 'geopackage_multisurface'. Skipping feature FME 2025.1.2.0
Hi All,I’ve got what should be a simple issue but I’ve not been able to find and answer for my exact query.I’d like to take a feature class, containing photo attachments, stored in a file geodatabase and write it to another file geodatabase. Essentially copying the data from one file gdb to another.I’ve seen lots of posts about reading and writing as separate processes. In both instances the photo’s are imported and attached or extracted from the data.Is it possible to essentially copy a feature class with attachments between file geodatabases, without having to extract the photo attachments and then reattach them?Thanks for your time.
Hello everyoneI am currently using FME Workbench 2025.0 (FME(R) 2025.0.3.0 (20250602 - Build 25241 - WIN64)) in combination with ArcGIS Pro 3.5. When attempting to add a File Geodatabase to my workspace, I encounter the following error:"Unable to perform any licensing-related tasks. Please check your Esri ArcGIS Compatibility workspace parameter, found in Navigator → Workspace Parameters → Translation. This 64-bit version of FME requires ArcGIS Desktop with 64-bit Background Geoprocessing, ArcGIS Pro, or ArcGIS Enterprise. Refer to this article: http://fme.ly/qua for more details."Additionally, the following message appears:"Failed to obtain any schemas from reader 'GEODATABASE_FILE' from 1 dataset. This may be due to invalid datasets or format accessibility issues related to licensing, dependencies, or module loading. See the log file for more information."The workspace generation fails I have attached a screenshot of my current FME Options and Navigator settings for your reference. C
I am looking for guidance on how to create this interactive map.. We have FME and ArcGIS… From time to time, we are given maps and we have to change the counties based on new staff. Most of the time the counties are adjacent. Other times not. We have a shapefile of the counties. I am looking for a solution where we can select the counties in the shape file/FME and output the selection for the update query.I believe I have all the pieces Just not sure how to attach the transformers together… or what the logic is to create this… TIA (Thank you in advance)
FME Form (Workbench) 2024.1.2.1 (20240906 - Build 24624 - WIN64)Oracle Spatial Database 19.27.0 (19c) Hello!When trying to read data in from an oracle spatial database, I receive the message that FME cannot query the metadata table. It's unclear to me which metadata table the reader is trying to use. This happens both with a FeatureReader and a SQLExecutor, the behaviour is the same. When switching logging to debug, there is no further logging of the query that is being executed.2025-07-29 13:52:56| 0.3| 0.0|INFORM|ORACLE Reader: Executing SQL Statement `SELECT * FROM DINO_DBA.GDW_BLK_ARE_VW' to obtain features for feature type `'2025-07-29 13:52:56| 0.3| 0.0|WARN |Could not query Metadata table for dimension for geometry column 'GEOMETRY' of table '' -- geometry will be assumed to be 2DThe FME documentation I could find (FME Support Center: Adding metadata entries for Oracle spatial tables or views) hasn't been updated since 2015.1, and refers to MDSYS.SDO_GEOM_METADATA which i
Hi, I am trying to manipulate the dates based on the logic. If the effective date falls between 06/01/2025 - 06/31/2025, then the date of inception should be 06/01/2025 and the similar rule applies for the month of july, aug, sept.And if the effective date is anywhere between 10/01/2025 - 10/01/2026, then the date of inception should be 10/01/2025. The issue here is :If the effective date is 08/20/2026 → Inception becomes 08/01/2025 ( Expected is 10/01/2025)The similar issue is observed for months of june, july, aug, sept for year 2026. I am surprised here why FME would not pick up the year from the date
I have a point feature class at each road intersection. And have a line feature class of these roads. I would like to determine the direction each line is oriented at each intersection.For example, I have one point at a four line (4 streets) intersection. The result would show the line ID along with the 4 IDs and orientation (N S E W). Or would show an angle? Something to determine which way the line is oriented in relation to the point. Thanks for any help. Steve
When writing 3-point arcs to Oracle Spatial with a projected coordinate system, FME 2020 (64-bit) can maintain their geometries as arcs. When writing arcs to Oracle Spatial with a geographic coordinate system, however, FME strokes the arcs into lines. Is it possible to write the arcs to a geographic coordinate system without converting them to lines?
I am currently using FME 2025.1.1 (Build 25615) and have had some issues with inspector crashing. I have tried multiple different ArcGIS Online provided background maps and they seem to be causing both Data Inspector and occasionally Form (when using Data Preview) to crash. I have tried with multiple different types of data, of various feature counts, sometimes it crashes on initial load of background map, other times when it reloads it after zooming in. Wondering if anyone else has run into this?
I’ve got some JSON data where the key/value pairs are separated so the keys are in one JSON block and the values in another (see the example below). I’m using:A JSONExtractor to get the "columns" fragment and then a StringReplacer and AttributeSplitter to convert it to a list. A JSONFragmenter to convert the "values" to a list. A PythonCaller to loop through the two lists and create the attributes.Is there a way to do this without python? I’ve attached a zipped file of my workbench, Example JSON============{ "columns": [ "sub_organisation", "system_id", "type", "mounted", "location", "road_id", "offset", "side", "geometry" ], "rows": [ { "message": null, "values": [ 24, 8, "1840", "Path", 8, 997, 10.9, "L", "POINT (1748664.55420184 5427732.02625559)"
Hey,I am mega confused with something that I thought would be relatively simple. I have a Survey123 feature layer in ArcGIS Online that automatically places survey points at 0 lat 0 long (west coast of Africa). What I would like to do is read the Survey layer into FME, geocode the data via an address attribute, and then write back the geometry updates to the layer without altering the attribute table at all. I can do all of that fine except for the final Write/update operation.I have confirmed that the layer in AGOL is editable and allows for Updates (attributes and geometry). I have the correct AGOL permissions to do these edits. In the parameters for my AGOL Writer, I have the Layer settings as: Update, Use Existing, Update Spatial Column = Yes. The operation completes successfully, but then when I check AGOL it appears that the layer’s geometry has disappeared. The table attributes are there, but no geometry is present.I can also see that AGOL recognizes some change to the data sinc
I am trying to see if I can update a feature layer in our ESRI Portal from a FGDB. We know we can insert, update, and delete features and have success on those fronts. However, we will like to also have dynamic schema available as we may change the data in our FGDB by removing/adding fields. I have tried several times to get a dynamic writer working to account for a schema change but without luck. I have tried to delete data in the feature layer to then insert but that had errors. Does anyone have advice or has done this? The FGDB is a testing stage as eventually we would want to update directly from SDE.
Hello community,i am using an Feature Writer to write Feature classes in an Feature Dataset in an EGDB.I found out that i need to enter the Feature Dataset Name/Feature Class Name hardcoded. For Example: FeatureDatasetName/FeatureClassName descriped in the following picture: SDE Feature Writer with hardcoded (static) Feature Dataset and Featureclass NameAn dynamically generated Value like “@Value(FD_Name)/FCName” or even the whole value @Value(FD_name_and_FC_Name) is not working as Feature Class.How i found that out? The Features get inserted in the Feature Class, even if i set Table Handling to drop and create. When i use the hardcoded (static) Feature Dataset and Featreclass Name the Table got dropped and created new, so it was working as expected.SDE Feature Writer with dynamic/Attributvalue Feature Dataset and Feature class NameWhen i use log level debug and use the dynamically (attribut value) Feature Dataset and Feature class Name, i get the following error Message which i dont g
Hi, I have a very simple FME worskspace that reads a shp-file and via Esri ArcGIS Feature Service updates a Feature Layer (hosted) on Portal for ArcGIS.The data is simple plygons with a few attribute. The Feature Layer is published from the same data in ArcGIS Pro.When i run my FME script the polygon ends up aprox 2000 km wrong. It does not matter if I have Feature Type Handling: Use existing or Truncate. If i use the old Esri ArcGIS Portal Feature Service writer it works fine. I am using FME 2025.1, Portal for ArcGIS 11.4 and PCS is EPSG:3006
Hi all.I need to identify (and convert) multisurface /curve polygons in a GDB.The GDBs contain one feature class with many polygons: some of these records are multipart polygons. The data I am working with comes from uncontrolled sources using different GIS programs, so the GDBs are put through a workbench to identify obvious spurious geometries like self-intersections (this works well). However, I am having a recurring problem where the downstream processes in other systems are failing due to multisurface /curve polygons.I have tried exposing the fme_type and geometry, but they are always “fme_areas”. However, if I run GDAL ogrinfo tool identifies lots of Multisurfaces, some are also CURVEPOLYGONs. For example, GDB today with 8 records had 64 multisurfaces.Any anyone help point me in the right direction for how I might Id these issues in FME, or incorporate the GDAL tool somehow?Note: I cannot share example data due to its sensitive nature.Many thanks
What is the process for ensuring that a custom coordinate system defined using the recipe from @daveatsafe below is reliably used by all members of a team using FME Desktop and also Server?(better yet: implement Update all available Coordinate Systems with EPSG Codes so it’s not necessary)
I have many parquet files stored in an s3 bucket; when I use the s3 connector to download the parquet file, I am able to read it successfully, but passing the s3 uri (“s3://”) raises an error:PARQUET reader: PARQUET reader: Failed to open file 's3:\my-bucket-s3-test\fme-test\test.parquet' for reading. Please ensure that the file exists and you have sufficient privileges to read itFailed to obtain any schemas from reader 'PARQUET' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more informationWhen I try to pass the url:PARQUET reader: PARQUET reader: Failed to open file 'HTTPS:\s3.us-west-2.amazonaws.com\my-bucket-s3-test\fme-test\test.parquet' for reading. Please ensure that the file exists and you have sufficient privileges to read it When I use the feature reader, regardless of whether or not I specify a web connection, it converts forward slashes to back slashes. How do I work w
Hello everyone,A colleague is trying to read a CSV file in FME 2024.2, but the file appears to be generated by Linux-based software. As a result, FME interprets the entire file as a single block of text instead of recognizing each line as a new row. Does anyone know how to ensure FME correctly identifies each line break in this file?
Hello, its me again.So I’m playing with changing excel documents in Form 2024.1 and its going superb, except from the fact that when Form writes out my changed excel it adds an @ in front of some of the formulas. So for example the formula that gets read in as:=XLOOKUP(blabla)Gets written out as:=@XLOOKUP(blabla)Which then makes the whole outcome excel document breaks.I have ran this with caching and see that at last cache before writing then the formulas are intact, so this must happen in the writer or that the excel gets written out in some manner that my excel setup *misunderstands* it?As always, all comments are welcomed (as long as you not a person just looking to score some points by copy/pasting what AI said the problem was).-Hlynur