Using readers and writers to extract and load data.
Recently active
HiI have a a workflow exracting data from an API. I have got almsot everything I need from the JSON but need to get as single description field. The JSON structures breaks the description into sever parts all nested within the description part. The number of parts varies by feature.I essentially need all the text elements in the image below When I use a JSON exposer it asks me to specificy each indexed element, but I do not know how many there will be in any given feature I imagine there is something really obvious I am missing hereClosest I have got is adding another JSON extractor using the query:json["fields"]["description"]["content"][*] is giving me:{"type":"paragraph","content":[{"type":"text","text":"This Jira ticket is for all activities related to the implementation of 365 – "},{"type":"text","text":"Office.com","marks":[{"type":"link","attrs":{"href":"http://Office.com"}}]},{"type":"text","text":" rollout."}]}Or using:json["fields"]["description"]["content"][*]["content"][*
I have two tables where I have to compare rows against columns. First table (excel) contain Analytes as columns, but the second table (sql) has analyte column which contains all the analytes as values. I have to compare the values from the Excel table (which has analytes as columns) with the corresponding limits from second table.Example of first table:Example of second table: I have tried couple of methods such as attributepivoter ,doing it via the pythoncaller but was not successful
Hi FME users,I am creating an automatic workflow to download GTFS (Transport Data) by HTTP caller. The zip file contains few CSV files which I need to read them separately for my workspace. The issue is I cannot reach each file through the zip folder by using Feature Reader. I want to avoid unzipping manually as I want to create an automatic workspace. Can you please advise on how to solve this issue? Appreciate your help.
Hi,I've been trying too use autocad_xref_path and autocad_xref_name to insert file (another dwg) into REALDWG writer feature type. It should be basic. But it's not working. No warnings, no errors.Did anyone succesfully managed to do that? Can you explain me what am I doing wrongRegards,Želimir
Hi, Has anyone had any issues placing in 3D symbols via cell file into FME DGN styler? It seems as soon as a solid or surface is involved the symbol dies not show correctly i.e these elements are missing. any advice thanks?
Hi,HELP. experiencing issues with cells in dgn styler.Can FME dgn v8 writer output solids? I am using dgn styler to input graphic cells from .cel file but seems like data is lost on output. When lines are used within the .cel file lines change colour within the output also. Please advise. I read about named and unnamed cells what is the difference? When I add the cel file to dgn writer elements go missing and colour of symbol is altered! In the writer I am using v8 seed file as provided in fme install. Am I missing anything had anyone wise have cell dgn styler experience?
I am trying to set the annotation scale options for a block in CAD but I cannot seem to find the proper attribute or setting. I want to be able to set the available annotative scales similar to how its done for text below in the DWG styler. I want to have these scales preloaded for my block as seen below.
Is it possible to generate a separate log file or configure the existing log file to display metadata for the reconciliation purposes. The field that I am looking to display is the feature count in input file, feature count in both output file, who executed the workspace with timestamp, the amount field totals in the input file and the amount field totals in the 2 output files ( I have a workspace where there is 1 input file and 2 output files) . Also I have noticed that FME overwrites to the same log file every time the workspace is executed, is it possible to create a unique log file at every run? Thank you for the support.
Hi, Has anyone went through issue with the Value doesn't fall within the Domain” in a File Geodatabase ?Even though the description is already there See screenshotI am currently dealing with it and it is a lot of work…Is there a workaround to fix the error ?The reason I am asking is because I have to go back to the Recreation.gov website and re-do again and reviw to ensure I choose the right one.I am using ArcGIS Pro 3.3.6 in a Citrix envirnoment
Earlier I asked about writing out DGN files with coordinate system.That's apparently not possible until now. But I would like to know how I can use seed files to get at least the symbology of a seed file into the DGNV8 writer. I referenced the seed file in the settings part of the DGNV8I reference a cell file in the settings as well I read my data in, define the level names in an AttributeManager based on the input data, use the PROJReprojector, to adjust the input data to the coordinate system of the seed file, and connect to a dynamic DGNV8 writer. In the DGNV8 writer I am missing the possibility to state that colour, style and weight will be used on the level, and not the individual object in the level. The level and level overrides section in the writer I cannot understand. My output dgn consists of multiple levels, yet the settings seem to point at one level only.Hence, I do not know how to configure the writer correctly.Leaving the level settings part undefined, but setting
Hi all,I’m trying to read a shapefile that is stored inside a ZIP file which itself is embedded inside another ZIP. I want FME to read it directly from the download URLI tried with https://url/data.zip[shp.zip] but did’nt work. any idea if its possible?Thanks
Hi Everyone,I’m new to FME. Currently, I use FME to convert IFC4 LOD 300 to CityGML 2.0 LOD 4. It happened that a long railing can make the size of one CityGML feature exceed 1 GB, and it’s challenging to import it into 3DCityDB. I have to divide the railing into pieces so that each CityGML feature won’t exceed 200 MB. As shown, the railing has 1270 parts of MultiSurface. I’m thinking of splitting it into 1270 CityGML objects.First, I tried the “Deaggregator” transformer. But when it is written to CityGML with other feature types, the divided geometry cannot be viewed. The file size is small, so I believe the divided geometry wasn’t written into the CityGML file. However, if I only convert the divided geometry into the CityGML file. The file size is 1.4GB, and it can be viewed in FME Data Inspector. Here is the screen capture of my workbench.I have no idea what was wrong. I was thinking it could be due to the geometry structure being changed. Originally, it was Geometry->MultiSurfac
Would be great to be about to output Dynamic blocks to AutoCAD, things likeVisible states and Flip setting would be great, Distances for stretch, rotation and Alignment parameters might be a bit harder to achieve.
I am trying to read in non-spatial data from Microsoft SQL Server. I need to read in three Tables and three derived Views. I have set up a connection using the Microsoft SQL Server Spatial (JDBC) format, and I have the connection to the main folder in the database working fine. In the Parameters > Constraints, I am only offered the option of ‘Tables’, and this does allow me to read in the three tables in the database perfectly. However I cannot find a way to access the Views which are in a different folder in SQL. Is Reader limited to just reading Tables? The FME documentation says “The Microsoft SQL Server Spatial (JDBC) reader and writer modules provide FME with access to spatial and attribute data held in Microsoft SQL Server database tables.” - with ‘tables'; being specifically mentioned, rather than all folders within a database.Is there another way of reading in Views? Or do I need to go back to the database creator and get him to do something else.
We recently migrated to FME 2025.1.2 / ArcGIS Pro 3.5.3Now I need to update some records in a point featureclass in SDE so I created a new workspace with a Creator, a FeatureReader, an AttributeCreator and a FeatureWriter.Reading the data from SDE works as expected. But when I try to write the data, I get the following errors:2025-10-22 13:12:21| 2.0| 0.0|ERROR |Esri Geodatabase Writer: Feature Type Definition 'd_y_n' was requested, but not defined. Please visit https://www.safe.com/support2025-10-22 13:12:21| 2.0| 0.0|ERROR |GEODATABASE_SDE writer: An error has occurred. Check the logfile above for detailsNot writing anything dynamic. Just point to the correct featureclass and go.I think I’m now pretty much out of options, because I upgraded my ArcGIS Pro.The only way to get it to work again is to remove ArcGIS Pro 3.5 and install a version which does work with an older version. I came from 2021.2.6 so I know that works, but I would prefer a more recent version.So my question is
I have a Geopackage, 458.761 polygons. Using a FeatureWriter, type Geopackage, I tried to store this. Unfortunately I get this error and could not found any logic behind this one:OGCGEOPACKAGE writer: Feature type 'Road' has geometry type 'geopackage_multipolygon' and cannot accept the current feature with a geometry of type 'geopackage_multisurface'. Skipping feature FME 2025.1.2.0
Hi All,I’ve got what should be a simple issue but I’ve not been able to find and answer for my exact query.I’d like to take a feature class, containing photo attachments, stored in a file geodatabase and write it to another file geodatabase. Essentially copying the data from one file gdb to another.I’ve seen lots of posts about reading and writing as separate processes. In both instances the photo’s are imported and attached or extracted from the data.Is it possible to essentially copy a feature class with attachments between file geodatabases, without having to extract the photo attachments and then reattach them?Thanks for your time.
I am looking for guidance on how to create this interactive map.. We have FME and ArcGIS… From time to time, we are given maps and we have to change the counties based on new staff. Most of the time the counties are adjacent. Other times not. We have a shapefile of the counties. I am looking for a solution where we can select the counties in the shape file/FME and output the selection for the update query.I believe I have all the pieces Just not sure how to attach the transformers together… or what the logic is to create this… TIA (Thank you in advance)
FME Form (Workbench) 2024.1.2.1 (20240906 - Build 24624 - WIN64)Oracle Spatial Database 19.27.0 (19c) Hello!When trying to read data in from an oracle spatial database, I receive the message that FME cannot query the metadata table. It's unclear to me which metadata table the reader is trying to use. This happens both with a FeatureReader and a SQLExecutor, the behaviour is the same. When switching logging to debug, there is no further logging of the query that is being executed.2025-07-29 13:52:56| 0.3| 0.0|INFORM|ORACLE Reader: Executing SQL Statement `SELECT * FROM DINO_DBA.GDW_BLK_ARE_VW' to obtain features for feature type `'2025-07-29 13:52:56| 0.3| 0.0|WARN |Could not query Metadata table for dimension for geometry column 'GEOMETRY' of table '' -- geometry will be assumed to be 2DThe FME documentation I could find (FME Support Center: Adding metadata entries for Oracle spatial tables or views) hasn't been updated since 2015.1, and refers to MDSYS.SDO_GEOM_METADATA which i
Hi, I am trying to manipulate the dates based on the logic. If the effective date falls between 06/01/2025 - 06/31/2025, then the date of inception should be 06/01/2025 and the similar rule applies for the month of july, aug, sept.And if the effective date is anywhere between 10/01/2025 - 10/01/2026, then the date of inception should be 10/01/2025. The issue here is :If the effective date is 08/20/2026 → Inception becomes 08/01/2025 ( Expected is 10/01/2025)The similar issue is observed for months of june, july, aug, sept for year 2026. I am surprised here why FME would not pick up the year from the date
I have a point feature class at each road intersection. And have a line feature class of these roads. I would like to determine the direction each line is oriented at each intersection.For example, I have one point at a four line (4 streets) intersection. The result would show the line ID along with the 4 IDs and orientation (N S E W). Or would show an angle? Something to determine which way the line is oriented in relation to the point. Thanks for any help. Steve
When writing 3-point arcs to Oracle Spatial with a projected coordinate system, FME 2020 (64-bit) can maintain their geometries as arcs. When writing arcs to Oracle Spatial with a geographic coordinate system, however, FME strokes the arcs into lines. Is it possible to write the arcs to a geographic coordinate system without converting them to lines?
I am currently using FME 2025.1.1 (Build 25615) and have had some issues with inspector crashing. I have tried multiple different ArcGIS Online provided background maps and they seem to be causing both Data Inspector and occasionally Form (when using Data Preview) to crash. I have tried with multiple different types of data, of various feature counts, sometimes it crashes on initial load of background map, other times when it reloads it after zooming in. Wondering if anyone else has run into this?
I’ve got some JSON data where the key/value pairs are separated so the keys are in one JSON block and the values in another (see the example below). I’m using:A JSONExtractor to get the "columns" fragment and then a StringReplacer and AttributeSplitter to convert it to a list. A JSONFragmenter to convert the "values" to a list. A PythonCaller to loop through the two lists and create the attributes.Is there a way to do this without python? I’ve attached a zipped file of my workbench, Example JSON============{ "columns": [ "sub_organisation", "system_id", "type", "mounted", "location", "road_id", "offset", "side", "geometry" ], "rows": [ { "message": null, "values": [ 24, 8, "1840", "Path", 8, 997, 10.9, "L", "POINT (1748664.55420184 5427732.02625559)"
Hey,I am mega confused with something that I thought would be relatively simple. I have a Survey123 feature layer in ArcGIS Online that automatically places survey points at 0 lat 0 long (west coast of Africa). What I would like to do is read the Survey layer into FME, geocode the data via an address attribute, and then write back the geometry updates to the layer without altering the attribute table at all. I can do all of that fine except for the final Write/update operation.I have confirmed that the layer in AGOL is editable and allows for Updates (attributes and geometry). I have the correct AGOL permissions to do these edits. In the parameters for my AGOL Writer, I have the Layer settings as: Update, Use Existing, Update Spatial Column = Yes. The operation completes successfully, but then when I check AGOL it appears that the layer’s geometry has disappeared. The table attributes are there, but no geometry is present.I can also see that AGOL recognizes some change to the data sinc