Using readers and writers to extract and load data.
Recently active
Hi, I have some 3D fencing data in IFC format and I want to work out the height of the objects. I been x,y,z co-ordinates and the ‘Bounds Extractor’. However, due to the data being long linear features and thus the underlying height of the ground negatively affecting the height. I get strange results (as fencing goes up and down underlying elevations).I think the only method is to take cross sections of the fencing and work out the distance (height) between the highest and lowest z value from the cross section. However, this seems difficult to do. Any ideas? ta
FME Form Version: FME(R) 2024.2.0.0 (20241102 - Build 24783 - WIN64FME Flow: 2024.2.1 Build 24801 - win64 I have created a bunch of User parameter type: Groups Box in a skript. Within those Group box are a bunch of parameter type: yes/no. These parameters are used in an FME Flow APP. However. They’re not working as I want them to work. When a Group box is unchecked in the FME Flow APP then I want all the layers inside the group box to get unchecked.However in FME APP, it doesnt do that. Please see picture below attached to this question. All the layers inside the Group Box (byggnadsdelar) are still checked. What am I doing wrong?Please see my konfiguration for the group box parameter and the yes/no parameters inside Group Box.
Is there a method to import CAD graphic elements, line, Arcs, etc. with the geometric attributes readable by Arc map such as Radius of arcs, bearings of lines. When I import CAD graphics, I get polylines, but they do not really have readable geometry like Line Length, Arc Radius, Line Bearing etc. I would like to import CAD graphics like road centerline geometry and have the geometric data in a Table like format, similar to the old COGO formats.
I have a list of client records with a start-date and an end-date. In some cases there are multiple lines for a client, identical except for start-date and end-date. I need to somehow either concatenate them into one client record which contains the minimum start-date and the maximum end-date from each of those client’s records, or create a new client record for each client with the minimum start-date and the maximum end-date. All other data can be discarded in the process.For example, I start with:JohnDoe, startdate: 1 Jan 2024, enddate: 1 August 2024JohnDoe, startdate: 3 Mar 2024, enddate: 31 August 2024JohnDoe, startdate: 3 Mar 2024, enddate: 15 Dec 2024DavidSmith, startdate: 1 Feb 2024, enddate: 15 Oct 2024DavidSmith, startdate: 3 Mar 2024, enddate: 18 Oct 2024 And I want to end up with:JohnDoe, startdate_min: 1 Jan 2024, enddate_max: 15 Dec 2024DavidSmith, startdate_min: 1 Feb 2024, enddate_max: 18 Oct 2024 I have managed to create a really intricate and clunky solution which kind
Good evening,I am wondering what the community thinks about this situation:FME Form 2024.1.3.0 (20240927 - Build 24627)Writing to Esri Enterprise Geodatabase (SDE) 10.9.1 - MS SQL Server 2022I have almost 700,000 records that need to be written out to our SDE into 1 feature class.Currently I have 1 Writer using the Esri Geodatabase (ArcSDE Geodb) format.The 1st attempt to write the data failed after 22 hours because I had a loc on the destination feature dataset. doh!On the 2nd attempt to write the data to the SDE, the job has been running for 12 hours. I cancelled the job, and below are snippets from the logfile highlighting how many records have been written, and how much time passed. This shows a pattern that: as time progresses, the processing time is becoming exponentially longer. I am thinking of breaking the data into 100,000 chunks, with the first chunk first truncating the table and then loading, and the sequential chunks appending to the table.Is this performance hit expe
I am trying to validate some properties of objects in DWG files, and some of the things I’d like to check require me to know what paper space viewport an object is visible through, but I have been unable to get the autocad_viewport_handle attribute to show up.I’ve tried a few combinations of reader parameters, including checking all boxes in the “Model and Paper Space Options” section, unchecking some options while leaving “Read Model Space Entities Through Viewports” checked, and tried reading multiple DWGs, but so far I have not had any luck. I am thinking this must be a “me” problem, but I’m kind of at a loss. Is there a certain set of parameter settings required to get autocad_viewport_handle to show up? I am setting the reader to expose the attribute, but so far, it is always missing. I’m using FME 2025.0.
Hi all,I hope all is well! I am very new to FME and data products.We use FME 2022.2 but we thought it will be time to upgrade to the latest version to benefit from the updates.I have installed 2025.1 and the first thing that I can see is the reader format has changed I would use “Microsoft SQL Server Spatial” in 2022 but in 2025 it is “Microsoft SQL Server (MSSQL)”I would assume they have aggregated both non-spatial and spatial into one reader format.I go to add the connection that we normally use - in this case it is called GisAzureView which is a hosted server for us. I would then need to select which tables I would like to read from but I get this error: 2025.1 Error when reading hosted SQL database“Failed to obtain any schemas from reader 'SQLSERVER' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information” - is the error that comes up - so it is failing to open the reader
I’ve been needing to identify leading and trailing spaces across many attributes, with a significant number of features. I don’t need to trim them, but rather identify their existence.The only solution I’ve been able to come up with so far is to use AttributeValidators - this way, I can set it to run against the 50 or so fields that need to be validated. I’m using Regex and the rule “^ +” for leading spaces, and a second AttributeValidator with the rule “ +$” (double quotation marks only for readability here, not used in the Rule Configuration) for trailing spaces.This works, but it is very slow. Is there a better way to do this within FME, without resorting to some Python?Thanks in advance for any thoughts on alternative approaches!
Is FME able to read the MicroStation DGN file geographical coordinate and use this information when creating esri geodatabase features? I see several tutorials and methods that seem to suggest CAD data such as DGN (MicroStation Design Files) do not contain geographic Coordinate systems but is not totally true. Design files do or can have coordinate systems, and most do when relative to Transportation Civil Engineering Design.
HiI have a a workflow exracting data from an API. I have got almsot everything I need from the JSON but need to get as single description field. The JSON structures breaks the description into sever parts all nested within the description part. The number of parts varies by feature.I essentially need all the text elements in the image below When I use a JSON exposer it asks me to specificy each indexed element, but I do not know how many there will be in any given feature I imagine there is something really obvious I am missing hereClosest I have got is adding another JSON extractor using the query:json["fields"]["description"]["content"][*] is giving me:{"type":"paragraph","content":[{"type":"text","text":"This Jira ticket is for all activities related to the implementation of 365 – "},{"type":"text","text":"Office.com","marks":[{"type":"link","attrs":{"href":"http://Office.com"}}]},{"type":"text","text":" rollout."}]}Or using:json["fields"]["description"]["content"][*]["content"][*
I have two tables where I have to compare rows against columns. First table (excel) contain Analytes as columns, but the second table (sql) has analyte column which contains all the analytes as values. I have to compare the values from the Excel table (which has analytes as columns) with the corresponding limits from second table.Example of first table:Example of second table: I have tried couple of methods such as attributepivoter ,doing it via the pythoncaller but was not successful
Hi FME users,I am creating an automatic workflow to download GTFS (Transport Data) by HTTP caller. The zip file contains few CSV files which I need to read them separately for my workspace. The issue is I cannot reach each file through the zip folder by using Feature Reader. I want to avoid unzipping manually as I want to create an automatic workspace. Can you please advise on how to solve this issue? Appreciate your help.
Hi,I've been trying too use autocad_xref_path and autocad_xref_name to insert file (another dwg) into REALDWG writer feature type. It should be basic. But it's not working. No warnings, no errors.Did anyone succesfully managed to do that? Can you explain me what am I doing wrongRegards,Želimir
Hi, Has anyone had any issues placing in 3D symbols via cell file into FME DGN styler? It seems as soon as a solid or surface is involved the symbol dies not show correctly i.e these elements are missing. any advice thanks?
Hi,HELP. experiencing issues with cells in dgn styler.Can FME dgn v8 writer output solids? I am using dgn styler to input graphic cells from .cel file but seems like data is lost on output. When lines are used within the .cel file lines change colour within the output also. Please advise. I read about named and unnamed cells what is the difference? When I add the cel file to dgn writer elements go missing and colour of symbol is altered! In the writer I am using v8 seed file as provided in fme install. Am I missing anything had anyone wise have cell dgn styler experience?
I am trying to set the annotation scale options for a block in CAD but I cannot seem to find the proper attribute or setting. I want to be able to set the available annotative scales similar to how its done for text below in the DWG styler. I want to have these scales preloaded for my block as seen below.
Is it possible to generate a separate log file or configure the existing log file to display metadata for the reconciliation purposes. The field that I am looking to display is the feature count in input file, feature count in both output file, who executed the workspace with timestamp, the amount field totals in the input file and the amount field totals in the 2 output files ( I have a workspace where there is 1 input file and 2 output files) . Also I have noticed that FME overwrites to the same log file every time the workspace is executed, is it possible to create a unique log file at every run? Thank you for the support.
Hi, Has anyone went through issue with the Value doesn't fall within the Domain” in a File Geodatabase ?Even though the description is already there See screenshotI am currently dealing with it and it is a lot of work…Is there a workaround to fix the error ?The reason I am asking is because I have to go back to the Recreation.gov website and re-do again and reviw to ensure I choose the right one.I am using ArcGIS Pro 3.3.6 in a Citrix envirnoment
Earlier I asked about writing out DGN files with coordinate system.That's apparently not possible until now. But I would like to know how I can use seed files to get at least the symbology of a seed file into the DGNV8 writer. I referenced the seed file in the settings part of the DGNV8I reference a cell file in the settings as well I read my data in, define the level names in an AttributeManager based on the input data, use the PROJReprojector, to adjust the input data to the coordinate system of the seed file, and connect to a dynamic DGNV8 writer. In the DGNV8 writer I am missing the possibility to state that colour, style and weight will be used on the level, and not the individual object in the level. The level and level overrides section in the writer I cannot understand. My output dgn consists of multiple levels, yet the settings seem to point at one level only.Hence, I do not know how to configure the writer correctly.Leaving the level settings part undefined, but setting
Hi all,I’m trying to read a shapefile that is stored inside a ZIP file which itself is embedded inside another ZIP. I want FME to read it directly from the download URLI tried with https://url/data.zip[shp.zip] but did’nt work. any idea if its possible?Thanks
Hi Everyone,I’m new to FME. Currently, I use FME to convert IFC4 LOD 300 to CityGML 2.0 LOD 4. It happened that a long railing can make the size of one CityGML feature exceed 1 GB, and it’s challenging to import it into 3DCityDB. I have to divide the railing into pieces so that each CityGML feature won’t exceed 200 MB. As shown, the railing has 1270 parts of MultiSurface. I’m thinking of splitting it into 1270 CityGML objects.First, I tried the “Deaggregator” transformer. But when it is written to CityGML with other feature types, the divided geometry cannot be viewed. The file size is small, so I believe the divided geometry wasn’t written into the CityGML file. However, if I only convert the divided geometry into the CityGML file. The file size is 1.4GB, and it can be viewed in FME Data Inspector. Here is the screen capture of my workbench.I have no idea what was wrong. I was thinking it could be due to the geometry structure being changed. Originally, it was Geometry->MultiSurfac
Would be great to be about to output Dynamic blocks to AutoCAD, things likeVisible states and Flip setting would be great, Distances for stretch, rotation and Alignment parameters might be a bit harder to achieve.
I am trying to read in non-spatial data from Microsoft SQL Server. I need to read in three Tables and three derived Views. I have set up a connection using the Microsoft SQL Server Spatial (JDBC) format, and I have the connection to the main folder in the database working fine. In the Parameters > Constraints, I am only offered the option of ‘Tables’, and this does allow me to read in the three tables in the database perfectly. However I cannot find a way to access the Views which are in a different folder in SQL. Is Reader limited to just reading Tables? The FME documentation says “The Microsoft SQL Server Spatial (JDBC) reader and writer modules provide FME with access to spatial and attribute data held in Microsoft SQL Server database tables.” - with ‘tables'; being specifically mentioned, rather than all folders within a database.Is there another way of reading in Views? Or do I need to go back to the database creator and get him to do something else.
We recently migrated to FME 2025.1.2 / ArcGIS Pro 3.5.3Now I need to update some records in a point featureclass in SDE so I created a new workspace with a Creator, a FeatureReader, an AttributeCreator and a FeatureWriter.Reading the data from SDE works as expected. But when I try to write the data, I get the following errors:2025-10-22 13:12:21| 2.0| 0.0|ERROR |Esri Geodatabase Writer: Feature Type Definition 'd_y_n' was requested, but not defined. Please visit https://www.safe.com/support2025-10-22 13:12:21| 2.0| 0.0|ERROR |GEODATABASE_SDE writer: An error has occurred. Check the logfile above for detailsNot writing anything dynamic. Just point to the correct featureclass and go.I think I’m now pretty much out of options, because I upgraded my ArcGIS Pro.The only way to get it to work again is to remove ArcGIS Pro 3.5 and install a version which does work with an older version. I came from 2021.2.6 so I know that works, but I would prefer a more recent version.So my question is
I have a Geopackage, 458.761 polygons. Using a FeatureWriter, type Geopackage, I tried to store this. Unfortunately I get this error and could not found any logic behind this one:OGCGEOPACKAGE writer: Feature type 'Road' has geometry type 'geopackage_multipolygon' and cannot accept the current feature with a geometry of type 'geopackage_multisurface'. Skipping feature FME 2025.1.2.0