Using readers and writers to extract and load data.
Recently active
Hello everyone,I am a beginner with CityGML and am currently trying to convert a dataset to CityGML 3 with generics extensions using FME Workbench. However, I am encountering a couple of issues:Warning about inheritance relationship: The output gives a warning indicating no inheritance relationship. I have used AttributeMerge to add gml_parent_id, but the system does not seem to recognize it.<GML_2 Writer> - '12482' orphaned features found, XML comments representing these features will be present in the output file: <!-- orphaned feature - parent id:'...', id:'...', type:'...' -->Geometry export issue: It does not export correctly after setting up the geometry. In the Inspector, the data appears as a table without geometry.Additionally, the original dataset exchenged in CityGML 3 standard, and its geometry's encoding is Name (encoded: UTF-16LE). Could this encoding be affecting the process?My settings and the transformer export are shown below.
Hi. I have created contour lines from DEM rasters and I’m getting outliers (straight lines to random points). What is the best way for me to remove these lines?
Currently I am working on writing to an IFC-file. One of the classes I would like to write is IfcZone. However, when I try to do that, I get the warning: IFC: Unable to write objects of type 'IfcZone'Now I am wondering whether I did something wrong and I am missing some settings or whether FME does not (yet) support writing to IfcZone?@DaveAtSafe
Good morning everyone.I am working with a text type file that I take as an example for cadastral constructions.This text file has a specific structure but a variable number of lines depending on the number of heights of the buildings and the number of premises in each height.I use the file to:Know the name of the floor, for example “Basement”, “Floor 00”, “Floor 1”, etc. Know the number of heights it represents, that is, I do not have to draw floor 02 if it is the same as floor 01.This plant name and the number of heights it represents are related to a DXF file that I am not using at the moment.The first line that I need to read in any file is 27 where the number of heights of the building is expressed, this line number is fixed; and for each of the plants I find the following structure. “23” (Number of total heights of the building” (line 27 of the file)“01” (Number of heights that the drawing represents) (line 28 of the file)“SOTANO -2” (Floor name) (line 29 of the file)“95” (Number
Hi all,I am trying to read a json file, that contains a collection of objects. It is NOT an array, and the objects have no name, they have just a number. It’s that number I am interested in, but I can’t seem to find a way to get it exposed. My Json looks like this:{ "1": { "name": "msg_status", "data": { <snip> }, "port": 4, "timestamp": 1717497996, "timestamp_parsed": "2024-06-04 12:46:36" }, "2": { "name": "msg_ublox_location", "data": { <snip> }, "port": 2, "timestamp": 1717498735, "timestamp_parsed": "2024-06-04 12:58:55" }, "3": { "name": "msg_ublox_location_short", "data": { <snip> }, "port": 13, "timestamp": 1717498741, "timestamp_parsed": "2024-06-04 12:59:01" }, "4": { "name": "msg_ublox_location", "data": { <snip> }, "port": 2, "timestamp": 1717499651, "timestamp_parsed": "2024-06-04 13:14:11" }}and so on, for a couple of thousand objects per file. The d
I’m unable to establish a connection to SDE after recently receiving a permanent license file from Safe. I’ve tried connecting using several methods: connection files stored in 'C:\Users\AppData\Roaming\Esri\Desktop10.8\ArcCatalog\’, connection file stored on a network directory; and typing in the database credentials. I was able to successfully use the same connection files while using the temporary license file provided and am not aware of any other changes in our IT environment. I’ve also tried (unsuccessfully) to connect to other SQL databases in our Data Warehouse (outside the GIS environment) that contain tabular data and receive the same error message (shown in red below) which appears after selecting the ‘...’ under “Tables” in the Esri Geodatabase (ArcSDE Geodb) Parameters dialog box that normally opens the list of feature classes/tables that can be added to the workspace.‘Failed to retrieve feature types. An error occurred while attempting to retrieve the connection paramet
In FME 2024, i have feature caching enabled but when I run the workspace, I cannot see more than 100 records at any transformer in the workspace. And if I try to sort them in asc or desc order by clicking on any column, nothing is displayed.
I want to implement referencing geometries of spaces and space boundaries using XLink:href. I found this solution (https://hub.safe.com/publishers/con-terra/templates/citygml-create-building-lod-2-using-xlinks). This solution works very well for CityGML 2, but I couldn't implement it for CityGML 3.0 using the GML writer. I changed the transformers and tried different approaches (considering the "boundary" relation in CityGML 3.0), none of them worked! I will appreciate any help and suggestion 🙂
Hi,I have a .add file that I just could open it as a text file in FME. Do you know anyway to read this file as CSV? Or a way to replace all spaces with one space?There are irregular spaces between them, and when I open it as a CSV, it is not a helpful file.I tried to use SrtingReplacer to replace many spaces with one space, but there are many different numbers of spaces in each attribute.Thank you for your assistance.
FME Workbench ver. 2021.2.3, build 21812FME Server ver. 2021.2.3, build 21812Hi Everybody.Sorry for my Canadian French, I try to be correct as much as possible in English, you may notice some errors on my part.Yes, I know, we should migrate to FME Form/FME Flow. The steps have been initiated with our supplier but we must wait until the migration from ESRI ArcGIS Desktop 10.8.1 to the ESRI Enterprise 10.9.1 version is completed. Premises:We maintain data that we share on a feature service hosted on ArcGIS Online with a subcontractor (different types, SQL Server, GDB and Shapefiles); The address of the feature service must remain constant for the processing of our subcontractor; The initial creation of the feature service goes correctly (an FME Workspace process launched manually for creation; We must replicate the update autonomously on our FME Server (same version as the FME Workbench, 2023.2.3, build 21812) so that the data is up to date over a 72-hour period.The update workspace fail
I need to set up a workspace to write a file directly into a specific Feature dataset within an ESRI File Geodatabase - is there any way I can set this up.
HiI got an ZFS Pointcloud (here) with integrated RGB colors. These are greytones (concrete) and visible in Autodesk Recap. From Recap i can export the PointClound to an e47 file and the colors are still included.But i got over 1’000 files, so I want to convert them with FME. With the ZFS Reader i can load the PointClound, filter it with the header information as decribed in the help (reflection), but the color is missing. Regarding the help, FME can read the color from an color file, linked in one of the header information, but I got no such files, the colors are integrated. How can I get access to these RGB values (color_red, color_green, color_blue)?
Hi everybody,I have a map with 'Layer A' (polygons district boundary) and 'Layer B' (lines roads).I would like to add a field on my 'Layer B' table with the name of every district crossed by each road.In this example, I would like my Road 1 attribute to tell me it crosses 'City A', 'City B', 'City C', and 'City D'. And my road 2 attribute to tell me it crosses ‘City A’.Could you please show me how to make it? Thank you
Hi, How can I shorten a line by 10 cm on both sides?
Getting the below error when trying to write the IFMEMultiSolid to Multipatch. I’ve tried to deaggregate the geometry but that didn’t work.The 'HAS_Z_VALUES' keyword is set to 'AUTO_DETECT'. With the exception of MultiPatch feature classes, the dimensionality of new feature classes will be based on the first feature written to the feature class. (Features with no geometry are considered 2D)A default z-value of '0' will be used for all 3D features where z-values are not providedEsri Geodatabase Writer: Not simplifying geometries being writtenTransactions are being used by the Esri Geodatabase WriterEsri Geodatabase Writer: The field 'OBJECTID' in table 'Dissolved123' will not be updated since it is not editableProcessing on a solid has failed. The solid may be too complex, not closed, or not orientable.Esri Geodatabase Writer: Failed to write geometry to MultiPatch feature class `Dissolved123' +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Feature Type: `Diss
Hi, I am trying to do check if data is correct in one of my tables compared to another one. To do that, I thought about merging/joining the two tables based on columns and conditions. The common column between the two tables is the City Code (postcode). Then I need to compare landmark values, which represent the location of objects in space. I managed to join them based on the City Code column but I don’t manage to do the landmark values comparison yet. More context:My actual data is fields of grass along roads. Each section of road belongs to a city (City Code) and is separated into categories of landmarks. For example a road within city 1 is separated into groups of landmarks ranging from 1 to 1.5; 2 to 3; etc.; and the field X is situated at a specific landmark value 2.5.So the field should be in the landmark range 2 to 3 because its landmark value is higher than 2. The tables: The first table has 3 columns and links city code and landmarks to a unique ID: City code: the city pos
Hello FME community,When creating a DWG file I would like to write some attributes to it. It is important that the written attributes appear in the properties of the object.The following picture shows more precisely what I mean. I want Attribute 1 and Attribute 2 to be appended to the DWG file.Does anyone know how I can attach attributes to the DWG file.Thank you
Hello , I would like to generate constant unique id for lots of points or lines that has not get the id yet and keep the same constant unique for each time running FME (no change)i do not want any changing of id for each running Fme .lines or points should get constant unique id and after one month when I run Fme workspace and there are new lines or points .FME should provide the same constant unique id for old points or lines that provided them before and provide new constant unique id for new lines or points .The problem I am generating points that they are not exist before at GIS data and I am not able to save the points with id in Gis database but I want to keep the id for each point without changing in Fme thanks in advance fme 2021
Hi, I want to find duplicate addresses in the data based on duplicate address numbers.The way that I found in ArcGIS Pro is using spatial join of the layer with itself using attribute matching “address number”. This way if a point has a duplicate with the same address number in the same location, is joining with the point with the same address number and if a join count is more than 1 display, there is a duplicate. I am looking for a way to do the same step in FME. I used SpatialFilter but did not get a result. I really appreciate any suggestion for doing this analysis.Also, in ArcGIS Pro, it is possible to join spatially "within a distance". Is this option available in FME?
Hello ,i have self intersection at specific line .but Geometry validator did not catch it .I have read at other article that it is better to use chopper vertex 2 and snapper segment to let geometry validator to detect self intersection issue ?I have tried it but it does not work .is there other suggestion that I have to try ?FME 2021thanks in advance .
Hello FME members,I have an IFC file with no coordinate information in the site feature.it is a 3dObject of a parcel that is supposed to represent the surface - but it is just a (3dObject) flat surface with an extrusion of 1]What I have done: I have at least 4 coordinates to transform, I tried to use:the 3daffinewarper, but the transformer showed me an error [because the transformation from 0,0,0 to x,x,444.1 is coplanar - and I only have 4 known points that went from z:1 to z:443] (I also tried 0,0,1 to x,x,444.1, but it didn't work) so I used the affinewraper to send the surface to the correct coordinate system)that worked!i need to know how to get the 3d object to the correct z value to display the surface (3d object) at the correct height.I hope someone can help me.Greetings Michael
Hi,I have a dataset with Centerlines shown in blue, some lines contain too much detail which is not accepted as input for the LineDivider I use in the downstream pipeline.Is there a way I can smooth the blue centerline into something like the red line shown on the right?The Generalizer should be the way to go I guess but did not find the right settings yet.
Has anyone successfully created a workspace that can convert Ordnance Survey MasterMap data to dwg format? I understand the process would be quite complex, but it would be good to get an idea of what’s involved from anyone who may have done this.
I'm creating a new excel file nightly and some nights there will be no data to populate the excel file, but I need the file to be created anyways. Is there a step in the Excel writer that I'm missing to do this?
Hi,I'm using a FeatureWriter to insert data into a PostgreSQL database. When certain features can't be converted into the desired data types, FME drops them without terminating the translation.The logger gives a message in blue:"Value of attribute 'test' could not be converted to type 'bool'. Feature will be logged and skipped" However, the issue lies in trying to capture this scenario and terminate the translation.Despite dropping some features, the FeatureWriter when outputting the summary feature still contains the FULL COUNT against the '_total_features_written' attribute. I was intending on comparing this number to a count of incoming features to check for a difference. Now the only other way I can think of is querying the database immediately after and getting the written feature count that way. I guess I have two questions:1. Is there an inbuilt way to halt the translation when a feature is dropped like this?2. Is the _total_features_wri