Using readers and writers to extract and load data.
Recently active
Hello experts,My question is simple.when using the Directory and File Pathnames to access a directory, can I then read files from that directory?I would like to be able to view and query the data in those 1042 filepaths passing the testfilter.see my current workbench: any help would be much appreciated,thank you.fb
Hello all, I am a beginner with CityGML and am currently trying to convert a dataset to CityGML 3 with generics extensions using FME Workbench.I re-organized the features in TrafficArea and added some new generic attributes. Then, I want to map these new features back to TrafficSpace to build the child-parent relation. But I always failed. I am not sure whether I used the wrong way to create the new TrafficSpace, and I didn’t find the tutorial online either. My workflow for the TrafficSpace is shown below. I extracted the boundaries from the TrafficArea and set them with lod2MultiCurve as the TrafficSpace back. Welcome for any suggestions or assistance! Thank you very much.
Hello togetherI am currently working with two watercourse datasets from different sources, which unfortunately do not take the same course depending on the region, although in reality there is clearly only one watercourse. For this reason, I would like to merge the datasets or assign the attributes of one dataset to the line segment of the nearest neighbour of the other dataset.I've already tried a bit myself in ArcGIS Pro, but haven't come up with a clever solution. Do any of you have an idea for this?Thanks in advance for an answerBest regardsDani
I have one FME workbench running on application server to export all the GIS sql tables into MapInfo tab files. It was running fine before but recently failed a couple times, its failed to export tab files after running 50 minutes or so, and each time its failed at export different sql table. I checked disk space and sql tables and they are fine to me. Any suggestions are greatly appreciated, the log file is attached.
HiI need to update several Excel files within a zip file. I have contacted support and they have created a problem report for the development team (FMEENGINE-83267, I have reproduced the problem with updating multiple Excel files within a zip file). FME Form 2023.2.1.0Build number: Build 23774Meanwhile I need a work around, any ideas?BrFelipe Verdú
I’m trying to load a csv that is saved in sharepoint. I want to convert this to Excel as well as process the data and export to other formats. I can access the data in a browser. Nothing is returned by the httpCaller or the SharePointOnlineConnector.
Good Day everyoneI have some difficulties reading an ifc file. There is an IfcBuildingPartElement that is apparently ‘too’ complex to read. When excluding Geometry from the FeatureReader running it is successful, but as I am trying to analyse the Geometry, it is kind of needed to include it whilst reading. The Error message does not tell me which of the objects it read failed, which makes it hard to figure out how to bypass the geometry. Does anybody have any solutions how to get it to skip/process the complex pieces? I have tried to ‘Continue Translation’ for Rejected Feature Handling, no luck FME Workbench Message:Processing on a solid has failed. The solid may be too complex, not closed, or not orientable. Feature Reader Settings: CheersFred
Hello,Currently, I have a process where I am doing a PointOnAreaOverlayer. I then create about 23 List Attributes. As of now, I have 23 List Summers to achieve my requirements. I then port all the List Summers into one Attribute Manager, remove all the non-summed fields, aggregate all the points grouped by the Primary Key, and then I join that back to the area layer so that it holds the summed values and stays an FMEPolygon and not a MultiFMEPolygon.Is there a way to do this “better”? I have to redo this process on another Polygon Feature Type and it’s cumbersome. Kind Regards,Senad
Note: I already solved this issue by forcing everything in “MGA2020-55_FME”, however the way FME writer handles GDA2020 data seems strange.I am trying to update an “EPSG7855” table from SQL to an “EPSG7855” feature service in ArcGIS Online. After checking the log, FME seems do not think EPSG7855 is GDA2020 Zone 55 and trying to reproject the data. Which cause the GDA2020Zone55 layer not align with GDA2020 Zone 55 basemap. Log: 2024-06-20 09:27:58| 0.9| 0.1|INFORM|The ESRIWKID number of the FME coordinate system 'MGA2020-55_FME' is '7855'2024-06-20 09:27:58| 0.9| 0.0|INFORM|ArcGIS Online Feature Service Writer: Requesting metadata for Feature Service at 'https://services-ap1.arcgis.com/w6r4Ll*/arcgis/rest/services/Property/FeatureServer'2024-06-20 09:27:58| 0.9| 0.0|INFORM|ArcGIS Online Feature Service Writer: Found layer/table 'property_view' with ID 4 for feature type 'property_view'2024-06-20 09:27:58| 0.9| 0.0|INFORM|ArcGIS Online Feature Service Writer: Requesting me
Hi everyone,I give you my work on the transformation of Runway from AIXM 4.5 reader to AIXM 5.1 writer.All seems to be fine with the structure but when i try to add some annotations to keep the <txtRmk> attribute inside an <aixm:annotation>, i didn’t suceed to keep the structure complete.When the branch is disabled, it’s fine. When the branch is enabled, all is going wrong.Could you please have a look and please give me your feedback.For the FME documentation team https://support.safe.com/hc/en-us/profiles/17698677148429-Liz-Sanderson: the workbench given on this page : AIXM 4.5 and 5.1 Reading, Writing and Validation - EU Airports Demo – FME Support Center (safe.com) doesn’t work with FME 2024. My workbench seems to be good except the annotations branch and i’m glad to help you in the way to update your workbench.Nice week-end
Hello everyone Im playing around with FME FLOW and uploaded my workspace. The workspace is running well with several parameters and writing me an OBJ file into my ressources and finally writing an HTML file (which opens a 3dviewer which opens the OBJ file).When im running the workspace in FME FLOW i choose datastreaming Service, and after success it opens the HTML file in my Browser.When i create a WebApp it is also running well and in the end opening the HTML file and showing the OBJ in the 3DViewer.But since the WebApp is quite limited with layout etc. i created an easy HTML Website on my Server. Here i added a send request with the webhook url of that workspace and the get method.And actually it is running, but after success its giving me a link to download a zip with the HTML and OBJ file.To me it seems because im using the Get method, it is just putting all the results into that zip to download. I tried a bit around and also searched in forum but didnt find an answer.Am i missing
SpatialFilter gives more intersections than expected, any clue?For a parcel I want to compute the area covered by buildings on that parcel. The start situation, with one parcel and some buildings. My next plan was to use a SpatialRelator to create a list of buildings located at the yellow parcel.I tested this approach using a SpatialFilter first to see whether the intersect function works. I expected to get back only the 2 red buildings within the parcel polygon. However, I got this:A subpolygon of one the buildings is also selected. Did I something wrong?My settings of the SpatialFilter:Any ideas how to solve this? I tried other Predicates to test as well but so far no success.
Hello everyone,I am a beginner with CityGML and am currently trying to convert a dataset to CityGML 3 with generics extensions using FME Workbench. However, I am encountering a couple of issues:Warning about inheritance relationship: The output gives a warning indicating no inheritance relationship. I have used AttributeMerge to add gml_parent_id, but the system does not seem to recognize it.<GML_2 Writer> - '12482' orphaned features found, XML comments representing these features will be present in the output file: <!-- orphaned feature - parent id:'...', id:'...', type:'...' -->Geometry export issue: It does not export correctly after setting up the geometry. In the Inspector, the data appears as a table without geometry.Additionally, the original dataset exchenged in CityGML 3 standard, and its geometry's encoding is Name (encoded: UTF-16LE). Could this encoding be affecting the process?My settings and the transformer export are shown below.
Hi. I have created contour lines from DEM rasters and I’m getting outliers (straight lines to random points). What is the best way for me to remove these lines?
Currently I am working on writing to an IFC-file. One of the classes I would like to write is IfcZone. However, when I try to do that, I get the warning: IFC: Unable to write objects of type 'IfcZone'Now I am wondering whether I did something wrong and I am missing some settings or whether FME does not (yet) support writing to IfcZone?@DaveAtSafe
Good morning everyone.I am working with a text type file that I take as an example for cadastral constructions.This text file has a specific structure but a variable number of lines depending on the number of heights of the buildings and the number of premises in each height.I use the file to:Know the name of the floor, for example “Basement”, “Floor 00”, “Floor 1”, etc. Know the number of heights it represents, that is, I do not have to draw floor 02 if it is the same as floor 01.This plant name and the number of heights it represents are related to a DXF file that I am not using at the moment.The first line that I need to read in any file is 27 where the number of heights of the building is expressed, this line number is fixed; and for each of the plants I find the following structure. “23” (Number of total heights of the building” (line 27 of the file)“01” (Number of heights that the drawing represents) (line 28 of the file)“SOTANO -2” (Floor name) (line 29 of the file)“95” (Number
Hi all,I am trying to read a json file, that contains a collection of objects. It is NOT an array, and the objects have no name, they have just a number. It’s that number I am interested in, but I can’t seem to find a way to get it exposed. My Json looks like this:{ "1": { "name": "msg_status", "data": { <snip> }, "port": 4, "timestamp": 1717497996, "timestamp_parsed": "2024-06-04 12:46:36" }, "2": { "name": "msg_ublox_location", "data": { <snip> }, "port": 2, "timestamp": 1717498735, "timestamp_parsed": "2024-06-04 12:58:55" }, "3": { "name": "msg_ublox_location_short", "data": { <snip> }, "port": 13, "timestamp": 1717498741, "timestamp_parsed": "2024-06-04 12:59:01" }, "4": { "name": "msg_ublox_location", "data": { <snip> }, "port": 2, "timestamp": 1717499651, "timestamp_parsed": "2024-06-04 13:14:11" }}and so on, for a couple of thousand objects per file. The d
I’m unable to establish a connection to SDE after recently receiving a permanent license file from Safe. I’ve tried connecting using several methods: connection files stored in 'C:\Users\AppData\Roaming\Esri\Desktop10.8\ArcCatalog\’, connection file stored on a network directory; and typing in the database credentials. I was able to successfully use the same connection files while using the temporary license file provided and am not aware of any other changes in our IT environment. I’ve also tried (unsuccessfully) to connect to other SQL databases in our Data Warehouse (outside the GIS environment) that contain tabular data and receive the same error message (shown in red below) which appears after selecting the ‘...’ under “Tables” in the Esri Geodatabase (ArcSDE Geodb) Parameters dialog box that normally opens the list of feature classes/tables that can be added to the workspace.‘Failed to retrieve feature types. An error occurred while attempting to retrieve the connection paramet
In FME 2024, i have feature caching enabled but when I run the workspace, I cannot see more than 100 records at any transformer in the workspace. And if I try to sort them in asc or desc order by clicking on any column, nothing is displayed.
I want to implement referencing geometries of spaces and space boundaries using XLink:href. I found this solution (https://hub.safe.com/publishers/con-terra/templates/citygml-create-building-lod-2-using-xlinks). This solution works very well for CityGML 2, but I couldn't implement it for CityGML 3.0 using the GML writer. I changed the transformers and tried different approaches (considering the "boundary" relation in CityGML 3.0), none of them worked! I will appreciate any help and suggestion 🙂
Hi,I have a .add file that I just could open it as a text file in FME. Do you know anyway to read this file as CSV? Or a way to replace all spaces with one space?There are irregular spaces between them, and when I open it as a CSV, it is not a helpful file.I tried to use SrtingReplacer to replace many spaces with one space, but there are many different numbers of spaces in each attribute.Thank you for your assistance.
FME Workbench ver. 2021.2.3, build 21812FME Server ver. 2021.2.3, build 21812Hi Everybody.Sorry for my Canadian French, I try to be correct as much as possible in English, you may notice some errors on my part.Yes, I know, we should migrate to FME Form/FME Flow. The steps have been initiated with our supplier but we must wait until the migration from ESRI ArcGIS Desktop 10.8.1 to the ESRI Enterprise 10.9.1 version is completed. Premises:We maintain data that we share on a feature service hosted on ArcGIS Online with a subcontractor (different types, SQL Server, GDB and Shapefiles); The address of the feature service must remain constant for the processing of our subcontractor; The initial creation of the feature service goes correctly (an FME Workspace process launched manually for creation; We must replicate the update autonomously on our FME Server (same version as the FME Workbench, 2023.2.3, build 21812) so that the data is up to date over a 72-hour period.The update workspace fail
I need to set up a workspace to write a file directly into a specific Feature dataset within an ESRI File Geodatabase - is there any way I can set this up.
HiI got an ZFS Pointcloud (here) with integrated RGB colors. These are greytones (concrete) and visible in Autodesk Recap. From Recap i can export the PointClound to an e47 file and the colors are still included.But i got over 1’000 files, so I want to convert them with FME. With the ZFS Reader i can load the PointClound, filter it with the header information as decribed in the help (reflection), but the color is missing. Regarding the help, FME can read the color from an color file, linked in one of the header information, but I got no such files, the colors are integrated. How can I get access to these RGB values (color_red, color_green, color_blue)?
Hi everybody,I have a map with 'Layer A' (polygons district boundary) and 'Layer B' (lines roads).I would like to add a field on my 'Layer B' table with the name of every district crossed by each road.In this example, I would like my Road 1 attribute to tell me it crosses 'City A', 'City B', 'City C', and 'City D'. And my road 2 attribute to tell me it crosses ‘City A’.Could you please show me how to make it? Thank you