Using readers and writers to extract and load data.
Recently active
Hi guys,is it possible to compare two filegeodatabases in FME? In each fgdb are 443 feature classes (points, lines and area feature classes). After some testing with the first vesion of the fgdb, we had to update the fgdb in some feature classes and changed some attribute fields and add some new domains and values. Is there any transformer which can show me the differences between both fgdb’s?Thanks for answering in advance.Cheers,Fabian
I'm using a FeatureReader to read a wfs service and getting strange failures.The following error is being loggedHTTP transfer error: 'Failure when receiving data from the peer'XML Parser error: 'Error in input dataset:'https://data.linz.govt.nz:443/services;key=xxxxxxxxxxxxxx/wfs/layer-53382?SERVICE=WFS&VERSION=2.0.0&REQUEST=GetFeature&TYPENAMES=data.linz.govt.nz%3Alayer-53382&NAMESPACES=xmlns%28data.linz.govt.nz%2Chttp%3A%2F%2Fdata.linz.govt.nz%29&BBOX=-36.939824852066955%2C174.70954193086246%2C-36.91494916200109%2C174.76090622708065' line:1 column:121683 message:unexpected end of input'The XML Module halted on error, see the logfile for details<WFS> An error occurred while reading a GetFeature response, to ignore the error and avoid losing the previously read features, set the WFS "Ignore GetFeature Error" parameter. Total features downloaded: '0'A fatal error has occurred. Check the logfile above for detailsAccessing the link and checking the file manually
I have manage to export shp in file geodatabase with datasets but now it seems that i have a strange problem (or bug).every shp that i have exported is missing 1st entry in geodatabase. lets say a shp file has 10 points then i’ll get only 9 points in gdb and the one is missing is always the 1st pont in shp file. every shp file is missing that 1st entry.the strange thing is that fme shows in information that it wrote all entries that the shp files has but somehow 1 is missing.there is absolutly no error in logs. i get some info about some fields that i don’t export anyway. i really have no idea why this is happening.the shps are also exported with FME from othe types of data.for writer i use Esri Geodatabase (File Geodb Open API) with some schemas that i read from a template database with featurereader and join it on shps (no schema was readed).so what im doing wrong?why there is no error about the missing entries?
How ı Cut the fme polygon from fme aggregate?You can find the photo attachedturquoise color object is fme aggregate .purple colored object is fme polygon .I want to cut below the yellow line.
Hi,I am trying to add a timestamp to a file, which is being written using feature writer. The workbench is on a shared data directory with a Flow Environment.I have seen other options of using fanout option but seems like they are limited to writers only.I just need a simple timestamp on my text-file when its written so that I can keep records of what is being written.I also have made a timestamp attribute using DateTimeStamper and DateTimeConvertor but don't know how to add that to the file name.Any pointers will be appreciated.Thank you
I’m attempting to automatically add three lines to the start of a processed data set, in order to create a batch file.There is probably a very simple solution but any help would be appreciatedThanks
Hello everyone,I am a beginner with CityGML and am currently trying to convert a dataset to CityGML 3 with generics extensions using FME Workbench. However, I am encountering a couple of issues:Warning about inheritance relationship: The output gives a warning indicating no inheritance relationship. I have used AttributeMerge to add gml_parent_id, but the system does not seem to recognize it.<GML_2 Writer> - '12482' orphaned features found, XML comments representing these features will be present in the output file: <!-- orphaned feature - parent id:'...', id:'...', type:'...' -->Geometry export issue: It does not export correctly after setting up the geometry. In the Inspector, the data appears as a table without geometry.Additionally, the original dataset complies with the CityGML 3 standard, and its geometry's encoding is Name (encoded: UTF-16LE). Could this encoding be affecting the process?My settings and the transformer export are shown in the attached image.I would g
Title!i’m trying to import shp files into a gdb database in separate dataset based on the folders that the shape files are located. i know i’ve read somewhere in the help to set dataset/feature name for feature name but its not workig.i get an error that its not possible without coordinate system. so i’ve added coordinate system to writer but i still get the same error.the error isFileGDB Writer: Cannot currently create feature datasets with unknown coordinate systems. Please specify a known coordinate system, or do not write to a feature dataset. Failed to create feature class 'B10/Shape_Z'so is it possible to write datasets in esri geodatabae with Esri Geodatabase (File Geodb Open API) writer? if so can you post an example.
Hello, I would like to export my FME workspace (see image below) in order to integrate it in the appendices of a technical report. Is there a way to do so apart the "Print"? Printing the workspace sadly does not work since it is quite large and would then become very small and unreadable. Any alternative? Can be either exported in a text format or a reduce graphic format...
Hello everyone,I am currently working on migrating sewer utility data from an AutoCAD Civil 3D (2022) DWG file into the Esri Utility Network Foundation (Sewer) feature class/file geodatabase.Issue: The attribution for the DWG sewer layers is stored in tables that I need to join to my DWG/Feature class during the FME workflow by matching an ID field. However, the ID field in my DWG is not appearing in the reader I am using (Autodesk AutoCAD Civil 3D), not even as an “unexposed attribute”.I discovered a legacy .fmw file that successfully reads this field using a different reader (Autodesk AutoCAD Map 3D Object Data), which I do not have a license for.Questions: What is the necessary license for Autodesk AutoCAD Map 3D Object Data (aka AUTOCAD_OD)? Is it an FME-based license, or does it require an active AutoCAD Civil 3D license on my computer (which I currently don't have)? As an alternative, can anyone guide me on how to copy-paste the ID field that I can’t access in FME into a differ
I have been using Dynamic writers to create feature classes and tables in an Esri File Geodatabase for years. I normally use the FME field type “fme_int32” to create Long Integer field types. However, I need to create attributes using Esri’s new ‘Big Integer’ field type. I assumed I could use “fme_int64” but when I run my workspace in FME 2024.0, it runs without errors but it doesn’t create the new feature class. When I change the 2 fields from fme_int64 back to fme_int32, it runs without errors and creates the new feature class. I have ArcPro 3.2.2 installed which also supports the new Big Integer (64 Bit) field types.My question is: Should I be using a different FME Field type besides ‘fme_int64’ to generate Big Integer field types via a Dynamic FGDB Feature Class Writer?Thanks in advance.
Hi,I have an FME workbench that outputs a KMZ but i want to create a folder tree style for ease of view. Currently it outputs as below: I have been unsuccessfully trying to create a tree which will output something like this:Proper name instead of doc (folder) → operating_voltage (folder) → feeder_name (folder) → actual feeder spatial data .Screenshot of workbench below: The operating_voltage and the feeder_name coming from the attribute_renamers at the right end of the workbench.I tried using the instructions in below link, but it is not exactly the same as the attributes are in the data already and not being created for the purpose of the multi folder.Creating KML Folders Through KML IDs – FME Support Center (safe.com)Any ideas how this can be done?thank you,fb
Hi,I have a table (that started life as a JSON table, lists exposed etc) containing multiple attribute fields and rows. One of the fields contains CLOB data, like this:<cmAstLocSpId>148606829</cmAstLocSpId><criticalityDetails><criticalityReasons><criticalityReasonsList><criticalityReason>CMEH</criticalityReason></criticalityReasonsList></criticalityReasons></criticalityDetails><cmOsgridref>NZ30272359</cmOsgridref><cmOsnorthing>523598</cmOsnorthing><cmOseasting>430279</cmOseasting><cmRegion>TEESSIDE</cmRegion><cmRepairRegion>TEESSIDE</cmRepairRegion><cmDnoArea>NP (NE)</cmDnoArea><cmCreatedByUser>DAVID</cmCreatedByUser><cmCreationDate>2023-11-23</cmCreationDate> I want to turn the normal text into column / field headings, and those highlighted in bold into values in the relevant column. eg the first column will be “cmAstLocSpld” and t
See 12 day old post. I appreciate the gamification of the user base but it is not a game when I have a critical, work FMW that that isn’t working. There has got to be something better than this support. Am I not entitled to some level of solution based, tech support for the software fees paid?
So I’ve been trying to overwrite a coordinate system in FME, usually I work with EPSG codes. In FME most (if not all ) projections has an EPSG associated with them. When searching for a coordinate system you can just throw in the EPSG code. It’s great.I discovered that one of FME’s coordinate systems (EPSG:3004) by default uses a pretty poor translation to WGS84. I wanted to update the definition so the EPSG code would work better. I defined a new coordinate system in the hopes that when picking the EPSG code it would take my user defined system over the FME one. I found that the only way I could get the EPSG number to link to my new definition was if I actually gave it the same name as the one in FME Any other name and using the EPSG would always revert back to the old unprecise definition. In this case “MonteMario_1.Italy-2”. Of course now I get what looks to be duplicates in the list. Interestingly, no matter which you pick you always end up with the same coordinate system getting u
Hi,How can I stop the translation if one Tester in my workspace pass 0 features in the ‘Passed’ port? Thank´s
I have FME v2024 with a Floating License. I have Windows 10 Enterprise installed. I am almost out of space on my disk where my "Temp" folder is located.The persistent problem I have with FME is that every time I try to open an XML file, although I do have the reader for it, I consistently get the same 6 errors. I have tried opening other files and there is no problem with those, only with XML files.[1]: HTTP transfer error: Timeout was reached[2]: Please ensure that your network connection is properly set up[3]: No proxy settings have been entered. If you require a proxy to access external URLs, please ensure the appropriate information has been entered.[4]:Failed to obtain any schemas from reader 'CITYGML' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information[5]:Workspace generation failed. Parameter file was C:\Users\User1\AppData\Local\Temp\FME_1717067304960_7084.Login
I’m running FME Form 2023 and creating a new script with a reader wich fails when looking up tables. Message given: Failed to retrieve feature typesCould not open the enterprise geodatabase because the local version of arcgis is not compatible with the server's SDE version.On the laptop I have both Arcmap 10.7 and ArcGIS PRO 3.1 (AGP) installed. When creating the reader I use a connection file created in AGP. I also have FME 2018 but this is 2023. The reader is defined as “Esri Geodatabase (ArcSDE Geodb) / Embed Connection Parameters” as the geometry format in the database is ST_GEOMETRY. To me it looks like files from ArcGIS 10.7 is found and used which doesn’t work. Is there any way to force FME 2023 to use “library files” from AGP 3.1 or is there another way to solve the problem?
I am joining a data table with polygons, via a FeatureJoiner using a common value between the two datasets, both data sources come from a sql database. I am outputting a spatial table (the polygons, joined with the data) to another database.I am encountering a strange issue when I try to open this data with ArcGIS Pro, I have never come across this before - The ESRI_OID does not exist. I was not aware this was required previously either.This is causing various issues with viewing the data and publishing it, or joining it within ArcPro. I am getting this error on the esri GIS server when I try to view the polygons/or view the table. here is what the output data rows look like:It is a very simple dataset with geometry. I’ve never had to make esri_oids before in any of my workbenches, does anyone have any insight to what might be going wrong?
I know that citygml has versions from 1.0 to 3.0.However, it seems that changing ifc to fme is only possible with citygml 2.0.Maybe I don't know how? Or is fme only converted to 2.0 by converting ifc to citygml?version미국식[│vɜːrʒn]영국식[│vɜːʃn; │vɜːʒn]1. (이전의 것·비슷한 종류의 다른 것들과 약간 다른) -판[형태] (→beta version)2. (어떤 사건에 대해 특정한 입장에서 밝힌) 설명[생각/견해]3. <다른 언어로 된 것을 번역하거나 다른 예술 작품 형태로 된 것을 영화·연극·음악 작품 등으로 만든 것> (→the Authorized Version, cover version)
The .ecw file created through FME, QGIS cannot identify its CRS correctly. I tried with both ecw v2 and v3. This can be fixed through ECW header edit. It might be a bug when trying to write GDA2020 datum to ecw file.
Hello community,I've updated an ArcGIS Online Feature Service using FME, but unfortunately, I seem to have lost my data. The table still exists, but the data is missing. The feature service I want to restore was already added as both a feature service reader and writer. Does anybody have an idea how I can restore my data? The 'Enable Feature Cache' option was already checked.FYI: we only have Arcgis online, we dont have Arcgis Entreprise and portal
What would be the best way (aside from opening the file in a GIS software) to find out if the vertices in a shapefile has a Z and/or an M?
Hi -I’m attempting to identify the schema of 33 shapefiles. The goal is to transform all the shapefiles from one schema to a standardized schema in a single workflow. My thought is to first identify all the attributes of the raw data then create a look-up table. To do this, I started by running a query on my source folder using the PATH reader to identify all the shapefiles in the folder. Next, I was going to use the FeatureReader transformer with the Format set to ESRI Shapefile using the file path attribute (path_windows) from the PATH reader as the dataset to read. I was then going to use the ListExploder to expose the attributes from the <Schema> output port. However, the schema output port is skipping 4 of the shapefiles. The schema output port = 29 ; initiator output port = 33. I’m not sure why it’s doing this. The file path is different for all the shapefiles. Any help to get all 33 shapefiles to go through the <Schema> output would be greatly appreciated! Thank you
Hi, when opening fbx in FME, I see a property with a description of the material in the geometry parts (pay attention to the line highlighted with a marker) FME has a python interpreter, with its own classes and functions.I have already pulled out the coordinates of the points, in the code belowimport fmeimport fmeobjectsFeatureProcessor class (object):def __init__(self):passesentering def (self, feature):all_geom = function.getGeometry()first_part = all_geom.getPartAt(0)if type(first_part) == fmeobjects.FMEMesh:meshs = first_part.getAsMultiSurface()vertices_list = first_part.getVertices()textur_coord_list = first_part.getTextureCoordinates()textur_length = len(textur_coord_list)if textur_length > 0:for trian_mesh in first_part:ver_index = trian_mesh.getVertexIndices()textur_index = trian_mesh.getVertexNormalIndices()newFeature = fmeobjects.FMEFeature()pnt1 = vertices_list[ver_index[0]]pnt1_t = textur_coord_list [textur_index [0]]newFeature.setAttribute('X1',pnt1[0])newFeature.setAt