Using readers and writers to extract and load data.
Recently active
Anyone come across .nt files (N-Triples) files? Their doesnt seem to be a native FME reader for it.
How can i extract data from this line? {"sl:stand": {"sl-bag-extract:bagObject": {"Objecten:Pand": {"Objecten:status": "Pand in gebruik", "Objecten:geometrie": {"gml:Polygon": {"@srsName": "urn:ogc:def:crs:EPSG::28992", "gml:exterior": {"gml:LinearRing": {"gml:posList": {"#text": "114062.419 542728.035 0.0 114067.343 542726.792 0.0 114067.637 542728.082 0.0 114068.445 542728.468 0.0 114069.011 542730.438 0.0 114068.36 542731.246 0.0 114068.639 542732.471 0.0 114063.762 542733.793 0.0 114064.204 542735.512 0.0 114057.619 542737.161 0.0 114055.721 542729.372 0.0 114055.572 542729.428 0.0 114053.081 542719.589 0.0 114059.937 542717.727 0.0 114062.353 542727.763 0.0 114062.419 542728.035 0.0", "@count": "16"}}}, "@srsDimension": "3"}}, "Objecten:voorkomen": {"Historie:Voorkomen": {"Historie:BeschikbaarLV": {"Historie:tijdstipRegistratieLV": "2010-11-26T12:31:16.436", "Historie:tijdstipEindRegistratieLV": "2014-10-27T12:32:20.904"}, "Historie:eindGeldigheid": "2014-09-25", "Historie:beginG
Hello,I am trying to write 3D Geometries (Points and Linestrings) to an Oracle-Database (21c Express). In the process all z-Coordinates get lost and SDO_GTYPE is wrongly written as 2001 or 2002 (2-Dimensional Geometries) instead of 3001 and 3002.Multiple Geometries are entering the writer as an aggregate (example below). Apart from the z-Coordinate missing these are written and interpreted correctly when writing to Oracle. I have checked the “Contains Z Ordinate” Option in the Writer-Parameters.Does anyone have anymore ideas what I could try?
Hi there, I am working on a data clean up model. Many thin areas and remnants have been cleaned up but I can't figure out how to this last thing.There are some thin areas that connect on both sides to a large and very complex polygon. (See image)Does anyone have a suggestion for how to remove these type of areas? So only the thin parts have to be removed.
Hi,I was wondering if there are some best practices and or style guides / examples on for workspaces. Some questions that I have about this (besides the obvious: avoid crossing as much as possible, annotation, clear transformer names etc) Like is there an agreed style for public and private parameters (casing, under scores, ...)Is there an advise on how many transformers can be put in the main part and how many in a custom transformer?How many custom transformers can be nested into each other or is it advised to not do this to deep (performance impact)Any other good to implement styles?
Hello everyone,At our organization we work on a virtual machine. When you log on into a virtual machine, you share the virtual machine with other users. Since a few weeks we encounter sometimes black screens when trying to use FME form 2023 or FME form 2024. I googled and the problem is quite similar to Known Issue: FME Workbench 2023 Opens as a Blank Window on a Virtual Machine – FME Support Center, instead it's a black screen. The article mentions about OpenGL versions, however the specs for all our virtual machines should be the same, so I think the cause is different.When you encounter the black screen, you can only hover over the black screen and can't do much else. When you close FME Form and try to open a new FME Form sesssion, you still get a black screen. The only workaround is to log off and log into a new virtual machine where this problem doesn't occur. We already did some troubleshooting and we know one thing for sureIt's possible that fme form 2023/2024 initially worked f
Hi, I am using the attribute creator to populate a new field. I want to fill in the blank rows with the previous master property number from the master prop no field. I have enabled the adjacent features but no matter what I try it still only populates just the 1 record after a value and not all the blanks. I thought I would only need 1 based on what I’ve found on the forums.What am I doing wrong here?I also tried to do that same thing via the attribute manager but get the same result.The end result would also have row 3 (FME row id not the xlsx one) with ‘932590’ and row 6 with ‘933123’ and rows 9-11 with ‘933796’ etc with the number of blank rows varying from 1 to potentially hundreds.The settings I have for the transformers are below.I am using FME 2022.2. Thank you! Belinda
I am trying to fill in the rows of my table with the previous values. I saw this thread and I am following the instructions but for some reason I am only getting the first empty row to be filled but not any subsequent rows. I tried to change the Subsequent Features to another value other than 0 and even tried to change the number of Prior Features but I always get the same results.I am on FME Form 2024.2.0.0 if that helps. Any suggestions as to what I am doing wrong?
Hi, I am trying to replicate the V-Lookup formulas in FME that I currently have in my excel. Also the current excel formulas refers to a different sheet named Limits and I am looking to create the same sheet in the FME and finally when the writer generates the output the file should have 2 sheets - 1st one where the data is written and the 2nd will be Limits. Writing to the existing template is not an option due to complexities involved
Hi all, I’d like to use FME to execute some count SQL functions on SQL server (SDE). I’m having trouble with the syntax of the SQL in FME and I’m not receiving any output from the SQL Executor. SQL I’m running:SELECT COUNT(*)from "SDE".SAMPLE;
I'm using FME to write spatial data to a SQL Server database via an SDE connection, but the table is created without the spatial data. How can I ensure the spatial data is written correctly?Error message below for refernce An error occurred while attempting to create the feature class 'EL.DATA'. The error number from ArcObjects is: '-2147216061'. The error message from ArcObjects is: {Table already exists [42S01:[Microsoft][ODBC Driver 17 for SQL Server][SQL Server]
Hello everyone,I performed a feature merger between two shapes and obtained a list from this transformer. My list is as follows:insee: 11232code: PTRSURF: 11insee: 11232code: PPHSURF: 15insee: 11232code: SPLSURF: 23insee: 15500code: PPHSURF: 2insee: 15500code: SPLSURF: 555So I want to assign the elements of the list to an attribute table (in columns). I have a maximum of 96 elements for a single code, so my resulting table will have many columns.So I want to get this: How should I do this?THANKS
I am having maybe a similar but different issue with the mbtiles writer. For some reasons the Zoom level dialog is not making a lot of sense to me. In my case I would like to force the writer to write out levels 0 to 11. In my head I am thinking I would set minimum zoom level strategy to “Lower” and then the Minimum Zoom Level to 11. My assumption is that when we talk about level it matches up with the table below. However with the above setting I get a mbtiles file with just one level in i (see results 1 below for log). If I instead set Base zoom to Upper and Minimum Zoom to 0 (run 2 below for log), I get a file with 10 levels. This is close to what I want, but I want 11 levels. Any ideas on how to better explain the dialog to me and get me 11 levels?? thanks so much!!! Run 1 log: Feature Caching is ONThe workspace may run slower because features are being output and recorded on all output ports regardless of whether or not there is a connection. Command line to run this w
What is the best approach to write to selected excel cells if I am overwriting using an existing template? How can I make FME understand to apply the formula or the predefined values based on the feature count in my input file ? The template contains the predefined value in the first row. Item ID Program Full Name Master Certificate Number Address Dentist Association XL89 My Input File / Reader FileItem ID Full Name Address 12 Jon Doe 14 King St 45 Mary Jane 5 Todds Ave 345 Henry Smith 7 Queen St My expected Output Item ID Program Full Name Master Certificate Number Address 12 Dentist Association Jon Doe XL89 14 King St 45 Dentist Association Mary Jane XL89 5 Todds Ave 345 Dentist Association Henry Smith XL89 7 Queen St
Hi, I am having an issue of trying to use a dgn cell library and seed file on FME Flow for point features. The workbench works correctly on desktop but not Flow. Is FME capable to read cell library and seed files on FME Flow? This is the error message I get:Any help would be greatly appreciated! Thanks!
Hi, I am trying to set up a simple update workflow that doesn’t like me. I am trying to update my enterprise portal with GDB updates and will eventually want to have this run everyday but for now I am just trying to figure out how to update one shapefile and repeat this 30 times. Right now I haver set up a GDB reader going directly into ESRi ArcGIS portal feature service writer to update an existing feature in enterprise and I have got it to write the features but it doesn’t want to publish the feature into portal.Can someone help me figure this out?
Hi all!I am trying to convert the Open Building Designer file to IFC 4. It was found that the IFC exporter in the Open Building Designer does not map features to the correct IFC entities, most of them will be classified as ifcBuildingElementPoxy. Therefore, I plan to try the conversion using FME. However, there is no reader format for Open Building Designer. Should I start the conversion by reading the Bentley MicroStation Design V8 format instead?
In a SDE reader, you have the option to ‘Resolve Domains’:In this example, this will take fields that have a domain, and create a new field with a suffix ‘_resolved’ and populates it with the descriptions from the coded values.I.e:The original field with the domain codes is ‘Accuracy_Spatial_Source’, while the ‘Accuracy_Spatial_Source_resolved’ are the domain descriptions.Once the codes are resolved, I no longer need the original fields, is there a simply way to remove these automatically?Sure, I can use an AttributeManager and remove them manually, however, it is not very practical or efficient when having more than 50 fields.One way to somewhat ‘cheat’ is to use a BulkAttributeRenamer and remove the suffix ‘_resolved’ to basically ‘overwrite’ the original fields, however, this causes schema issues.Another method I tested was using a PythonCaller and generating a list of all the “unresolved” fields, however, I could not find a way after to bulk remove the attributes from a list.Has an
Hello all, I am working on the generation of SolitaryVegetationObject with a workbench referring to https://hub.safe.com/publishers/con-terra-lab/templates/citygml-create-solitaryvegetationobject-with-implicit-representation. The conversion details could be reference to my last post below. As you could see from the FBX and CityGML file below, some texture went missing in the CityGML model. I have only one PNG as texture and my model has two parts, one is the crown (130 surfaces) and another is the trunk (2700 surfaces). My findings are that the <app:X3DMaterial> part referenced to both parts of the model separately while the <app:ParameterizedTexture> part only referenced to half of crown part of the model (65 surfaces), leading to an incomplete texture. Is there any potential cause to this problem as observed from my workflow and is there any way to fix the issue? Thanks! FBX texture CityGML appearanceWorkflow for FBX to CityGML
Hello all, I am currently working on the conversion of FBX tree model to CityGML SolitaryVegetationObject. I have made reference to the template workflow for creating SolitaryVegetationObject (ref: https://hub.safe.com/publishers/con-terra-lab/templates/citygml-create-solitaryvegetationobject-with-implicit-representation). However, my case is slightly different from the template. First of all, what I current have, is a CSV file containing the tree information (XYZ, DBH, etc) and an FBX file containing one 3D tree model with correct transformation and dimensions (DBH). This FBX file was originally a prototype in FBX format and was transformed into a correct XYZ and DBH. Since not all my data contain crown spread and tree height, they would be estimated by scaling from the prototype with reference to DBH. This estimation would not generate a value for the crown spread and tree height but only a dimension change. What I want to do is to convert this FBX into a CityGML file, appending the
Context : The reader file has 14 attributes ( No formulas ) and the format is Excel File. For the writer file, I am trying to leverage an existing template file (with 2 sheets - Standard & Limits) and the final output should be written to the Standard sheet of the template file. The template file has 80 attributes in total. The value for some attributes are based on the value from the reader attributes, some attributes are hardcoded in the template itself and the remaining attributes will be populated based on the formulas from the existing sheet i.e Standard and the Limit Sheet. What is the ideal approach to achieve the result ensuring no formulas are overwritten in the template file - standard sheet in the process and that my final writer output has the exact same sheets ?
Hi - I’m trying to create polygon geometry from the GeoJSON in the attached file. This is a string attribute returned from an API.I was thinking I could use a GeometryReplacer with the encoding set to GeoJSON. However when I do this the record is rejected with an ‘INVALID_PARAMETER_GEOMETRY_SOURCE’ message.I have passed the GeoJSON attribute through a JSONValidator and this doesn’t flag up any issues.Any suggestions for what I’m doing wrong, or alternative approaches would be very welcome.Thanks in advance.
I am trying to create a workflow that will update a feature layer on ArcGIS Online that is powering a dashboard but keep running into several roadblocks regarding updating the layer. The points themselves are being updated from two sources (other AGOL feature layers) and I am using FME to combine them. First they go through an attribute manager to get the schema matching (They are similar, but different attribute names and one is significantly longer because it just has more data. This longer one is the base for the "master layer"), then those two go through an Update Detector transformer with both of those being compared to the "mater" feature layer. That update detector finds which existing records have been updated (I hope) and then those updated or new records are linked to the master feature layer writer in Update mode. The problem I am running into is when I hit run, an error occurs and says "your layer is missing the ID attribute 'OBJECTID' neede
I have a list containing 93 different WFS URLs, my goal is to be able to read these in one workbench without clutter and for the workflow to handle changes in the URLs for example, a new WFS is released and gets added to the list, I want it to work without having to change or add more to the workbench.Im using FeatureReader to read the format OGC WFS (Web Feature Service) but it wont accept an attribute value as the Dataset, I mean I can put one in there put it does not know what to do with it. If I put the URL directly as the Dataset it knows exactly what to do and I can use the Feature Types to Read and select all an they end up as text separated by a space between each Feature Type. This theoretically means that I could just write a list of every Feature Type I need, use the Attribute Value as Dataset and get results. However, what I really need now is a way to get every Feature Type from the WFS List so that I can ad it in place of Feature Types to Read.Dataset = Attribute ValueFea
Hi,I have a very complex KML file with many folders and subfolders. I would like to save the folder name or full folder path where each placemark is located — something similar to the "FolderPath" field when converting KML to GDB in ArcGIS Pro.How can I achieve this?