Skip to main content

Data

Using readers and writers to extract and load data.

  • 6,970 Posts
  • 25,684 Replies
6970 Posts
arenscott
Contributor
arenscottContributor
asked in Data
SQL Count function

Hi all, I’d like to use FME to execute some count SQL functions on SQL server (SDE). I’m having trouble with the syntax of the SQL in FME and I’m not receiving any output from the SQL Executor. SQL I’m running: SELECT COUNT(*)from "SDE".SAMPLE;

699
ebygomm
Influencer
julianat
Contributor
julianatContributor
asked in Data
DGN Cell Library in FME Server

Hi, I am having an issue of trying to use a dgn cell library and seed file on FME Flow for point features. The workbench works correctly on desktop but not Flow. Is FME capable to read cell library and seed files on FME Flow? This is the error message I get: Any help would be greatly appreciated! Thanks!

731
julianat
Contributor
cdog
Contributor
cdogContributor
asked in Data
ArcGIS enterprise update

Hi, I am trying to set up a simple update workflow that doesn’t like me. I am trying to update my enterprise portal with GDB updates and will eventually want to have this run everyday but for now I am just trying to figure out how to update one shapefile and repeat this 30 times. Right now I haver set up a GDB reader going directly into ESRi ArcGIS portal feature service writer to update an existing feature in enterprise and I have got it to write the features but it doesn’t want to publish the feature into portal. Can someone help me figure this out?

478
cdog
Contributor
sobdm5
Participant
sobdm5Participant
asked in Data
Does FME Workbench support the conversion of Open Building Designer files to IFC 4?

Hi all! I am trying to convert the Open Building Designer file to IFC 4. It was found that the IFC exporter in the Open Building Designer does not map features to the correct IFC entities, most of them will be classified as ifcBuildingElementPoxy. Therefore, I plan to try the conversion using FME. However, there is no reader format for Open Building Designer. Should I start the conversion by reading the Bentley MicroStation Design V8 format instead?

241
carlw
Safer
nwse
Contributor
nwseContributor
asked in Data
Once attributes are resolved, is there a way to remove the original (coded) attributes automatically?

In a SDE reader, you have the option to ‘Resolve Domains’: In this example, this will take fields that have a domain, and create a new field with a suffix ‘_resolved’ and populates it with the descriptions from the coded values. I.e: The original field with the domain codes is ‘Accuracy_Spatial_Source’, while the ‘Accuracy_Spatial_Source_resolved’ are the domain descriptions. Once the codes are resolved, I no longer need the original fields, is there a simply way to remove these automatically? Sure, I can use an AttributeManager and remove them manually, however, it is not very practical or efficient when having more than 50 fields. One way to somewhat ‘cheat’ is to use a BulkAttributeRenamer and remove the suffix ‘_resolved’ to basically ‘overwrite’ the original fields, however, this causes schema issues. Another method I tested was using a PythonCaller and generating a list of all the “unresolved” fields, however, I could not find a way after to bulk remove the attributes from a list

284
nwse
Contributor
cossy27
Contributor
cossy27Contributor
asked in Data
Texture missing in SolitaryVegetationObject generation

Hello all, I am working on the generation of SolitaryVegetationObject with a workbench referring to https://hub.safe.com/publishers/con-terra-lab/templates/citygml-create-solitaryvegetationobject-with-implicit-representation. The conversion details could be reference to my last post below. As you could see from the FBX and CityGML file below, some texture went missing in the CityGML model. I have only one PNG as texture and my model has two parts, one is the crown (130 surfaces) and another is the trunk (2700 surfaces). My findings are that the <app:X3DMaterial> part referenced to both parts of the model separately while the <app:ParameterizedTexture> part only referenced to half of crown part of the model (65 surfaces), leading to an incomplete texture. Is there any potential cause to this problem as observed from my workflow and is there any way to fix the issue? Thanks! FBX texture CityGML appearance Workflow for FBX to CityGML

354
cossy27
Contributor
cossy27
Contributor
cossy27Contributor
asked in Data
Creating CityGML Solitary Vegetation Object

Hello all, I am currently working on the conversion of FBX tree model to CityGML SolitaryVegetationObject. I have made reference to the template workflow for creating SolitaryVegetationObject (ref: https://hub.safe.com/publishers/con-terra-lab/templates/citygml-create-solitaryvegetationobject-with-implicit-representation). However, my case is slightly different from the template. First of all, what I current have, is a CSV file containing the tree information (XYZ, DBH, etc) and an FBX file containing one 3D tree model with correct transformation and dimensions (DBH). This FBX file was originally a prototype in FBX format and was transformed into a correct XYZ and DBH. Since not all my data contain crown spread and tree height, they would be estimated by scaling from the prototype with reference to DBH. This estimation would not generate a value for the crown spread and tree height but only a dimension change. What I want to do is to convert this FBX into a CityGML file, appending the

9216
cossy27
Contributor
aashnaparikh
Contributor
aashnaparikhContributor
asked in Data
Excel Writer - Leveraging Existing Template with Formulas.

Context : The reader file has 14 attributes ( No formulas ) and the format is Excel File. For the writer file, I am trying to leverage an existing template file (with 2 sheets - Standard & Limits) and the final output should be written to the Standard sheet of the template file. The template file has 80 attributes in total. The value for some attributes are based on the value from the reader attributes, some attributes are hardcoded in the template itself and the remaining attributes will be populated based on the formulas from the existing sheet i.e Standard and the Limit Sheet. What is the ideal approach to achieve the result ensuring no formulas are overwritten in the template file - standard sheet in the process and that my final writer output has the exact same sheets ?

462
takashi
Influencer
vasukimgis
Participant
vasukimgis
asked in Data
reading spatial data from Oracle to writing to SQL server

I'm using FME to write spatial data to a SQL Server database via an SDE connection, but the table is created without the spatial data. How can I ensure the spatial data is written correctly? Error message below for refernce An error occurred while attempting to create the feature class 'EL.DATA'. The error number from ArcObjects is: '-2147216061'. The error message from ArcObjects is: {Table already exists [42S01:[Microsoft][ODBC Driver 17 for SQL Server][SQL Server]

170
vasukimgis
Participant
mattebridges
Participant
mattebridgesParticipant
asked in Data
Creating geometry from GeoJSON text

Hi - I’m trying to create polygon geometry from the GeoJSON in the attached file. This is a string attribute returned from an API. I was thinking I could use a GeometryReplacer with the encoding set to GeoJSON. However when I do this the record is rejected with an ‘INVALID_PARAMETER_GEOMETRY_SOURCE’ message. I have passed the GeoJSON attribute through a JSONValidator and this doesn’t flag up any issues. Any suggestions for what I’m doing wrong, or alternative approaches would be very welcome. Thanks in advance.

677
mattebridges
Participant
tva
Contributor
tvaContributor
asked in Data
FME Form (desktop) best practices and style

Hi, I was wondering if there are some best practices and or style guides / examples on for workspaces. Some questions that I have about this (besides the obvious: avoid crossing as much as possible, annotation, clear transformer names etc) Like is there an agreed style for public and private parameters (casing, under scores, ...) Is there an advise on how many transformers can be put in the main part and how many in a custom transformer? How many custom transformers can be nested into each other or is it advised to not do this to deep (performance impact) Any other good to implement styles?

1744
bobw
Contributor
A
afackler_napsg
asked in Data
Updating AGOL Feature Layer - No ObjectID?

I am trying to create a workflow that will update a feature layer on ArcGIS Online that is powering a dashboard but keep running into several roadblocks regarding updating the layer. The points themselves are being updated from two sources (other AGOL feature layers) and I am using FME to combine them. First they go through an attribute manager to get the schema matching (They are similar, but different attribute names and one is significantly longer because it just has more data. This longer one is the base for the "master layer"), then those two go through an Update Detector transformer with both of those being compared to the "mater" feature layer. That update detector finds which existing records have been updated (I hope) and then those updated or new records are linked to the master feature layer writer in Update mode. The problem I am running into is when I hit run, an error occurs and says "your layer is missing the ID attribute 'OBJECTID' needed to update/delete". However I ca

4806
birgit
Influencer
oskar
Contributor
oskarContributor
asked in Data
Reading multiple WFS with FeatureReader issue

I have a list containing 93 different WFS URLs, my goal is to be able to read these in one workbench without clutter and for the workflow to handle changes in the URLs for example, a new WFS is released and gets added to the list, I want it to work without having to change or add more to the workbench. Im using FeatureReader to read the format OGC WFS (Web Feature Service) but it wont accept an attribute value as the Dataset, I mean I can put one in there put it does not know what to do with it. If I put the URL directly as the Dataset it knows exactly what to do and I can use the Feature Types to Read and select all an they end up as text separated by a space between each Feature Type. This theoretically means that I could just write a list of every Feature Type I need, use the Attribute Value as Dataset and get results. However, what I really need now is a way to get every Feature Type from the WFS List so that I can ad it in place of Feature Types to Read. Dataset = Attribute ValueF

659
nielsgerrits
VIP
marta.podsiad
Supporter
marta.podsiadSupporter
asked in Data
KML to Gdb with saving hierarchy folders names

Hi, I have a very complex KML file with many folders and subfolders. I would like to save the folder name or full folder path where each placemark is located — something similar to the "FolderPath" field when converting KML to GDB in ArcGIS Pro. How can I achieve this?

744
takashi
Influencer
hawaiialex
Contributor
hawaiialexContributor
asked in Data
Resolve Domains Replication of FCs in EGDB

Hi all, I am working on a script to replicate a set of feature classes from one enterprise geodatabase that we use for transactional editing purposes to another enterprise geodatabase that we use for publication purposes for the organization. This replication script would be scheduled in FME Server to run on a nightly basis. The issue is that the feature classes I plan on replicating have several domains and subtypes applied to them that don’t translate correctly. I’ve been advised to use the ‘Resolve Domains’ functionality and change the configuration from ‘coded domain’ type to ‘char’. My test workflow involves the below: Copying the feature class via the ‘Import Feature Class’ tool in ArcGIS Pro into the target Enterprise Geodatabase to have the feature class available in both geodatabases With FME: Selecting the ‘Resolve Domains’ checkbox in the Writer at the outset, and using the ‘Insert’ and ‘Truncate Existing’ In the Writer configuration, changing the ‘coded domain’ type to ‘cha

662
nwse
Contributor
froberts
Contributor
frobertsContributor
asked in Data
MBtiles Writer and forcing layers

I am having maybe a similar but different issue with the mbtiles writer. For some reasons the Zoom level dialog is not making a lot of sense to me. In my case I would like to force the writer to write out levels 0 to 11. In my head I am thinking I would set minimum zoom level strategy to “Lower” and then the Minimum Zoom Level to 11. My assumption is that when we talk about level it matches up with the table below. However with the above setting I get a mbtiles file with just one level in i (see results 1 below for log). If I instead set Base zoom to Upper and Minimum Zoom to 0 (run 2 below for log), I get a file with 10 levels. This is close to what I want, but I want 11 levels. Any ideas on how to better explain the dialog to me and get me 11 levels?? thanks so much!!! Run 1 log: Feature Caching is ONThe workspace may run slower because features are being output and recorded on all output ports regardless of whether or not there is a connection. Command line to run this workspace: "C

250
froberts
Contributor
marta.podsiad
Supporter
marta.podsiadSupporter
asked in Data
Expose Feature Attributes from KM

Hi, I have error while running the workbench from How to Expose Feature Attributes from KML Tags or HTML Tables – FME Support Center It failes at point Method 2: XML> 2. Fragment XML Any idea why it does not work. I have not changed any of the settings in that workbench

657
marta.podsiad
Supporter
jugoslaviaa
Enthusiast
jugoslaviaaEnthusiast
asked in Data
Accessing Annotation Class Names and Text Symbols from GDB

would like to know if FME can read annotation classes and text symbol information that are defined in the Feature Class properties (e.g., in a File Geodatabase or Enterprise Geodatabase). Specifically: Can FME access Annotation Class Names? Is it possible to read text symbol properties like font, size, color, or placement defined in the annotation feature class?

441
crystalatsafe
Safer
sveeraa9790
Participant
sveeraa9790Participant
asked in Data
GMLfile reading issue

I have tried to read GML file using OGC GML reader but I got some errors. I Tried different version reader still the issues coming all those files.

231
takashi
Influencer
geovision
Contributor
geovisionContributor
asked in Data
Create one dataset from three

I have three datasets containing points which I want to bring down to one complete set. Dataset A contains most of the points but not very accurate in terms of location Dataset B contains less points but is more accurate then dataset A Dataset C contains the least points but is the most accurate of all three sets. So I am looking to create something like the following: When there are three points (dataset A, B and C) within one meter of each other merge the A and B with the point from C. When there are two points, for example dataset A and C, merge the point from dataset A with the one from C. And so on.. A way of ranking I would say. Now I have tried using the NeighborhoodAggregator but I cannot specify which point I want to merge which point. I have also looked at the NeighborFinder but I cannot seem to get that working either. Is it possible to have all three datasets analyzed together? Or do I have to do two at a time?

554
max_h
Supporter
jakethepainter
Contributor
jakethepainterContributor
asked in Data
Error reading KML: Could not determine the root kml file of

I'm trying to read some USFS wildland fire data. There's a link to the kml on their website: http://www.wfas.net/google-earth/wfas_nfdr.kmz When I use the url in the kml reader, it downloads it to a temp file location successfully (I can see it there) and it's unzipped. It's got a folder structure about 5 deep. Then I get FATAL |KML: Could not determine the root kml file of `C:\\Users\\xxx\\AppData\\Local\\Temp\\FME_OGCKML_KMZ_1562607566639_14376' If I go to the temp file location and navigate down to the kml, I can read it in no problem. C:\\Users\\xxx\\AppData\\Local\\Temp\\FME_OGCKML_KMZ_1562607566639_14376\\fsfiles\\office\\wfas2\\dir-obs\\wfas_nfdr.kml

458
saraatsafe
Safer
joy
Enthusiast
joyEnthusiast
asked in Data
Black screen FME Form 2023 and FME Form 2024

Hello everyone, At our organization we work on a virtual machine. When you log on into a virtual machine, you share the virtual machine with other users. Since a few weeks we encounter sometimes black screens when trying to use FME form 2023 or FME form 2024. I googled and the problem is quite similar to Known Issue: FME Workbench 2023 Opens as a Blank Window on a Virtual Machine – FME Support Center, instead it's a black screen. The article mentions about OpenGL versions, however the specs for all our virtual machines should be the same, so I think the cause is different. When you encounter the black screen, you can only hover over the black screen and can't do much else. When you close FME Form and try to open a new FME Form sesssion, you still get a black screen. The only workaround is to log off and log into a new virtual machine where this problem doesn't occur. We already did some troubleshooting and we know one thing for sure It's possible that fme form 2023/2024 initially worke

513
crystalatsafe
Safer
fme_junior
Contributor
fme_juniorContributor
asked in Data
Summing the population data from several rasters for overlapping polygons

I have two layers: one raster with population data for each cell (blue) overlapping polygons (buffer of 100m) around existing road segments (red) I would like to know the total population contains in each polygon. How do I do this in FME?

924
takashi
Influencer
geckosolutions
Contributor
geckosolutionsContributor
asked in Data
FME Ingesting AGOL json

Hi Everyone, I have this “open” dataset provided by the City of Toronto. I am using a few from the city that are provided in this manner. The only way to bring it into ArcPro and then extract it to a geodatabase is to use the json address and add by url, then use the ‘feature to point’ geoprocessing tool to extract the data to points in gdb format, then use as needed. I need to get this layer into FME from the live feed so I can analyze it and then push it out via other format(s), one of which is AGOL feature layer. For some reason I have been unable to bring it into my FME script via any JSON reader or HTTP caller and I’m wondering if anyone else here will have more luck. The link I am working with is as follows: https://gis.toronto.ca/arcgis/rest/services/cot_geospatial2/MapServer/64 The json link is: https://gis.toronto.ca/arcgis/rest/services/cot_geospatial2/MapServer/64?f=pjson If anyone has the steps to bring the content into FME (geometry and attributes) to have it available for

202
geckosolutions
Contributor
B
bramvr
asked in Data
Optimizing i3s (slpk) LOD

I'm converting 3D data from Postgres to an Esri Indexed 3D Scene Layer (slpk). I'm converting this to an i3s service on Azure (not ArcGIS Online). When loading this as an external layer in ArcGIS Online, the LOD seems totally random, buildings are being visualised but not the way I'd like to see (not based on distance). Is there a way of optimizing this in FME?

46015
vince_j
Contributor

Helpful Members This Week

Badge Winners

Show all badges

Popular Tags

Community Stats

31,140
Posts
118,064
Replies
38,759
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.