- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,780 Posts
24,934 Replies

When you subscribe we will email you when there is a new topic in this category

6780 Posts

Recently active

Most replies Most views Newest first

gogopotter90Contributor

asked in Data

How to detect zigzag -spike -dangle lines and fix them ?

HelloHow could FME detect unwanted spike and unwanted zigzag and fix it without changing geometry of lines ?I have used spike remover and zigzag remover but sometimes it catches data that has no relevant with spikes ,what is best angle for transformers?How to keep the original geometry without changing it ,after fix the problem with zigzag or spike remover ?what is the best method to detect dangle lines and fix it ?thanks in advance fme 2021

1193

7 months ago

nicholasContributor

asked in Data

Difference between MapInfo Writers?

Hello all,I want to understand the difference between two MapInfo WritersI am running FME Desktop version FME(R) 2022.1.3.0 (20220928 - Build 22630 - WIN64)The Writers are;MapInfo TAB (MITAB)Precisely MapInfo TAB (MAPINFO) Is one Writer better than the other?

When trying to read an IFC file, I am getting an error ISO10303-21

When trying to read an IFC file, I am getting an error ISO10303-21: Skipping instance #1154: Instance is not syntactically valid. How can this be fixed?

1229

7 months ago

takanakaContributor

asked in Data

Efficiency of CityGML

Hi, I have some questions about how to make a CityGML more efficient. Context: I have about 1.8m pipelines and cables. I want to visualise these as 3D cylinder/pipes (not actual ‘FMEPipeGeometry’), regardless of the ‘is it necesary to do this’. All features also have attributes like diameter and such. I want to write this to CityDB and CityGML. This results in huge filesize (somwhere like 15gb or 20gb). What I did: My thought process was it would be more efficient to use relative geoetries (a circle) that I extrude/scale/offset/etc to the proper location using the transformation matrix. Of course I cut the original geometry into pairs of 2 vertices. I wanted to reaggregate this to 1 feature once I had the relative geometry up and working. This all worked just fine until I discovered that in CityGML schema the cardinality is 0-1 on features with relative geometry. This means I cannot gather all separate bits of the cables again, giving me an even more absurd amount of features. I also

1338

7 months ago

jimmybowden29Contributor

asked in Data

Esri Utility network reader subtype layer

The Esri ArcGIS Portal Feature Service Reader has most of the capabilities needed to read from a Utility Network including being able to set branch versioning. However there doesn't seem to be a way to resolve domains that are defined at the subtype. The Utility Network uses the subtype layer concept where domains can be applied differently on each field by subtype. Is accessing the subtype domains something the FME can/will support?

17418

7 months ago

michaelapParticipant

asked in Data

Maintaining Trace Network when Editing Location of Features (SDE) from FME

I am trying to edit features (location) that are within a trace network from FME.When editing in ArcGIS Pro I’m able to move features and have the network adjust (example: Move a point connected to a line and the line moves with the point) but I am unable to replicate this behaviour when running from FME. It simply moves the point feature away from the line. Notably I did have this working in a geometric network but since completing a recent upgrade and moving to the trace network in ArcGIS Pro it’s not showing the same behaviour.Is it even possible to maintain the network structure using a trace network out of FME?

461

7 months ago

scootercat_nlContributor

asked in Data

from Points to Polygon in a map

I have been working on FME for a while now. But not much with geo-related issues.A user receives requests : With and without address. Requests without addresses do contain coordinates (in both RD-Amersfoort and ETRS89)The user would like to see a map with a polygon in it.What steps/attributes do I need to realize this?I have already tried with the following attributes : AttributeReprojector, AreaBuilder, HullAccumulator Please give your advice and tips

8914

8 months ago

becContributor

asked in Data

Can FME create complex Excel outputs?

I’m fairly new to FME. I’m using FME Workbench 2023.1. I am trying to recreate an excel output similar to the below image, but I’m not sure FME is capable since there isn’t much information out there on using FME to write an excel output like what I have a need for… All I see is more simple outputs. I need to be able tie the output values of a lot of those cells to data created in other transformers, but since the layout is not your typical excel sheet layout, I can’t seem to find any info if you can use a template and then tie the output from another transformer to the particular cell it goes with in the excel template. If anyone knows where I can find more information on this, I would greatly appreciate the help! Sample template with values

775

8 months ago

humbertoContributor

asked in Data

Merge shapefiles located in folders with the same name in different locations

I am totally new to FME.I would like to merge all the shapefiles located in the all the folders called 2012. Any ideas how to do it?

537

8 months ago

laplanterContributor

asked in Data

Extract information from writer

Hi!I have many workbenchs to manage and I would like to find a way to create a table linking the workbench name with the output writers of each workbench. The goal is to find which workbench generates which table(s). My idea is to add a custom transformer to all my workbench. The information I would like to have is :name of the workbench directory of the workbench writer information (table name, table qualifier and writer)With ParameterFetcher, more specifically, the FME_MF_DIR and FME_MF_NAME parameters, I can get the information about the the name of the workbench and directory. But I cannot find a way to extract the information of the writers. All the writers I have are in a postgis format.I would prefer not to use Python if possible. I’m sure there’s a way to extract the information since it appears in the log, I just don’t know how to get to it! Thank you 😀 !

452

8 months ago

geouser97Contributor

asked in Data

sequential shapefile snapping process

"Hello, I have a folder containing multiple shapefiles, labeled as (a, b, d, e, f...). My objective is to utilize the AnchoredSnapper transformer in the following manner: initially, snap shapefile 'a' with 'b', where 'a' serves as the anchor. Then, the resulting snapped shapefile will be used as the anchor and snapped with 'c', and so forth until all shapefiles are snapped. I tried to implement loops but the problem is that the output have to be the new output after everh iteration, so i can't get a configuration of the loop. I appreciate any assistance or proposition you can provide. Thank you."

592

8 months ago

geomaxContributor

asked in Data

conversion shapefile in IFC format

Hello, I am trying to convert an shapefile in IFC format, never did before.What I did is to connect the reader for shp format to a writer for IFC format but the result is empty.Please, can you explain me the setting to use or the procedure to perform this conversion?Thanks

1663

8 months ago

fme_hansContributor

asked in Data

Retrieve data from Microsoft fabric lakehouse.

HiIs it possible to connect fme to a Microsoft Fabric Lakehouse? And read data?I use fme 2022.2

3201

8 months ago

pushpaContributor

asked in Data

Reader ESRI FGDB - Parameters- Tables - Geodatabase Error (-2147024894)

Hi there, I am getting an Error on Windows Server FME 2021.2.5 when add Reader FGDB and tried to open Tables. (Geodatabase Error (-2147024894) Please see the attached image for more details.I have used FGDBs many times using FME, Windows Server Patches installed by the IT Department recently and it seems since then I am having this issue on FMEI have tried on different servers, ie: Windows 2012 & Windows 2019 and FME on all servers have the same issue.I can drag and drop FGDBs on to the FME Workbench canvas without any issues. Could anyone help me to identify this issue and let me know how to resolve it?thanksRegards,Pushpa

493

8 months ago

aronContributor

asked in Data

Get data from most recent database?

We have a series of databases (postgis) that get _year_month added to their endings so that we can see which one is the newest. The rest of the name, schema etc is the same.It would be convenient to have our workspaces automatically look for the most recent database.So if there exists: supercooldatabase_21_09, supercooldatabase_23_07 and supercooldatabase_24_03 on the server I would like to have FME check all supercooldatabase’s and select the one with the higest number, aka _24_03. This attribute would then be passed on to guide FeatureReaders correctly.Would it possible to do this within FME?

393

8 months ago

kattContributor

asked in Data

Expose Attributes of sql query

Hi, I am using a sql executor reading dynamically some data from our db. I am using following query: select * from t_@Value(F_CLASS_NAME) where fid=@Value(FID). How can I expose the attributes of each query ? I can not use the attribute exposer of the sql executor as the attributes name and number change depending on the table name. I tried a few things but nothing has worked so far. I am reading about 10-40 tables so I want to avoid to manually type in all diff attribute names.

281

8 months ago

sam_appletonContributor

asked in Data

Overwriting AGOL Hosted Feature service - Can't overwrite

Hi, When I try to overwrite a layer in AGOL using the AGOL Feature Service Writer it creates a duplicate feature layer, with a different feature ID. I need to overwrite as there is a schema change in the data and i’m trying to avoid creating a new feature layer as we’ll have to re-configure the downstream map services.I ran the same workbench on a different environment and it had no issues overwriting the layer I was pointing at. Any ideas on how to get this to overwrite?I’ve attached a screenshot of the settings I'm using

2964

8 months ago

sunita22Contributor

asked in Data

How to give file path to load multiple CSV file to SQL server?

I want to give file path to load multiple CSV file to SQL server, How to give file path to reader to select multiple CSV file?

803

8 months ago

galigisEnthusiast

asked in Data

Concatenate values within the same cell & space

Hi All,I need to concatenate the two values of the same cell into just one line. I’ve been (partially) able to do it by using a StringReplacer but some of the cells show an space which make the StringReplacer not working, see below an example:There’s an space between line 2 and Siding, how can I make the final result ‘CE Siding’ ?

484

8 months ago

saravanakumarSupporter

asked in Data

In Oracle writer, how to skip a feature if already available ?

Hello enthusiasts, I am trying to migrate a bulk data (assume 2Million records) to an oracle table due to size planning to split and sent them by batches. In this situation I have a certain doubts which are below, if a data already migrated to the oracle table, but next batch also have that record means oracle will through the “unique id constraint” error. how can I skip that record and move next one? Due to size of the data, i am splitting them into different batches and try to run parallel. FYI: I am migrating data into one same oracle table using oracle writer. can i run multiple workbenches (like insert1.fmw and insert2.fmw) parallelly and is it works fine or will be chances to loss data in this scenario ?WRITER using: oracle spatial object expecting your thoughts and suggestions.Thanks in advance !

372

8 months ago

ohumeniukParticipant

asked in Data

SQS Message content to workspace job.

Hello everyone! I'm a novice in FME Form/Flow. Maybe somebody can help me.I have a workspace that has multiple PostgresSQL readers, and these readers have a reference to the User Parameter in the WHERE clause.This workspace is published to FME Flow and triggered by an Amazon SQS trigger. The SQS message content is a JSON with parameters that are required for the readers in the workspace.My question is, how do I pass/parse incoming content to separate parameters in the workspace?

821

8 months ago

joe.fmeContributor

asked in Data

Batch processing metadata from SQL export to XML for use in ArcPro

Hi FME community,I’ve been tasked with trying to get the metadata we hold (in a SQL server database) into an INSPIRE-compliant format.I was hoping that we could use the metadata we currently hold (Title, Abstract, Temporal Extents etc) and run it through an INSPIRE XSD template. However, it’s pretty overwhelming when I look at the XSD templates (which I got from here - application-schemas/schemas at main · INSPIRE-MIF/application-schemas · GitHub) as there are so many nested parts (see screenshot). Is there a relatively straightforward method I could use for each topic of data (be they addresses, parcels of land etc - which have their own topic under the INSPIRE framework) which could be joined in FME and output an XML file which can be imported to the data in ArcPro? It seems a bit convoluted but I’m just trying to get an idea of where to go from here with a large shift in metadata storage and how we will be using it at my organisation going forward. Thanks

984

8 months ago

spill002Contributor

asked in Data

Request for input s- Unable to update the date field record using arcpy updatecursor in FME

Hello, I am trying to update the date field records of a feature class using arcpy update cursor, but I am getting the following error (text in bold), please let me know If I am missing anything : Field Name : e_result_datetimeField Values : 20230803081554 Field datatype : Date Also, want to mention that I am able to update the string, double data type fields using updatecursor in FME with no issues - it’s only with date data type I am facing the problem. Python Exception <RuntimeError>: The value type is incompatible with the field type. [e_result_datetime]Traceback (most recent call last): File "<string>", line 46, in inputRuntimeError: The value type is incompatible with the field type. [e_result_datetime]Error encountered while calling method `input'PythonCaller (PythonFactory): PythonFactory failed to process feature

485

8 months ago

ingallaContributor

asked in Data

ArcGIS database table watcher

Hi AllI am trying to set up a workspace to react when a change is made to an ESRI Enterprise Geodatabase table but cant figure out how to watch for changes on the table.I could set up a scheduled task to read all of the data and then a change detector to update a further table but that doesn't seem a wise use of resources, particular if there are no changes.SO any ideas how to watch this database table for changes efficiently??Regards

mr_fmeEnthusiast

Hi,I have a shapefile with lines, some of which show the degree of curvature...I would like to delete some lines based on the angle of curvature.How can I do that?

633

8 months ago

Page 20 / 272

Badge winners

grahamavardhas earned the badge Welcome Back
thomastupuivaohas earned the badge Accelerator
dani_ehas earned the badge Accelerator
andersonkhas earned the badge Accelerator
rabih.mansourhas earned the badge Accelerator

Show all badges

30,126: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.