- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,429 Posts
23,792 Replies

When you subscribe we will email you when there is a new topic in this category

6429 Posts

Recently active

Most replies Most views Newest first

solyContributor

how to find duplicate of specific column ?

Hello , i would like to find duplicate of specific column As exampleColumn A contain 256789 - 45674567 - 256789256789 - 4567i would like to find all duplicate values at column A ,consider the values as duplicated in case a-b or b-a i mean , 3 above values are matched .How could I achieve it ?thanks in advance FME 2021

solyContributor

how to show the graphic from excel file ?

hello ,i would like to save geometric data into excel file then I read the excel file in arcmap ,It shows me the attribute tables and location of lines .How to achieve it ?fme 2021thanks in advance

manojse07Contributor

Help with reading blob from db3 file using FME

I am attaching a sample db3 file that I am using for a project. This db3 file contains many fields of blob type. The table, field of my interest are as belowTable Name: CURRENT_TAGField Name: _TAGOBJ_SUBSTATIONGIDselect _TAGOBJ_SUBSTATIONGID from CURRENT_TAG where _TAGOBJ_GID = '145242397947723855';This particular record in my application shows this value “151433541765593417”But in db3 file it is actually stored as blob. How do I decode the blob as text? I tried to use online tools to convert this binary to text - it doesn’t work. Also, how do I know the data format that is stored as blob - is it either image, xml, json etc.?

jesselangdonContributor

Splitting bulk features into individual features when performing simple copy of annotation between File GDBs

I am trying to do a very basic read/write of an annotation feature class from one file geodatabase to another. In my case, I’m first running a PythonCaller transformer to remove any and all annotation feature classes in the target file geodatabase, then I use a FeatureReader to read the annotation feature class from the source file GDB, and then run a FeatureWriter to write the annotation FC to the target geodatabase with “Insert” and “Create if Needed” options selected for the table, which I assume is creating a new annotation feature class in the target FGDB.Regardless of minor tweaks I make to both the FeatureReader and FeatureWriter transformers, FME Flow keeps writing these as individual features instead of bulk features. There are ~450k annotation features in the feature class, so running this by writing individual features takes over an hour, which will not work for our scenario.Interestingly, the first time I ran this in an earlier workspace, FME Flow used the bulk feature sett

muzhnastoContributor

Extract an attribute from geometry definition using Python

Hi, when opening fbx in FME, I see a property with a description of the material in the geometry parts (pay attention to the line highlighted with a marker) FME has a python interpreter, with its own classes and functions.I have already pulled out the coordinates of the points, in the code belowimport fmeimport fmeobjectsFeatureProcessor class (object):def __init__(self):passesentering def (self, feature):all_geom = function.getGeometry()first_part = all_geom.getPartAt(0)if type(first_part) == fmeobjects.FMEMesh:meshs = first_part.getAsMultiSurface()vertices_list = first_part.getVertices()textur_coord_list = first_part.getTextureCoordinates()textur_length = len(textur_coord_list)if textur_length > 0:for trian_mesh in first_part:ver_index = trian_mesh.getVertexIndices()textur_index = trian_mesh.getVertexNormalIndices()newFeature = fmeobjects.FMEFeature()pnt1 = vertices_list[ver_index[0]]pnt1_t = textur_coord_list [textur_index [0]]newFeature.setAttribute('X1',pnt1[0])newFeature.setAt

schulte.aContributor

How to query all add/delete tables in SDE and have a count of each as a row in the output

Hello, I am trying to create a workbench that will read in all our add/delete tables from our SDE, do a count on the running total of records for each, and export a spreadsheet with the table name, and the counts in each,I’m using a SQL Creator and my SQL statement is something like SELECT COUNT(*) FROM <tablename>,and right now that's not returning me any value even though it was successful? Also, how would I go about coding out to add the next table in?would it be:SELECT COUNT(*) FROM <tablename>unionSELECT COUNT(*) FROM <tablename2>unionand so forth?also for background:We use Microsoft SQL Studio, and I chose the connection as a spatial server.Thanks for any help!

user01Participant

Generate incrementation from column max value

Hello,I want to generate an incrementation from the max value of a column in order to not have duplicate values. The _max value column is not recovered in the counter for the 50 duplicate features : Any idea ? Thank you

pauldParticipant

Split text into parts based on text number

Hi, I have a text string that looks something like this…LOT 4-6 DP 287 SEC 2-3 SO 345152 I have a regex “(LOT \d+[\s?&-]\d+ DP \d+ ){1,}” that grabs the LOT 4-6 DP 287 from the text line.How can I split the 4-6 into separate attributes so I end up with Lot 4 DP 287 Lot 5 DP 287 Lot 6 DP 287I could do it with a testfilter but there are unknown combinations. 1-12, 60-62, 78-82 etcAny help is greatly appreciated.Regards, Paul

seanclarknerParticipant

Merge features from Table A using a field value to Table B if the Table A value matches one of a set of comma delimited values in a field in Table B

A have one dataset (Dataset A) that has contains fields, one of which is CityName; example value “Sudbury”. I have another dataset (Dataset B) that contains a field made up of comma delimited AltNames; example value “Gran Sudbury,Grand Sudbury,Sudbury, etc.I need for these features to be joined in one dataset if the value in CityName matches any one of the comma delimited names in AltNames, however different records have different numbers of alternate names and it cannot match with a section of a comma delimited value. For example, Sudbury != Grand Sudbury.I think that lists may solve this but I’m not familiar with the transformers that might enable this process.

fmesafe.podporaContributor

Sequential processing of elements

Hey. Do you have any idea how to solve the sequential processing of input elements on HorizonAngleCalculator? If I have several elements on the input of the Horizontal Transformer, I need one element to be processed and then the next element to follow after that element is processed. After that, I would put a featureholder after the HorizontalAngleCalculator and it might work. I've tried testing the featureholder with counter and filtering features that have already been processed, but somehow I can't get it to work. Thank you very much

Bentley i.dgn files to Synchro Pro .sp file

Good morning,I have a lot of files to convert from .idgn (Bentley) format to .sp (Synchro Pro) file format.To do that in microstation, there is a specific plugin from Synchro to do that.I am looking a way to do that automatically for a lot of files at the same time, so I was thinking FME.I am not a FME expert but do you think it is possible to configure that ?Thank you.Best regards,

pauldParticipant

Update a list element base on another list element

Hi.I have a file of text strings that have multiple ‘parts’ that I have split into a _list. Example text string... LOT 9 DP 19723 LOT 12 DP 384274 LOT 8 DP 30287 LOT 9 DP 2402 PT RS 17343 17491 BLK VII X XI TENGAWAI SD-TIMBER NOT ASSESSEDUsing string searcher, I have formed a list of the formatted string to push into the list using regex: (LOT \d+ DP \d+){1,}The result is a list containing the:appellation:LOT 9 DP 19723 LOT 12 DP 384274 LOT 8 DP 30287 LOT 9 DP 2402 PT RS 17343 17491 BLK VII X XI TENGAWAI SD-TIMBER NOT ASSESSED matches: LOT 9 DP 19723 LOT 12 DP 384274 LOT 8 DP 30287 LOT 9 DP 2402 What I want to be able to do is remove the matched part from appellation on the way through leaving me with both the matches as individual features, and a subset of appellation with the matches removed. The resultant appellation in this example would be: PT RS 17343 17491 BLK VII X XI TENGAWAI SD-TIMBER NOT ASSESSED I would be very grateful for any help with this.Regards, Paul

mmccartContributor

Does FME 2024.0 Support Esri's New Big Integer Field Types When Creating New Dynamic Feature Classes?

I have been using Dynamic writers to create feature classes and tables in an Esri File Geodatabase for years. I normally use the FME field type “fme_int32” to create Long Integer field types. However, I need to create attributes using Esri’s new ‘Big Integer’ field type. I assumed I could use “fme_int64” but when I run my workspace in FME 2024.0, it runs without errors but it doesn’t create the new feature class. When I change the 2 fields from fme_int64 back to fme_int32, it runs without errors and creates the new feature class. I have ArcPro 3.2.2 installed which also supports the new Big Integer (64 Bit) field types.My question is: Should I be using a different FME Field type besides ‘fme_int64’ to generate Big Integer field types via a Dynamic FGDB Feature Class Writer?Thanks in advance.

boron013Participant

DGN Smart Solid - Solid interpolation to mesh

Hello,I’m working in FME Form (both tested in 2023.2 and 2024.0 ) with DGN files contaning 3D objects in Smart Solid format.I’m looking for some possibility in controlling solid to mesh decimation process. At the moment I can’t find any way to change default way how FME Reader create mesh from solid objects.For example some circular object is decimated as 8 vertices.I’ve already tested Stroking Tolerance without any effecthttps://docs.safe.com/fme/html/FME-Form-Documentation/FME-Form/Workbench/Stroking_Tolerance.htmand “Number of interpolated curve vertices” in DGN Reader parametrs. Any suggestions?

jeroen_hackContributor

WFS GetFeature Error, but still get results

Hello FME enthousiasts, I've been building a simple workspace for a collegue to get some parcel data from a public WFS. When I run the process it all seems to work (i get the desired parcel written to a File Geodatabase). But it keeps giving a single WFS error in the log, but the error apparently doesn't stop it from running:<WFS> GetFeature URL: `https://service.pdok.nl:443/kadaster/kadastralekaart/wfs/v5_0?SERVICE=WFS&VERSION=2.0.0&REQUEST=GetFeature&TYPENAMES=kadastralekaart%3APerceel&FILTER=%3CFilter%3E%3CAnd%3E%3CPropertyIsEqualTo%3E%3CPropertyName%3EAKRKadastraleGemeenteCodeWaarde%3C%2FPropertyName%3E%3CLiteral%3ERNN01%3C%2FLiteral%3E%3C%2FPropertyIsEqualTo%3E%3CPropertyIsEqualTo%3E%3CPropertyName%3Esectie%3C%2FPropertyName%3E%3CLiteral%3EK%3C%2FLiteral%3E%3C%2FPropertyIsEqualTo%3E%3CPropertyIsEqualTo%3E%3CPropertyName%3Eperceelnummer%3C%2FPropertyName%3E%3CLiteral%3E36%3C%2FLiteral%3E%3C%2FPropertyIsEqualTo%3E%3C%2FAnd%3E%3C%2FFilter%3E&OUTPUTFORMAT=app

siggisObserver

problem reading WFS 2.0

WFS 2.0 services are available on the Geoportal Baden-Württemberg. It is not possible for me to view/download the contents of the objects (BP_Plan) with the WFS Reader using FME 2023.Does anyone have any idea what the problem might be?Example:https://geodienste.komm.one/ows/services/org.165.d5516855-2ef7-4512-92f7-68d208f6f722_wfs/org.165.15f5882e-891a-4ce4-b2fc-000a45978e11?SERVICE=WFS&Request=GetCapabilities

Help reading attributes from multiple dwg. files

Hi there,I am fairly new to FME. I have around 6000 dwg. files regarding the same industrial drawings and the data is roughly found in the same place in each file. I would like to know how i can extract the attributes that i need out of these files.I have started using a wildcard function to read multiple files. I know this question is fairly vague, still I was wondering if anyone has the time to help me with this, or knows any recomendations for explanation (youtube or similair examples/workspaces) Like I said, FME is still pretty new to me so any advice would help. Thank you

j.m-vismaParticipant

A little help exposing attributes in a JSON

I am making a call to an API and getting a JSON in return. With the JSONFragmenter and it's flattening options, I can expose most of the attributes in the JSON into FME attributes, but I am getting stuck on a particular structure. Sometimes there's a little table within a single attribute in the JSON like so: "related_objects": [ { "relation_name": "verbinding", "relation_id": 1, "objects": [ "randomid1", "randomid2", "randomid3" ] } ] This indicates objects that are related in a particular way to the object in my query. I would like to generate a list of all of the related objects (randomid1, randomid2 etc.). I want to use that list in my FME flow. The number of related objects might be one, or a hundred, in this case it's three.How do I make FME turn that littl

asablombergContributor

GeoPackage, Failed to add data - no such table main.GDB_Items

I am writing a geopackage file in FME but when I try to use it in ArcGIS Pro I get this error message. Any idea what could be wrong?“Failed to add data ...main.GNG.anlaggningsomrade. Invalid parameter value passed to function[no such table: main.GDB_Items}”FME Workbench 2022.2.2ArcGIS Pro 3.2

alisonsepContributor

AGOL writer-is there a limit?

Hi, I have one Form workspace that writes to a hosted feature service on AGOL fine. It is set at insert and Truncate. It writes a little more than 9,000 features and I run it every week without issue. However, I now have a different hosted feature service on AGOL that has +23,000 features. When I try the same process to update it, it drops all the data and only ends up writing out 15,000 records at most. The number of records diffs as well. I have tried adjusting the timeout and features per request, but have not been successful in achieving the full write out. Any suggestions would be appreciated.

fmesafe.podporaContributor

Sequence of points

Hey. I need some advice, or at least direction, on how to solve a complex problem. See attachment: I have a track. The track consists of waypoints, the waypoints are minisegments which consist of a startpoint and an endpoint and these minisegments form one big segment and these big segments form one complete track. The direction of the "flow" of the points is determined by the number of startpoints and endpoints, see below, where we see that the only possible direction is from A to E, since it must connect startpoint to endpoint between the minisegments, which form one segment out of three. The waypoints of one of the segments at the level of the points that make up the minisegments look like this - A, F, C, E: Startpoint: AEndpoint: FStartpoint: FEndpoint: CStartpoint: CEndpoint? EThe problem I'm solving is that some segments have this sequence of startpoint and endpoint reversed in the source data, so that the sequence of points of one of the segments would look like this: E, C, F, A

jinseokContributor

Issue of visualization failure after data conversion (obj to citygml /obj)

We have tried to export(write) an obj 3D building file to dae / citygml / slpk file formats, and all three of the conversions were successful.However, only the dae format was successfully visualized in a viewer, and citygml/slpk failed to visualize with the viewer that supports the formats.Could you give some advice for this issue?CASE1 - obj to citygml (failed to visualize)input 1784_OBJ.zip output 1784_CityGML.zip output import view capture (KITModelViewer) No geometry information, only attribute information can be verified CASE2 - obj to slpk (failed to visualize)input 1784_OBJ.zip output 1784_slpk.zip FME Capture output import view capture (ArcGIS Pro)

Write an IFC in Postgres with Postgis extension

Hello, I have an IFC file I wish to import in Postgres(PostGIS extension) to go through spatial analysis. Oriinally, what I did was to convert the IFC to a 3DGIS compatible format (GML) and import it in Postgreswhich was successful. Exploring a little more, I saw that Postgres supports the solid geometry type of FME and I performed the same conversion, without converting the geometries to b-rep. This photo shows the input in Postgres and this photo shows the output when I am reading it from Postgres. The highlighted part is visualised differently. I couldn't help but wonder the reason why.Could you please help me figuring this out?Thank you, George

Data Inspector 2023 can't read ArcGIS Pro FileGDB

I’m trying to use the Data Inspector to inspect data in a Pro-generated file geodatabase. I’d get these errors which prevents any dataset from coming in.I’m on ArcGIS Pro 3.1.3. Dialog window:“Failed to open datasetEsri Geodatabase (File Geodb) dataset ########### could not be opened as configured. See log window for details. Remove it from recent dataset list?“Log window:An error occurred while attempting to open the table, feature class or relationship class 'Administrative_Lines'. The error number from ArcObjects is: '-2147211773'. The error message from ArcObjects is: {The item does not have a definition.}It could have failed to open because it contains ArcGIS Pro-only features, for example Arcade expressions. If this is the case, please install ArcGIS Pro or Pro-compatible ArcGIS Server and 64-bit FME. If already installed, set the Esri ArcGIS Compatibility setting for this workspace to 'Esri ArcGIS Pro' under Navigator -> Workspace Parameters -> Translation From FME Form, I

jtermaatenContributor

How to use Deployment Parameters in a FeatureReader to reference a Custom Resource with a local value set to a Share?

We're using FME Flow 2023.1.2.We have got a Windows Share registered as a custom resource at FME Flow, which is locally accessible as a UNC path. I'm looking for a way to reference the custom resource in such a way that it locally uses the UNC path and at FME Flow automatically uses the resource. I believe I can use Deployment Parameters for that.When I create a Deployment Parameter and use it as part of the path in a FeatureReader, it doesn't recognize the file I'm trying to reach, though I did fill in the local value of the Deployment Parameter.Deployment Parameter Value: $(FMEShare) Deployment Parameter Local Value: \\computername\shared_folder\ Reader Path: $(FMEShare)Subfolder\file.xlsxI tried to create an attribute _pathExcel that is set to the path I tried to fill in in the FeatureReader. Locally that worked, but at FME Flow I got this error message:Too many recursive macro substitutions -- line currently is: `$(FMEShare)'How can I tailor this method to get it to work? Thanks!

1
2
3
4
...
258

Page 1 / 258

Badge winners

allisonlehnhas earned the badge Student (Grey)
chelseawuhas earned the badge Student (Grey)
pcarrerabalsellhas earned the badge Teacher (Bronze)
pcarrerabalsellhas earned the badge Student (Grey)
pcarrerabalsellhas earned the badge Teacher (Grey)

Show all badges

28,670: Posts

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.

Username or e-mail

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK

A product of

Company Products Giving Back Careers Contact Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.