- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,780 Posts
24,926 Replies

When you subscribe we will email you when there is a new topic in this category

6780 Posts

Recently active

Most replies Most views Newest first

charryContributor

asked in Data

split combined lines

Every two lines combined in my shp, I want to split, how I shoud do?

4 years ago

bevinc

asked in Data

How do I convert DWG to IMDF?

Hi I have an AucoCAD dwg file and tried to follow the "Converting CAD dataset to IMDF: Part 1".When I use the and I always get Test failed in Tester(Keep only Xref features).I am not a civil engineer, and get this dwg file from design company.Really need some tips or comment to help me fix this problem.Thank you so much.

How to keep field properties in FGDB class?

I have several FGDBs with same feature class and fields and I want to merge them into one FGDB, so I set Single Merged Feature Type at reader and Dynamic at writer. By setting Feature Read Mode as Metadata I can keep field alias, but I can't keep allow null values as NO, is there way to make it work?Figs below show that field properties before and after running workspaces.Before:After:

4 years ago

kees_v

asked in Data

i want multiple readers to read at the same time.

Hi,I have a database with 160 featureclasses(tables) and a total of 170.000.000 tecords. It takes a very long time to read all te data (almost 2 days). Is it possible to use multiple readers and writers who will read/write at the same time. (for example: 4 readers and writers that handles 40 featureclasses each). Or do i have to make multiple workspaces? Kind regards kees

Will my current FME Server 2018.1 play with SQL Server 2017

In the process of migrating a number of SDE databases to SQL Server 2017.... will my current FME Server 2018.1 play along? I've tried to find a simple technical specifications document online but wasn't successful. Thanks. (In other words: is FME2018.1 compatible with SQL 2017?)

4 years ago

mhabContributor

asked in Data

How to better control Excel Reader for unwanted Warnings ?

I read an Excel (.xslx) file with several worksheets in it.I specify 2 Feature Types to read, i.e. I want to read 2 out of 8 available worksheets.I get the data I want and so far so good. What I do not like is, that I get hundreds of WARNINGS for all kinds of problems which seem to exists in the worksheets I don't read.e.g. WARN |A required column was not found in the table. Row xxx will be skipped I did not want to read them and I don't care about anything in those other worksheets.Is there a way to silence the warnings for worksheets I don't read ?I don't understand why they are processed anyhow ... ThanksMichael

4 years ago

ae_jeff

asked in Data

MS Access Reader - error 2147467259 - connection string cut at space

I have a workspace that runs in Desktop, but has issues in Server.It appears that the file path for the MS Access database gets cut off at the first space character. The error message from Server is pasted below:Microsoft Access Reader: Connection failed. Connection string `Provider=Microsoft.Jet.OLEDB.4.0;Jet OLEDB:Engine Type=5;Data Source='\\\\server\\groups\\group;User ID=admin;Password=********'. Provider error `(-2147467259) Could not find file '\\\\server\\groups\\group'.' The connection string should be: \\\\server\\groups\\group name\\target database.mdbVersions:FME Server is 2019.1 - Build 19608 win32FME Desktop is 2019.1 - Build 19608 win32

Error writing to ESRI Enterprise gdb

I have a workspace that is trying to write to an Esri enterprise database (in PostGis). One particular layer errors out with An error occurred while attempting to open the table, feature class or relationship class 'xxxx'. The error number from ArcObjects is: '-2147216011'. The error message from ArcObjects is: {The SQL statement was not a select statement}I’m unclear what sql statement the process is trying to run as no ‘sql to run before write’ was specified when the writer was created.Other similar layers pass through and write with no apparent problem. Disabling that layer allows the process to run. The fields are named in similar fashion to the other layers.Esri told me to try writing out to a file gdb first (the File Geodb writer had no problem) and then read that into the enterprise version but the source format doesn’t seem to affect it. Obviously there is something the ArcSDE Geodb writer does not like about that layer, but I can't see it. What should

AGOL Reader - WinError 10061 - target machine actively refused connection

I have a workspace that runs in Workbench, but has issues in Server. I have tried reading both:Private data (via the Esri ArcGIS Online (AGOL) Feature Service Reader), as well as Publicly available Living Atlas data (via the Esri ArcGIS Server Feature Service Reader) The error messages differ slightly but are largely the same. The full text of the error message (for the publicly available Living Atlas data) is:ArcGIS Feature Service Reader: Could not connect to server. Check that you are connected to the internet and that no firewall is blocking outbound connections. The error was 'HTTPSConnectionPool(host='services5.arcgis.com', port=443): Max retries exceeded with url: /4LKAHwqnBooVDUlX/arcgis/rest/services/ParkBoundaries/FeatureServer?f=json (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x050672B0>: Failed to establish a new connection: [WinError 10061] No connection could be made because the target machine actively refus

dgn translation to shape with Bentley Microstation geographics

Hello i want to translate DGN to shape with Bentley Microstation geographicsi have many dgn files like 1.dgn 2.dgn 3.dgn etc...and many access files like 1.mdb 2.mdb 3.mdb etc... which are linked to dgn .But when i use Bentley Microstation geographics source i can put all dgn files but only one mdb file.Somebody can explain me how to do Thank you

4 years ago

garydlester

asked in Data

How to set arrow size for autocad_leader

Is there a way to set the arrow size on an autocad_leader, I see that the leader style is controlled by the Dimension styles but when I pass a name value to autocad_dimension_style_name the dimension style is not applied to the leader. Is there any other attribute to control arrow size on leader?

How to dynamically create Arcsde Feature Class with domains and dynamic feature class names?

HiI need to create in dynamic way ESRI Feature Class with domains fields. Feature Class names are dynamic so there is a problem to use XML schema template which defines only one, static feature class.I cant also import schema to Writer because FME do not import domains field definitions (am I right?) so when FME create new FC I don't get domain fields.Thanks for any suggestions

4 years ago

engineerchirayu

asked in Data

How can i see materials properties of building element in ArcGIS Pro ttribute? What should i have to do in FME Workbench to add attribute with materials properties?

How can i see materials properties of building element in ArcGIS Pro attribute? I did export IFC from Revit and translate it to shapefile but i was not able to see materials properties. So what should i have to do in FME Workbench to add attribute with materials properties?

4 years ago

jasperwisEnthusiast

asked in Data

JSON to flat table

Hi,I am new to JSON and I am trying to convert a JSON to a flat FME table.In the workbench attached, I found a way, but I was wondering if there is a moresimple way.My second question is: is there a way to convert this to a flat table without knowing the object attribute keys? Jasper

Timeout error 404 writer/arcgisonline

Hello,We use FME SERVER to transfer feature on arcgis online.We always have a problem of timeout."ArcGIS Online Feature Service Writer: Encountered an unexpected error. The error code from the server was '504' and the message was: 'Your request has timed out.'. Details: '' We try to send less packets each time bur the problem is the same. Could you help us? Best regards.

4 years ago

louisput

asked in Data

TextStroker ignores fme_rotation

Hey FME'ers, We have a problem with the TextStroker. It seems like it ignores the rotation of our text features. In attachment an example of our problem. Note that the textstroker doesn't change the fme_rotation but still the text is shifted 180° around a point different than that of the insertion point.It seems like the problem started since the update to Version_5. With version_4 there is only a slight shift in position (see attachment). I guess we could set back our textstrokers to version 4 to avoid this problem.Our FME version: 2019.1.3.0 (20191007 - Build 19642 - WIN64)we use python 3.6+ Thanks in advance!Kind Regards,Louis

4 years ago

maros

asked in Data

Export xyz ascii tab delimited.txt from DGN v8 levels into level corresponding text files

I have a v8 DGN with say 25 different levels - I need to generate xyz coordinates of these specific levels into a tab-delimited asii text file (id y x z level#).txt So i.e dgn level "post level in the dgn" will output to post.txt I need to extract the coordinates of the point features:igds_xhigh 2014161.7674759198igds_yhigh 13799548.426837647igds_zhigh 73.6230882525444 the first number from which the data came from igds_level_name 77 Insulator Attachment at Structure and YXZ of nodes from the shapes also: as seen here i tired this so far: output file is blankany help is welcome - thank you

File Geodatabase Writer not creating shape_area and Shape_length fields

Hello,The shape_area and Shape_length fields are missing when I write data to a file geodatabase. I've experimented by including these fields from a reader that is at the beginning of the workbench. That seems to work, but shouldnt the writer create these fields for me? Also, the objectid field is written, but at the bottom of the table. Shouldnt I be able to control this to be at the top?

1367

4 years ago

asked in Data

How can I set header values when using HTTP Request in FME Automations?

Is there a way to set headers for the HTTP call? Ironically I am trying to call the FME Server API, so I need to set, for example, Authorization: token fmetoken=YourTokenHere

How to write feature by feature to ArcSDE Geodb?

Hi AllI would like to perform writing feature by feature to ArcSDE Geodb. I was trying to "roll" all feature attributes into one attribute (using Aggregator and GeometryExtractor) and provide such feature via WorkspaceRunner to slave workspace, "roll out" attribute into feature definition and then pass to Writer. Is it a good direction or any other suggestions?

4 years ago

olpotosiContributor

asked in Data

Can FME move an AutoCAD layout/viewport to align with a re-positioned model space?

I have over 100 layouts that reference a model space that is improperly located. I would like to use FME to move the model space to the proper location and have the layouts follow along. However, based on my testing and this post from 2017 that teases at improved AutoCAD layout handling, it seems unlikely. I can move the layouts manually in AutoCAD if necessary but I was hoping to FME them into position. Thanks for any information/advice you can offer.https://knowledge.safe.com/articles/34345/working-with-autocad-layouts.html

Diretory and File Pathnames check file gdb for locks

I am trying to implement a workflow that will check a specified FDGB directory for the presence of .lock files and use the ownership information of those lock files to email the users to disconnect so the data can be updated. The problem is that the path_ownername attribute is not being returned by the Directory and File Pathnames reader. I have tested this in multiple FGDBs and the only time I get a value for path_ownername is when I change the extension to .atx (which doesn't help) or when I use a directory that has some older (orphaned?) lock files with last modification dates of a day or more. What method does the reader use to harvest these attributes ? Perhaps there could be a security related interference or a default permissions problem

How do i convert a CSV file to a XML?

Append multiple ESRI geodatabases into one

So I'm trying to append approx. 600 geodatabases all containing 5 feature classes with everything in the same schema. All of the geodatabases are in the same folder and I need to parse through the entire folder appending each one into the Target.gdb. I don't know much about FME, but I feel like this should be pretty straight forward. Any ideas?

Is it possible with FME cloud to watch an AGOL feature service? So that when the feature service gets modified it trigger's an FME script on FME cloud to run.

255

4 years ago

Page 91 / 272

Badge winners

leanderhas earned the badge FME Form Basic Training
jaywoodhas earned the badge Teacher (Grey)
jaywoodhas earned the badge Welcome Back
pjmerkenshas earned the badge FME Certified Professional
markjayson26has earned the badge FME Form Basic Training

Show all badges

30,109: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.