- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,811 Posts
25,085 Replies

When you subscribe we will email you when there is a new topic in this category

6811 Posts

antoineContributor

Is it possible to append to a json file saved as an Azure blob? AzureBlobStorageConnector overwrites.

FME Desktop 2020: How to permanently reorder the fields of attribute table of geodatabase feature class?

FME Desktop 2020: How to permanently reorder the fields of attribute table of geodatabase feature class? In the screenshot below, I wanted to permanently move F3 to be to the right of F1. Which tool can be of help on this?

Reading Civil 3D objects and attribution

I'm trying to read the attached Civil 3D file, extract non standard attributes and certain geometric details such as edge strings. I've attached a screenshot of the file when viewed in Civil 3D, and displayed the 'Property Sets' or attributes I want to get out. I've also attached a shot of what FME makes of the file. Anyone know how I set FME to read the attributes in the dwg and expose them so they can be worked with in Workbench?

220

4 years ago

jasperwisEnthusiast

asked in Data

read civil3D feature lines

Hi,Is there a way to read Civil3D Feature Lines in FME, without having to explode them to 3D Polylines manually in advance? Jasper

Specifying the geometry type when writing from ESRI Shapefile into PostGIS

Hi, I am using FME to write a Shapefile to PostGIS and I am wondering if there is a way that you can specify that it writes polygons only? When it is writing into PostGIS it is coming in as an unknown geometry with a warning triange!

SSH Tunnel connection fails when using JDBC driver

I am utilizing FME Cloud (Server 2020) to run a regular ETL pipeline from a Firebird database using their Jaybird JDBC driver. Working with a local instance and FME Desktop seems to have no issues with connecting and running SQL statements.The database cannot have external ports opened due to sensitive data being stored within it. However, we are able to create an SSH tunnel to a jump server that is otherwise locked down which FME Cloud could then use to create a connection. Needing to keep a secure encrypted connection throughout the entire path I have managed to load some external Python libraries and establish a temporary SSH tunnel from the FME Cloud instance to the jump server for the duration of the workbench execution. I have tested this connection by using the Firebird Python library in a PythonCaller to execute an SQL statement successfully.However, when I try to use the SQLCreator or SQLExecutor with the already established to work JDBC driver with this local SSH tunnel it fa

25712

4 years ago

oscardInfluencer

asked in Data

[FME 2019 - ACAD Reader] Error: The encoded string is not a valid fme-wwjd string

Greetings!I wanted to start using FME 2019 today with a new workflow I'ven been tasked to create. It's pretty simple: read polygons from a DWG file and store them in a SHAPE file.The source file has many layers, so my idea was reading all the layters except one (it contains texts I don't want). I have checked the "Single Merged Feature Option" and in the "Feature types to read" parameter I have picked the ones I want:When I try to run this, I get the following error:ERROR |ACAD reader: The encoded string is not a valid fme-wwjd string: 'ELC.02 - AREA DE EXPANSI\xC3\x93N OESTE'It seems the Reader doesn't like the accents in the layer names.If I use "Single Feature Types" instead of merged ones, FME is capable of reading all the features.I still have FME 2018.1 installed, so I have tried the same steps in that version and it works fine with merged features.Could this be a bug of FME 2019 (19238) or is there something new about that reader that I am missing?

Is it possible to use the '$' ASCII character on the OGC Geopackage field names?

I need to use the ASCII 36 ($) character in the name of attributes on a geopackage file. In the direct way is it impossible, because the Use Attribute pane of the Feature Writer for geopackage changes the '$' char into a '_'; same story using an opportune schema in 'Dynamic Schema Definition'.Is this a FME bug? Is there a way to workaround this issue?

4 years ago

bigapplerizzi19

asked in Data

How to apply attribute to CityGML writer with ADE schema

I specified a ADE schema file in CityGML writer and tried to export a attribute to a attribute of cityGML difined by ADE.Then the attribute generated as follows: <gen:stringAttribute name="aaa_extended_attribute{0}.aaa_key_value_pair_aaa_key"> <gen:value>1</gen:value></gen:stringAttribute> <gen:stringAttribute name="aaa_extended_attribute{0}.aaa_key_value_pair_aaa_key_codeSpace"> <gen:value>../abcde.xml</gen:value> </gen:stringAttribute> <gen:stringAttribute name="aaa_extended_attribute{0}.aaa_key_value_pair_aaa_string_value"> <gen:value>XXXXYYYYZZZZ</gen:value> </gen:stringAttribute> The results I'm expecting are as follows: <aaa:extendedAttribute> <aaa:KeyValuePair> <aaa:key codeSpace="../abcde.xml">1</aaa:key> <aaa:stringValue>XXXXYYYYZZZZ</aaa:stringValue> </aaa:KeyValuePair>

180

4 years ago

dms2Contributor

asked in Data

FeatureReader vs Reader : Esri ArcGIS Server Feature Services

I can't connect to a specific ArcGIS Server feature service using a FeatureReader.I get the service layers listed as output ports but when I execute the translation it throws this error:ArcGIS Feature Service Reader: Encountered an unexpected error. The error code from the server was '400' and the message was: 'Failed to execute query.'. Details: '' Using a Reader instead all service layers are read without problem. I don't understand why the Reader connection works different than the transformer. Any idea?Generally I would stick to the Reader connection and forget about this weird thing but I prefer using a FeatureReader here because I need to catch any error and work further with it in the translation.

Save .shp multipolygon to .wkt file

Hello, I am trying to save multipolygon .shp file to .wkt file. See attachment. Is it possible to save the output of my workbench directly to the file with extension. wkt? I noticed that .wkt Reader exist, but I cannot find Writer. I know that I could save it to .txt, but it doesn't solve my problem because in the next step of the process I need to seed this file to external tool which reads only file with .wkt extension. I would like to avoid manual step of changing .txt file extension into .wkt as I would need to do it multiple times.

How to retrieve M-values from ESRI-JSON ?

Hi, I have a ESRI-JSON file which geometry looks likes this: "geometry":{"hasM":true,"paths":[[[333334.24000000209,6611588.879999999,0], ...Note that the hasM property is true.I am trying to convert that file (among other operations) but when it is read by FME it seems that the third coordinate is parsed as a Z value and not as a measure: Where I should expect something like that (2D but with true measure): Question: how to deal with that data to output a true M-Value? I am thinking of two approches:Find a proper setting in the ESRI-JSON reader what would parse the M-value as a true measure and not a Z ; I did not find that kind of settings if it existsLet the reader as it but find a way to transfer/copy the Z value into a M value using transformers; I did not find the proper method yet Any thoughts about this? Thanks a lot!Jean

Compress delta tables in ArcSDE Enterprise geodatabase using FME?

Hello all, I'm wondering if anyone has any suggestions for using FME to compress the delta tables of an ArcSDE enterprise geodatabase? I'm thinking it could be achieved using the python caller to run the ArcPy command for executing the compression. Does anyone have and suggestions or best practices in this area? Thanks!

Hi! Is there a way to change the "else if" condition statement to an "if" condition? I want to assign two values to the same element and with the "else if" I just assign the first value.

160

4 years ago

deanhowellEnthusiast

asked in Data

Unsupported font Family

Hello FME Support,Is there any news on the 'Unsupported Font Issue' in the PDFWriter? https://knowledge.safe.com/questions/2007/unsupported-font-family-message.html We need to be able to read DWG drawings in a range of True Type Fonts but it keeps failing and reverting to Helvetica when writing to PDF.

how to efficiently build a geological voxel model?

Hi, My name is Jie, and I'd like to build a geological voxel model as the following picture copied from the question asked by @philip_wehrens . I want to know how to efficiently build a model like this? With this model, I want to export the model for Finite Element Analysis. To be specific, The finite element code is developed in Matlab. All the best,Jie

Postgresql not showing geometry

Hello,I have a table in Postgreql with geometry that I can perfectly load in QGIS but the FME reader doesn't show the geometry. The allowed geometries is postgres_none but they are polygons. What am I missing? TIAJonathan

1600

4 years ago

jugoslaviaaSupporter

asked in Data

Clipping .DWG with polygons

I have multiple .dwg files and a shape while which consists of polygons (Grids). I would like to clip the dwgs by the polygons and save them to individual new dwgs. I tried Clipper and LineOnAreaOverlayer. However, quite a lot of objects are rejected as I have different geometries in it or objects like in the image How can I clip all objects in the dwg regardless from object types? Thanks in advance.

430

4 years ago

fnealContributor

asked in Data

What would cause Esri ArcGIS Pro interpreters not to show as available in the drop-down list?

I am unable to see any ArcGIS Pro python interpreters available in Options>Translation. I have Pro 2.6.0 installed and FME Desktop 2019.2.3.2.

4 years ago

sprongandre

asked in Data

DGN to DWG; how do I get 3D solids in stead of meshes?

I would like to export the DGN-meshes to DWG-solids.The strange thing is that not all the DGN-meshes become solids in DWG.I don't get it why :-S. Attached is the test dgn and my workbench.Could somebody take a look and change the workbench so I will get all 3D solids in the DWG? That would be great! Thanks!

Reading AGS/Text file in FME

Hello, I am trying to create a reader to process AGS 4 data but am struggling with it a bit.For those who haven't encountered the data before, I have included an example below.When opened as a text file, the data is all in one column. It is grouped into sections that define a subsection of the overall dataset. These sections always start with the "GROUP" header and end with a empty line before the next group header. Fortunately, the groups always follow the same pattern: "GROUP" = Name of the group"HEADING" = The different data headers (These would be the column headers if brought into excel)"UNIT"= The Unit of the header"TYPE" = The Data type"DATA" = The actual data for each header. "GROUP","GCHM""HEADING","LOCA_ID","SAMP_TOP","SAMP_REF","SAMP_TYPE","SAMP_ID","SPEC_REF","SPEC_DPTH","GCHM_CODE","GCHM_METH&quot

1170

4 years ago

g_karssenbergContributor

asked in Data

Timeout using SharePoint Reader on FME Server

We have a workspace scheduled multiple times per day, from 6 AM till 6 PM every two hours. This workspace reads information from a SharePoint site (on-prem) using the SharePoint Reader.All schedules are running OK, apart from the first one at 6 AM. We get the following error every day:2020-03-11 06:00:54| 1.0| 0.0|ERROR |Python Exception <ReadTimeout>: HTTPSConnectionPool(host='xx.xx.com', port=443): Read timed out. (read timeout=20)We did some checks on the FME and SharePoint side on the machine, but did not see anything that could cause the timeout. What could cause this?In addition: the timeout setting appears to be fixed at 20 seconds. Is there any way to modify that? FME Server 2019.0.1 Build 19253 - win64 - patch 1FME Desktop 2019.0.1.0 Build 19253 - WIN32

Can I maintain GlobalIDs in ESRI File Geodatabase

I am merging data from and existing ESRI File Geodatabase with data form excel spreadsheet using globalID. I then want to write that data to new ESRI File Geodatabase, preserving the GlobalID from the existing fGDB. I can see this is possible in SDE. is there a way I can do this in non-SDE fGDB. I am using FME version 2019.1

1130

4 years ago

umapper1Contributor

asked in Data

Why does newly created attribute not show up in Visual Preview after run?

Hi there, I'm curious as to why the newly created attribute in my workspace is not showing up by default when I go to the visual preview table view. I've had this happen before but I cannot find what governs this. Is there a toggle? The default behaviour should be that it shows up in the table so I can see that it's been created. I can find it in the list of available columns but it is a pain if I'm having to rerun the routine a lot. Anyone know how to change this? Using ver2020.1 but have experienced this issue on previous versions. Below example of my new attribute "Quality Level".

Extracting all coordinates/vertexes for a line (a street) in SHP

Hello, I have a shape file with few streets and I would like to extract all coordinates forming each line/street inside a new Attribute. Taking a look at picture attached, I would like to copy all sets of coordinates from IFMELine to a new attribute that I will be creating.Any ideas how to solve this issue? Thank you very much!

190

4 years ago

Page 59 / 273

Badge winners

abhishekethas earned the badge Expert (Grey)
koronada92has earned the badge Teacher (Grey)
koronada92has earned the badge Student (Grey)
abhishekethas earned the badge Teacher (Grey)
abhishekethas earned the badge Student (Grey)

Show all badges

30,530: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.