- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Form
Data

Data

Using readers and writers to extract and load data.

6,808 Posts
25,080 Replies

When you subscribe we will email you when there is a new topic in this category

6808 Posts

How to remove characters from JSON list?

I'm really struggling with the string functions in FME at the moment. I have a workbench reading JSON features from an API and I have one attribute where the results are in a list. The JSON extractor results the attributes like this: ["Medium"] Or if there are multiple values, like so:["Easy","Advanced"] I want the results to be: MediumIntermediate,Easy I want to remove the brackets and quotes using a single transformer and can't figure out the formatting for my life! Currently I have 3 separate "string replacers", each one removing a single character, but there must be a better way...I don't mind using a REGEX expression if someone can figure it out. I'm also open to using a different type of JSON query to extract these values? If there's a way to get the attributes without the brackets and quotes? I also tried using the string pair replacer but I constantly get an error, and I can't seem to format it properly. I wish yo

1444

3 years ago

tim_bkrParticipant

asked in Data

Resolve geodatabase domains

Hi,I was looking for the way to resolve geodatabase domains from a reader.It took me a while to find this post https://community.safe.com/s/question/0D54Q000080hOcnSAE/how-to-expose-a-file-geodatabase-domainFor me, Updating feature type solved the problem but I'd wish FME would give the user hint that he needs to do this feature type update.Here's the thing in more words :When you add a gdb feature class or table which has fields with domains, if you don't check the option "Resolve domains", the table is added with the codes, and that's all and that's normal.But then if you want the domains and in the parameters you check "Resolve domains", then you need to Update feature type to get the _resolved fields.I think the user should at least be getting a warning that he needs to Update feature type.Cheers,Tim

How to export Smallworld Internal Objects

I am using a Smallworld Edition of FME, version 2017. How do I use it to export internal objects and have it reference back to its world owner.

500

3 years ago

dhaulagiriContributor

asked in Data

How to write a PostgreSQL table with an generated column?

Hello,FME throws an error when I want to write to a PostgreSQL table that contains a generated column (value calculated from another column). Message: generated columns cannot be used in COPYIs there any way to ignore this column (by clearing the column from the writer, the error still occurs) or work around this problem?Thanks for your help

Informix reader WHERE clause in 2021.1

I have workspaces authored in FME2018 that use informix spatial readers. In 2018 I am able to set a WHERE clause within the FeatureReader. In version 2021.1 I can no longer do this as the WHERE clause option is greyed out.Is this a known bug or intended behaviour?

How to solve HTTP Status 405 Error

I am getting a HTTP status 405 error when I try to generate a GEOPDF using the link http://arcgprdcgy001.network.lan/fme/GenerateGeoPDF/. It says: HTTP method GET is not supported by this URL. The method received in the request-line is known by the origin server but not supported by the target resource.

510

3 years ago

swethabhupathiContributor

asked in Data

is fme supprort to read Arcgis Pro file formats (like aprx, lyrx,mpkx,etc.,)

i want to read an aprx or lyrx file in fme . is it possible?

2310

3 years ago

fbastian73Contributor

asked in Data

hello experts, I am trying to make my workbench output the result data into an already existing folder of the same name as the data file. How can I implement something like this?

I have attached the actual workbench below. SO in more detail, what I am trying to do is to output fanned out (by council name) shape files and GDBs to an already existing folder (of the same name as the council name attribute) on a drive somewhere. Is there a way to direct the output data to go into the different council folders when this workbench is run for all councils?The intention is to place this in the server and then schedule it to run on a quarterly basis.any thoughts?thanking you in advance.

3 years ago

tnarladniEnthusiast

asked in Data

adding multiple child elements xml to existing xml or replace value if tag exists from excel

I have an excel spreadsheet with 3 columns (featureclass, tag, summary). I want to update the metadata.xml file that corresponding to the featureclass. These xml files are embedded in a column in an sde table gdb_items. I'm able to extract the xml, but I don't know how to add xml elements. I have seen the xmlUpdater which works but only when that tag exists in the xml. Also, the "tag" field in the excel is a list of tags separated by commas. I need to create multiple <keyword> tags, one for each item. Here's my workspace so far. shows the xml without the existing "summary" and "tag" <idPrup> <searchKeys> with child nodes <keyword>, respectively shows xml with those nodes (lines 80 to 86)

Convert DWG solid colors to OBJ

I'm trying to convert a DWG with solids to an OBJ mesh.The conversion is good but the OBJ doesn't include the color of the solid ("autocad_color"). I tried GeometryColorSetter but I can't seem to set it up properly.I also tried the AppearanceSetter, following this post: https://community.safe.com/s/question/0D54Q000080he8G/how-to-set-the-color-of-an-ifc-objet-ifcproxy but I can't set it up correctly Could you give me some suggestions on how to setup the transformer GeometryColorSetter (or a better one) so that it takes the "autocad_color" of the geometry and gives the same color to the resulting obj.

330

3 years ago

dor1411993Contributor

asked in Data

2-step verification for Fme Server Apps

Hello everyone! I have a question regarding information security in server applications. Is it possible to perform 2-step verification for apps with sensitive Data? There is of course the access using a username and password that I set. Is it possible to do another step for verification via email, for example?Thanks!

Why can't FME data inspector read my Locusview gdb dataset?

I have a gdb (ESRI) dataset from Locusview which QGIS can read fine but FME Data Inspector (2019) says there is a file missing, but doesn't say which. The key part of the errors seems to be: "2021-08-26 05:19:36.616 ERROR - Geodatabase Error (-2147024894): The system cannot find the file specified." Log reads as follows: 2021-08-26 05:19:20.981 INFO - FME Data Inspector is starting up...2021-08-26 05:19:29.189 INFO - Loaded module 'fmeprompter' from file 'fmeprompter.dll'2021-08-26 05:19:36.204 INFO - Creating reader for format: Esri Geodatabase (File Geodb Open API)2021-08-26 05:19:36.278 INFO - Trying to find a DYNAMIC plugin for reader named `FILEGDB'2021-08-26 05:19:36.279 WARN - FME Configuration: Maximum of 2000000 feature(s) will be read starting from feature number 12021-08-26 05:19:36.613 INFO - Loaded module 'FILEGDB' from file 'C:\\apps\\FME2019\\plugins/FILEGDB.dll'2021-08-26 05:19:36.614 INFO - FME API version of module &#

Check multiple DWG versions

Hi, I'm trying to create a workspace to check multiple DWG versions, Iäve tried Real DWG reader and others, but cannot find the attribut that tells me the version. I made a picture below.Select multiple DWGs to readCheck The DWG Version with a testerOutput filename and check if version is 2013 as en excel(or user selected version test check)My issue is mainly finding the version at all and making it into a tester

I3S LODs and ArcGIS online, LOD, visibility issues

Hello,I'm wondering if anyone is actively using I3S files from FME in ArcGIS online. I ran into some issues, where depending on the camera position, some meshes disappear. Like this: https://i.imgur.com/R9PMcj3.gifvIs this maybe because of missing LOD defintions?

3 years ago

p.jeremieContributor

asked in Data

Oracle writer column does not exist in table

Hi, I am updating an existing table (in fact updating/inserting/deleting with fme_db_operation, created with ChangeDetector). All data is well updated, all coming from my revised source, on all columns of my destination table. However, I have a lot of warning telling me that the column xxxxxx does not exist in table XXXXXXX.In the database, the columns exist, of course. I am using a FeatureWriter and the feature types have been imported from dataset, Oracle Spatial Object and selecting the tables.All columns are not updated (some have the red triangle, other the green one). Any idea why I get these warning, whereas the columns are well updated ?

1005

3 years ago

fmelizardContributor

asked in Data

How do I get the folder name for my features stored in a KML/KMZ file?

When I open my KML file in Google Earth, I can see the data displayed in folders in the table of contents. When I use the KML reader to read the data, that folder name doesn't show up on my features. How do I get that out?

swachContributor

I am creating a mosaic from a bunch of tiff files into an ecw. The shape of all the tiffs together is irregular so there is empty space. It is defaulting to black, I would like it to be white. This seems like it should be an easy fix but I can't figure it out.

ArcGIS Online Reader/Writer Error: Code 503

Hello,So we have some workbenches (FME 2018.1.1; 20181203 - Build 18578 - WIN64) that either read or write to AGOL after performing a bunch of operations on the data. These workbenches were working fine up until a week ago, when all of a sudden they started throwing a very generic 503 error message and failing completely.If I understand correctly, a 503 means it's a server side error (so it's likely something with ESRI), right?We've been having issues with our organization's ArcGIS Online portal for the last couple of days (layers being randomly dropped from maps, apps refusing to load) and I'm starting to think that their December 2018 AGOL update messed some things up, including the way FME's readers/writers communicate with it. Is anyone else having trouble working with AGOL lately?Thanks!

Point coordinates cannot be infinite error

Hello!Once again, I've come across an error I have never seen before and can't find online.I'm adding a new ArcGIS Online feature layer to an existing workbench, which matches points inside polygons (using the PointOnAreaOverlayer) and gives the points the project number attribute from the polygon.This works fine for all the layers inside it, but this new layer gives the following error:ArcGIS Online Feature Service Writer: 'updateResults' error for a feature in '<layerName>'. The error code from the server was '1000' and the message was: '24126: Point coordinates cannot be infinite or not a number (NaN).'I checked the point which was sent to the layer (using the feature caching), it shows on the map just fine and according to the attributes it's an IFMEPoint. But at the end of the coordinates it shows <nan>, regardless of the X, Y and Z values. The main difference between this layer and the others is this one is the first with a Z-value attached. So I expect that's the pro

IFC to Cesium 3D Tiles - geometry colors disappearing

Hello everyone, I recently updated to FME 2019, since then the IFC - Cesium3DTiles conversion does not preserve geometry colors (it was working fine with FME 2018). I think the problem comes from the Deaggregator. When I inspect the IFC, colors are preserved, but they disappear right after the Deaggregator. Has someone got into the same issue ? Thankssj

Creating ESRI Vector Tiles in ArcGIS Online sing FME

Is it possible to create ESRI Vector Tiles in ArcGIS Online using FME. I'd like to read from a database feature class for example, and keep an ArcGIS Online Vector Tile layer up to date with period updates. I can only seem to create and update ESRI Vector Tiles in ArcGIS online from ESRI PRO or possible write a script in Python3 and use the ESRI GIS API, in which case I don't really need FME.

Bad geometry detected in the following feature; Geometry could not be encoded for Oracle

Hi, I am using a bufferer and a dissolver transformer to generate a buffer polygon from an aggregated set of 500+ geometries. The Inspector is showing the generated geometry but the Oracle Spatial writer is unable write the geom into the spatial table. I am getting the error "Bad geometry detected in the following feature; Geometry could not be encoded for Oracle". I have added a GeometryValidator after the Dissolver transformer. The generated geom comes through the PASSED output but still the error remains. FME Desktop 2013 is used. Regards, Ananda

Processing with the Microstation DGN with TAGs

I have decided to understand how to resave DGN file with tags using FME. I have dowloaded some files from this article (https://community.safe.com/s/article/writing-microstation-dgn-tags-with-fme#AdvancedExample) and ran it. It works correctly, but when I decided to change data to display into Microstation, I got NOT displayable data into DGN file. Before and after my changes into AttributeKeeper and AttributeCreator transformers: Owner.x_offset and Owner.y_offset are created too. Before and after my changes there are some differences between output DGN files even while trying to enable display option for new tag: Openning modified DGN file into FME, diffences are so big:Reader configurated like: And Exposed some hidden attributes I get:Owner.color = 0Owner.display = noOwner.justification = 2Owner.x_offset = 0Owner.y_offset = 0 But Owner.original_justification = 7Owner.x (y and z) are NOT the same as I set into output DGN file. And I see NEW attributes such:igds_color, igds_weight

Is it possible to change the text size when writing ArcGIS Pro geodatabase annotation?

I am writing to an ArcGIS Pro annotation feature class in a file geodatabase defined where the text symbol is not required to be selected from the symbol table. My intent is to change the size of the text and have the symbol stored inline, but have been unsuccessful in my attempts. The font size always ends up as 10. This doesn’t seem to be related to the definition of the annotation class symbol, as I have created annotation classes with different size symbols and the resulting size is always 10. I am setting the following attributes in the workbench and exposing these on the writer:geodb_text_size: 72geodb_symbol_id: -1geodb_anno_class_id: -1geodb_allow_symbol_overrides: TRUEgeodb_font_point_size: 72 In my testing I have been able to change these properties and see the results come through:geodb_text_colorgeodb_font_name I have tried using the TextPropertySetter to change the text size but that doesn’t translate to the resulting annotation. I did try running this with FME 2020.1 aga

530

3 years ago

fhydeContributor

asked in Data

From the Postgresql Writer, when a table is truncated and then inserted with new data is it possible to reset the Primary Key sequence to '1'? It currently restarts at the last PK value (+1) from previous entry.

320

3 years ago

Page 49 / 273

Badge winners

kokilamhas earned the badge FME Form Basic Training
mahapandianhas earned the badge Teacher (Bronze)
karolhas earned the badge FME Certified Professional
meghanhas earned the badge Welcome Back
scarterhas earned the badge Teacher (Silver)

Show all badges

30,353: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.