Using readers and writers to extract and load data.
Recently active
I have a list of postgis tables and their schemas coming from a python caller. I want to dynamically read all the postgis layers and export them. However I cannot get the layer attributes to come through - only the geometry comes through in the feature reader.I'm passing the schema.table as an attribute called datasetName into the "Feature Types to Read". See below the inspector giving a valid value. When running I don't get the attributes that I expected along with the geometry: If, however, I paste in the text that I generated for the datasetName, i.e: o6_energy.bgs_eng_gas_goodcbmpotentialgbv1_bgs_bslnThen it creates a new port with the attributes I wanted: Hey presto, the attributes are there: Can I not dynamically provide the datasetName and get the geometry + attributes to come out of a single predictable port?Note it's not coming out of the generic port anymore, it's created another port with the dataset name. This is massively inconvenient as- as i
I am trying to write from Smallworld 4.3, using FME 2018 build 18301 and the MS SQL Spatial (JDBC) writer. The writer creates the new table ok, but when it tries to write the features I get the following error: “C:\\apps\\FME2018\\metafile\\mssql_jdbc_spatial_.fmi could not be opened”. If I look in this directory there are 3 .fmi files that start with mssql_jdbc_spatial_, ie Destination, geommap, & Source. I presume FME is looking for some sort of parameter value, and trying to make some decision on which of these 3 files to use, however I can’t see any missing parameters in my mapping file. Can anyone point me in the right direction please?Thanks Neal
Hi, I have a very simple workspace, the result of which is excel spreadsheets. However, there is a published parameter where I always need to inform dates, for example: 20200709030000, 20200710030000,20200712030000. Currently I need to run date by date, is there a way to run date by date automatically, that is, entering the required dates in one go? Thank you very much
I am merging an excel spreadsheet and an ArcGIS SDE feature class on a common field. Some of the entries in the spreadsheet have a "Strikethrough" effect--these entries should be ignored, however, FME is matching them anyway. How can I get it to ignore any entries with strikethrough?
I am trying to read the domain names from a portal feature service. I believe this requires the use of the REST API and httpCaller. I am also using a Portal Feature Service Reader to do everything else I want to do.I have tried everything I can think of to get hold of the Feature Service parameter with no success.Is there any sort of elegant way to get hold of this parameter so I can use it in the httpCaller to return queryDomains?My last resort would be for the user to have to effectively do this twice when picking the feature service to read (in the reader) and also get them to supply a text published parameter in the run dialogue (for use in the httpCaller).Am I missing something? thanks in advance Ian
I need a help for POSTGIS to GML feature transformation. All attributes are written except geometry in GML and after translation I got Attribute table. All geometry data are ok in POSTGIS DB.
I have a workbench set up to detect changes between 2 sets of folders and then copy the new files from one set into the other, with some fancy formatting and fanning applied. The change detector works perfectly in this example I set up, it detects 17 changes and these are passed through an Attribute manager and onto the filecopy writer. Somehow though, the writer copies way more than 17 files that are passed to it so somehow that information is still getting to the writer, but I cant see how. Does anyone have any ideas?
2020-07-24 14:29:55| 0.4| 0.0|WARN |Excel Reader: Internal error: Could not find any sheets to read2020-07-24 14:29:55| 0.4| 0.0|WARN |Excel Reader: Found named range '_xlnm__FilterDatabase' on sheet 'Haul Data'. This is a Microsoft Excel internal name so FME will not show it as a sheet. If you wish to read this named range, please rename it
I have a series of WorkSpaces that run in sequence (via WorkSpace Callers). I have the main WorkSpace scheduled to run a few times a day, and over the last few weeks they've been running fine.Today I noticed some of them began to fail, and throw the same error that I would sometimes get when I set them up the first time, a few months ago:Encountered an unexpected error. The error code from the server was 'none' and the message was: 'Service name 'SERVICE' already exists for 'xxxxxx''. Of the 5 Workspaces that write to AGOL, 4 started to fail. One is working fine. All have the same settings, use "Insert" and "Truncate".Looking deeper in to the logs, I found that for all of the writers that are failing the following is happening (some names redacted): ArcGIS Online Feature Service Writer: Requesting portal informationArcGIS Online Feature Service Writer: Getting list of user content items in 'User_org'ArcGIS Online Feature Service Writer: Searching for all groups in the organization ac
Hello everybody, i try to integrate an IFC File of a building into a gdb File.Someone from ESRI France has read the file correctly and put in gdb file with Data Interoperability and ArcGIS Pro 2.5.I don't know very much this BIM format but i have some problems to read it in FME 2020.1 (build 20596). step1 : all the file is ok except the class IfcWallStandardCase wich has a problem just in reading it with an inspector.with 2D, no problem, but 3D reading, it failed : Construction de la commande OSG Graphe de scène caught exception: stk::ex::FatalError[0] Expression: edgeCurves_[edge].has_value()[1] auto __cdecl cycletopology::Graph::extractCircuit::<lambda_62cd9dca1bd617e3c133d0725ef0952f>::operator ()(const struct stk::ex::index<unsigned __int64,struct cycletopology::Graph::Edge>) const(C:\\code\\fme\\foundation\\framework\\geometry\\cycletopology\\src\\graph.cpp:167) step 2 :i have tried to write the 1400 items into a gdb file (multipart) with a geometry filter on soli
Dear FME community.I've to use the dynamoDB connector with a partition key like a specific date (for example : today - 5 days).For that I only can using a published parameter :But in this case I don't have access to the date function :Do you know how can I do that ?For information, I've FME Server.Thank you for your help.
Hello everyone,is there any possibility how to upload mediafile to ORACLE (e.g. PNG, JPEG etc.) via FME?Thank You so much!Lubo
Hi all!I'm testing the new 12d xml reader and writer transformers. I've started with a simple static reader to writer workspace to see if a basic conversion works with no manipulation but hasn't been successful. I believe it requires some extra manipulation. Had the following error when trying to get back in to 12d model software:I don't know how to read the xml so I don't know what's going wrong. Below is an image of my workspace and attached fme template file. I'm also curious whether/if FME can write back to 12d vertex attributes as well as string attributes. It certainly reads them however puts them in to a list. I wonder if this complicates things on the 'write' side of the process. Any help would be appreciated.Using FME 2020.
I am trying to connect to S3 on FME Server using the S3Connector System authentication. Our FME server is using the 6th method as per https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-quickstart.html#cli-configure-quickstart-precedence : Instance profile credentials – You can associate an IAM role with each of your Amazon Elastic Compute Cloud (Amazon EC2) instances. Temporary credentials for that role are then available to code running in the instance. The credentials are delivered through the Amazon EC2 metadata service. For more information, see IAM Roles for Amazon EC2 in the Amazon EC2 User Guide for Linux Instances and Using Instance Profiles in the IAM User Guide. I have confirmed I have access on the server to reach the S3 bucket specified directly via the CLI, but when I run through FME Server I get the following:Attribute(encoded: UTF-8) : `fme_rejection_message' has value `S3Connector: Required Amazon S3 credentials were blank or could not be found. Please note
The reader documentation for acad list 2020 as the most recently supported version, just checking in to see if this is true for the FME 2020.1 release and when AutoCAD 2021 will be supported.
I have some legacy images (jpg) with a SHP file with points for each image.Is there anyway to create geotagged photos from these?
I need to read all tables from Postgis scehma. With reader I got only tables which has geometry or which has tables related to geometry tables with foreign keys.Is there some option to read them all, or some Python script which can help me with this?
When using the GUID generator i would like to assign that column as a primary key without opening the writer and assigning it? Is there a transformer i can use for this? (Would be a great addition to that transformer.)
I have a .dxf with points and lines within different layers and blocks. For one layer of data, I need to delete the attribute value within the block and insert in it the geometric value z. Which transformer is best to use?
I follow step 1 of https://knowledge.safe.com/questions/101352/write-b3dm-from-kmz-with-textures-to-cesium-3d-til.html, selected 'Placemark' feature and run.It generated 'tileset.json' and 'data/data0.b3dm' and I tried loading it in Cesium but I couldn't see anything. What is the right way to do to convert KML to 3D tiles?
Hi all,Just been on working on converting AGS Files to GIS format.This is the first time I have gone through this and it is a difficult file to convert.Just wondered if anyone has any experience with this and are there any steps that have to be done before using FME to convert.@daveatsafe - I have seen a similar thread where you have done some fantastic work building the AGS FME file. I have played around with it but struggle with the output. Below is the FME file:I have also used the AGS transformer which FME now has but not getting the output I was after.
I'm going from ESRI Shape Files to PostGIS and trying to add a primary key to all my tables so that Mapserver and other queries are happier with the unique Primary Key. I see from https://knowledge.safe.com/idea/74374/postgres-writer-add-unique-primary-option-for-inde.html that I can add a Serial and that works well but I'd like to add that to 20, 30, or even 50 shape files at a time. Is it possible to do this as a batch?Thanks!
Dear FME community.I would like to compare to database who contains json (with subobjects).The aim is to UPDATE, DELETE or INSERT json into the target DBInforamtion : the base 2 may be to json format or "classical" attributes format.What is the better way to do this ?Thanks.
Is there any possibility to change the default geometry column 'geom' on postgis readers to some other column with a different geometry like geom2 ?Thanks
Hi Guys, this might be a simple question - I am writing data to a TAB file. every time I run the workspace it over writes the TAB file with the new data. How do I append data being written to the TAB file.Dave