Using readers and writers to extract and load data.
Recently active
I am trying to read the domain names from a portal feature service. I believe this requires the use of the REST API and httpCaller. I am also using a Portal Feature Service Reader to do everything else I want to do.I have tried everything I can think of to get hold of the Feature Service parameter with no success.Is there any sort of elegant way to get hold of this parameter so I can use it in the httpCaller to return queryDomains?My last resort would be for the user to have to effectively do this twice when picking the feature service to read (in the reader) and also get them to supply a text published parameter in the run dialogue (for use in the httpCaller).Am I missing something? thanks in advance Ian
I need a help for POSTGIS to GML feature transformation. All attributes are written except geometry in GML and after translation I got Attribute table. All geometry data are ok in POSTGIS DB.
I have a workbench set up to detect changes between 2 sets of folders and then copy the new files from one set into the other, with some fancy formatting and fanning applied. The change detector works perfectly in this example I set up, it detects 17 changes and these are passed through an Attribute manager and onto the filecopy writer. Somehow though, the writer copies way more than 17 files that are passed to it so somehow that information is still getting to the writer, but I cant see how. Does anyone have any ideas?
2020-07-24 14:29:55| 0.4| 0.0|WARN |Excel Reader: Internal error: Could not find any sheets to read2020-07-24 14:29:55| 0.4| 0.0|WARN |Excel Reader: Found named range '_xlnm__FilterDatabase' on sheet 'Haul Data'. This is a Microsoft Excel internal name so FME will not show it as a sheet. If you wish to read this named range, please rename it
I have a series of WorkSpaces that run in sequence (via WorkSpace Callers). I have the main WorkSpace scheduled to run a few times a day, and over the last few weeks they've been running fine.Today I noticed some of them began to fail, and throw the same error that I would sometimes get when I set them up the first time, a few months ago:Encountered an unexpected error. The error code from the server was 'none' and the message was: 'Service name 'SERVICE' already exists for 'xxxxxx''. Of the 5 Workspaces that write to AGOL, 4 started to fail. One is working fine. All have the same settings, use "Insert" and "Truncate".Looking deeper in to the logs, I found that for all of the writers that are failing the following is happening (some names redacted): ArcGIS Online Feature Service Writer: Requesting portal informationArcGIS Online Feature Service Writer: Getting list of user content items in 'User_org'ArcGIS Online Feature Service Writer: Searching for all groups in the organization ac
Hello everybody, i try to integrate an IFC File of a building into a gdb File.Someone from ESRI France has read the file correctly and put in gdb file with Data Interoperability and ArcGIS Pro 2.5.I don't know very much this BIM format but i have some problems to read it in FME 2020.1 (build 20596). step1 : all the file is ok except the class IfcWallStandardCase wich has a problem just in reading it with an inspector.with 2D, no problem, but 3D reading, it failed : Construction de la commande OSG Graphe de scène caught exception: stk::ex::FatalError[0] Expression: edgeCurves_[edge].has_value()[1] auto __cdecl cycletopology::Graph::extractCircuit::<lambda_62cd9dca1bd617e3c133d0725ef0952f>::operator ()(const struct stk::ex::index<unsigned __int64,struct cycletopology::Graph::Edge>) const(C:\\code\\fme\\foundation\\framework\\geometry\\cycletopology\\src\\graph.cpp:167) step 2 :i have tried to write the 1400 items into a gdb file (multipart) with a geometry filter on soli
Dear FME community.I've to use the dynamoDB connector with a partition key like a specific date (for example : today - 5 days).For that I only can using a published parameter :But in this case I don't have access to the date function :Do you know how can I do that ?For information, I've FME Server.Thank you for your help.
Hello everyone,is there any possibility how to upload mediafile to ORACLE (e.g. PNG, JPEG etc.) via FME?Thank You so much!Lubo
Hi all!I'm testing the new 12d xml reader and writer transformers. I've started with a simple static reader to writer workspace to see if a basic conversion works with no manipulation but hasn't been successful. I believe it requires some extra manipulation. Had the following error when trying to get back in to 12d model software:I don't know how to read the xml so I don't know what's going wrong. Below is an image of my workspace and attached fme template file. I'm also curious whether/if FME can write back to 12d vertex attributes as well as string attributes. It certainly reads them however puts them in to a list. I wonder if this complicates things on the 'write' side of the process. Any help would be appreciated.Using FME 2020.
I am trying to connect to S3 on FME Server using the S3Connector System authentication. Our FME server is using the 6th method as per https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-quickstart.html#cli-configure-quickstart-precedence : Instance profile credentials – You can associate an IAM role with each of your Amazon Elastic Compute Cloud (Amazon EC2) instances. Temporary credentials for that role are then available to code running in the instance. The credentials are delivered through the Amazon EC2 metadata service. For more information, see IAM Roles for Amazon EC2 in the Amazon EC2 User Guide for Linux Instances and Using Instance Profiles in the IAM User Guide. I have confirmed I have access on the server to reach the S3 bucket specified directly via the CLI, but when I run through FME Server I get the following:Attribute(encoded: UTF-8) : `fme_rejection_message' has value `S3Connector: Required Amazon S3 credentials were blank or could not be found. Please note
The reader documentation for acad list 2020 as the most recently supported version, just checking in to see if this is true for the FME 2020.1 release and when AutoCAD 2021 will be supported.
I have some legacy images (jpg) with a SHP file with points for each image.Is there anyway to create geotagged photos from these?
I need to read all tables from Postgis scehma. With reader I got only tables which has geometry or which has tables related to geometry tables with foreign keys.Is there some option to read them all, or some Python script which can help me with this?
When using the GUID generator i would like to assign that column as a primary key without opening the writer and assigning it? Is there a transformer i can use for this? (Would be a great addition to that transformer.)
I have a .dxf with points and lines within different layers and blocks. For one layer of data, I need to delete the attribute value within the block and insert in it the geometric value z. Which transformer is best to use?
I follow step 1 of https://knowledge.safe.com/questions/101352/write-b3dm-from-kmz-with-textures-to-cesium-3d-til.html, selected 'Placemark' feature and run.It generated 'tileset.json' and 'data/data0.b3dm' and I tried loading it in Cesium but I couldn't see anything. What is the right way to do to convert KML to 3D tiles?
Hi all,Just been on working on converting AGS Files to GIS format.This is the first time I have gone through this and it is a difficult file to convert.Just wondered if anyone has any experience with this and are there any steps that have to be done before using FME to convert.@daveatsafe - I have seen a similar thread where you have done some fantastic work building the AGS FME file. I have played around with it but struggle with the output. Below is the FME file:I have also used the AGS transformer which FME now has but not getting the output I was after.
I'm going from ESRI Shape Files to PostGIS and trying to add a primary key to all my tables so that Mapserver and other queries are happier with the unique Primary Key. I see from https://knowledge.safe.com/idea/74374/postgres-writer-add-unique-primary-option-for-inde.html that I can add a Serial and that works well but I'd like to add that to 20, 30, or even 50 shape files at a time. Is it possible to do this as a batch?Thanks!
Dear FME community.I would like to compare to database who contains json (with subobjects).The aim is to UPDATE, DELETE or INSERT json into the target DBInforamtion : the base 2 may be to json format or "classical" attributes format.What is the better way to do this ?Thanks.
Is there any possibility to change the default geometry column 'geom' on postgis readers to some other column with a different geometry like geom2 ?Thanks
Hi Guys, this might be a simple question - I am writing data to a TAB file. every time I run the workspace it over writes the TAB file with the new data. How do I append data being written to the TAB file.Dave
I I am trying to convert the attached shape file to topojson. it is a shapefile of points. It seems some of the points are causing a problem when converting because I can take a sample and create the topojson file. I can't seem to figure out the problem with the offending points. Appreciate any help. Thanks.David
Hello everyone, I am converting CAD data to CityGML. To create the LoD2 class of buildings with hierarchical integrity, I used GeometryCoercer to transform the extruded solids into surfaces, followed by the Deaggregator, separating the roofs, walls and grounds. I tried to use SurfaceOnSurfaceOverlayer to identify shared walls between buildings but the transformer is not identifying all the cases. When I set the tolerance, it identify more cases but it ends up disturbing the geometry of the surfaces, generating non-flat surfaces, with duplicate points, etc ... all verified by GeometryValidator and by CityGML validation tools like Val3dity. As you can see in the prints, a case of shared surface is identified (Surface 1 and 2) and another one with the same characteristics (Surface 3 and 4) no. As I used the vertical direction in the Extruder and have the same X and Y coordinates, they should be coplanar- I also used the PlanarityFilter before the process and the value of the _surfaceNorma
We recently upgraded FME Desktop 2007 to 2020. Now I'm upgrading all of our old workspaces and I've having an issue after upgrading GML reader to the latest version.GML files are read without any error with the old reader but with the new version I get the following error for every feature in every GML file:Cannot convert null string into an integer class StatusInfo *__cdecl STF_stringToUInt(const class ObsoleteString &,unsigned long &)(C:\\code\\fme\\foundation\\framework\\util\\stf\\stfutil.cpp:358) - class StatusInfo *__cdecl STF_stringToUInt(const class ObsoleteString &,unsigned long &)(C:\\code\\fme\\foundation\\framework\\util\\stf\\stfutil.cpp:358)I checked the GML version for all my files in the xsd file and they all say it's GML 3.1.1. Didn't see any limitation on this in the reader's help.Any idea of what's going on?Edit: the old GML reader works as expected before saving my workspace with Desktop 2020, but the error is there after sav
I have a text file that contains an AutoCAD pathname on each line, e.g., D:\\project4033\\dwg\\p1234.dwg D:\\project515\\dwg\\p642.dwg X:\\dwg\\a556.dwgHow can I set up a Reader to process each file (the output format will be Adobe GeospatialPDF)? I see answers like a "TextFileReader", but on my 2020.1 system there is no such transformer.