Using readers and writers to extract and load data.
Recently active
When using the ArcGIS Online Feature Writer, sometimes during truncation, AGOL will encounter an error on delete. It looks like this:2022-01-12 18:39:01| 25.9| 0.0|INFORM|ArcGIS Online Feature Service Writer: Truncating layer/table 'Meters'. 2578 features remaining2022-01-12 18:39:39| 26.1| 0.2|INFORM|ArcGIS Online Feature Service Writer: Truncating layer/table 'Meters'. 1578 features remaining2022-01-12 18:40:47| 26.2| 0.1|WARN |ArcGIS Online Feature Service Writer: 'deleteResults' error for a feature in 'Meters'. The error code from the server was '1018' and the message was: 'The specified feature could not be deleted or does not exist.'2022-01-12 18:40:47| 26.2| 0.0|WARN |... Last line repeated 315 times ...2022-01-12 18:40:47| 26.2| 0.0|ERROR |ArcGIS Online Feature Service Writer: 6000 features successfully deleted from layer/table 'Meters', but the server rejected the 1000 deletions in the last request due to errors. See warnings above. Aborting translation2022-01-12
Hello everyone, I should start by saying I'm an FME beginner user. I'm currently toying with an old ESRI coverage dataset that still has some importance. The files are split by index (grid) and so each layer is stored in a separate folder like shown below. My goal is to extract the data from only one theme ("batim_p" which is building point data) and to merge it into a unique layer. Although the schema is always the same, it is possible that some index folder do not hosts the data folder. The thing is that I have an arcpy script that does this within about 40 mins but the FME process I constructed (which basically is only a feature reader) takes almost 10 hours to do about the same thing. I believe my problem comes from the fact that the reader scans EVERYTHING, although I have only selected the feature type of interest in the initial parameters. So I tried to work around this by using a Path/Directory reader to extract the folder name and THEN use a featureReader t
I've been noticing something and having trouble resolving it. I have a workflow that runs every half hour, it runs fine however I noticed that it is creating a legend.tiff file in temp in a numbered folder within /tmp. This does not seem to clear and is about 1GB. I would like if this file was not created or at least removed when the process finishes. It will eventually create too many of them and lead to the disk getting full. I can remove them manually or with script on intervals, however I feel there must be a way for FME not to create them. If any one has any tips on what transformer is creating them that would be great.
I'm using an SQL Creator to return data from three tables (Microsoft SQL Server), one of which contains a geometry column. Initially, I was just joining two tables and this all worked as expected with the geometry being correctly displayed within FME. When i amended the SQL to include a third table, the geometry column seems to have stopped being interpreted as geometry and is now displayed as an attribute containing binary data. A bit more investigation, if I limit the fields being returned by the SQL creator, the geometry is interpreted correctly (bottom SQL creator). If i attempt to return all fields (explicitly naming or using *), the geometry field is returned as an attribute Additional information, only the table I'm attempting to get the geometry from has a geometry column. Am I missing something obvious? FME(R) 2020.2.2.0 (20210111 - Build 20817 )
When I am translating Smallworld 4.2 using a seed file that has a coordinate system set the file that is created does not have a coordinate system set. If I create a file from within Microstation using the same seed file the new file does have the coordinate system set. I verified that during the translation using FME the correct Seed file is being used. I then created a translation of a V8i Microstation file translating to another V8i Microstation file using the same Seed File and the coordinate system is unset in the created file. Am I missing some kind of setting? or is there a know problem with Coordinate systems and Microstation files?
Looking to use these building footprints from Google, and they're in a format I haven't heard of before, a 'spatially sharded CSV'. Has anyone ever worked with this dataset or know how I could read in the spatial data? Here's more info from the page at Google Research: Building polygonsBuilding polygons are stored in spatially sharded CSVs with one CSV per S2 cell level 4. Each row in the CSV represents one building polygon and has the following columns:latitude: latitude of the building polygon centroid,longitude: longitude of the building polygon centroid,area_in_meters: area in square meters of the polygon,confidence: confidence score [0.5;1.0] assigned by the model,geometry: the building polygon in the WKT format (POLYGON or MULTIPOLYGON),full_plus_code: the full Plus Code at the building polygon centroid,
Hello, I am having trouble with an DWG plan containing arrows. Workbench: Does changes in the model space and writes the modificated plan into a new DWG file. I am using a DGW styler just before the writer (I don' have selected more parameters). Writer parameters: Preserve template paper space data: yesOutput (see image): Plan (green rectangle) and arrows (red rectangle) are seperated. Does someone know why this occurs and has a handy solution? Thank you!
Table1Table2 Reader data from soap and writer is oracle spatial object. I use inline querier and featureMerger for using xml hierarcy that is "STATUS_REASON_SEQ_ID ". So, I merged two tables and created. But I expect to see foreign key(references Table2 (SEQ_ID)) in Table1. What should I use in this case. ?
Is it possible to add a "$filter" parameter to an OData reader in FME 2021.2 ?
I try to make a setup of a script workbench and a runner workbench. The script consists of a postgis feature reader and a gdb writer. The schema of the postgis feature reader is defined as a user parameter, and so is the destination of the gdb writer. The runner consists of a Postgis reader that reads a table containing schemas and paths for the gdb, and a workspace runner that runs the script and defines the user parameter mentioned above using the schemas and paths from the PG table. However i just this error when trying to read the table of the schema: "021-12-21 12:53:57| 0.1| 0.0|ERROR |Error executing SQL command ('select * from "FME_PostGIS_SCHEMA"."DF_Mast" where false limit 0'): 'ERROR: relation "FME_PostGIS_SCHEMA.DF_Mast" does not exist" So it just inserts the name of the user parameter rather than the actual schema it was support to insert. I hope you can help. Regards Rasmus
FME Desktop 2020.0.0.0: What does “untouched” indicate for in the “geometry coercer” tool? For example, in the screenshot below, I got 3 features as “untouched”. What does this indicate for? The data is attached
I am importing landxml file that has alignment(s) with stationing. I'd like to view the alignment(s) with stationing labels including tick marks in the Graphics window. Is this possible?
Hi, After converting the tif to ecw, ecw always comes with a background. I don't see the background in FME inspector or ArcMap, but there is always a background in Smallworld. Is it a way to remove the background colour of the ecw?
I have an AIXM 5.1 file which clearly states at the beginning that the encoding of the file it is in UTF-8. However, when I use the AIXM 5.1 Reader suddenly all my attributes are in UTF-16LE which is not what I want. I could use the AttributeEncoder to change everything back to UTF-8, but that seems like a waste of time as my data was good to start with. Also is my geometry converted into XML and reading that will give errors as declaration inside the attribute is then UTF-16LE while I converted the attribute to UTF-8.
FME server get current logged in user from token
I have FME Small world Edition license on my system but I am unable to read the data as it shows below error. Please help me with this.
I've been given some data - 10 KMZ files which seem to comprise multiple named layers (so over 70 in total) with only occasional data in the Name field, which I want to convert to TAB format. I'm struggling with it - below are 3 views of the data - in Google Maps, in QGIS and in FME Data Inspector. I also attach one of the KMZ files here. I'd like to generate a workspace to produce 10 MapInfo tables of points, lines and polygons, to correspond with the KMZ files and named as the KMZ files, but with an attribute column populated with the layer names, for example, "J Garden Terrains" (in QGIS appears to be the Layer names) and a Name field for the occasional data that has. The only way I can see of converting the data at the moment is to click on each layer in QGIS and Save As a MapInfo table. I'm sure I must be able to do this in FME - I hope so! If anyone can help I'd be very grateful. Thanks, Jane
I have a workbench which converts IFC to ESRI Multipatch, the original colours in IFC are reserved very well in the output Multipatch (as inspected in ArcGIS Pro), however if I convert the multipatch to 3D object scene layer package, it seems the colours are gone. there are not many option for me to play in the I3S writer. I have checked the FME I3S factsheet which has mentioned Generic Color Support: No. Not sure if that's related, but any advice how to keep the colours of the output .slpk matches what's in the original IFC or multipatch? thanks
I am attempting to make a connection to an AGOL feature service through the ArcGIS Online Feature Service Reader and receive the above exception and error indicating invalid token. I just created the web connection using valid credentials so this shouldn't be a refresh token issue. I've tried creating multiple web connections for AGOL and get the same exception/error each time. Note: I am not the owner of the feature service however is is shared to my organization. The credentials I'm using to try to create the connection are admin credentials for my organization. I have never attempted to connect to an AGOL feature service before so any help would be appreciated. I realize there are similar forum posts/questions but none seem to resolve my issue.
Why this is not working? 😕 I am using:2020.2.0.0 (20201027 - Build 20787 - WIN32)REALDWG reader/writerDWGStylerI want to: read DWG file with som "autocad_text" entities,change size of these entities,write it to new DWG file.My approach:I use REALDWG reader to read my dwg:I then use DWG styler to manipulate text sizeI then use REALDWG writer to generate new DWG fileResult:Inspecting generated file with AutoCad shows that size in not changed!Workspace and test file in attachment
Hi folks, I'm trying to read a GPKG Layer from a rather extensive Geopackage which I use as an offline data exchange container. Said layer has a total of 228 objects, of which 47 have multipolygon geometry and the rest are tabular data. The problem: While FME Data Inspector on its own reads the data correctly, the FME Workbench GPKG reader reads all features as type "geopackage_none" and omits geometries completely. I have not found any reader options to resolve this. What can be done do force FME to read all "geopackage_multipolygon" objects correctly? Splitting the data into separate tables is not an option, since I have to use a given data model. Thanks for any helpful advice!
Hi, I have an issue when reading from an Oracle database.In my table a field is set to number(10,2) but when read with the Oracle Reader (Non-Spatial or Spatial Object), I get the attribute with the fme_data_type String. However, in the User Attribute tab of the reader parameters, I do see the oracle type numer(width,decimal) / 10 / 2. How come this can be ? Same behavior with the the FeatureReader.I am using FME 2020.2Context is : reading from Oracle DB, reading from Postgres DB and comparing both tables with same attributes with ChangeDetector to syncronize Oracle to Postgres.
I have got a set of polygons as result of my FME processes which I want to write to DGN and Excel (they carry different attributes like area, the country they are situated in etc.). When writing to DGN, the polygons get an igds_element_id I would like to use to identify the polygons in the Excel document as well, so that an user who opens the DGN and the Excel document is able to connect the polyon in Microstation with the respective row in Excel. Is it possible to control the creation of igds_element_ids before writing to DGN (like it is with fme_text_string -> igds_test_string), or do I have to generate an additional ID (is it possible to pass it to DGN?!) respectively merge the igds_element_ids with a second Workbench to my Excel rows after writing th DGN? I'm a little lost at the moment when it comes to find a solution fot this 😵
I've been trying to run a simple test, where I read in a 12D XML file, then write the same data back out. The 12D file is read in successfully, with all expected data and attribution, but when writing back out, there is an issue with the geometry of the included TIN. The TIN feature is written, but is missing all of it's geometry parts. The image below shows the TIN from the read input file:This image shows the same data when output to a new 12D XML file:The vertex pool exists, but with no parts. Anyone have any ideas why this may be happening?
I tried FTPCaller using the full path to the file I want but I am unsure of authentication as it seems undocumented. I am unable to use username and password and must use SSH key files. Setting to ssh-agent seemed like the way to go but how do you choose your key file? I am publishing to Cloud anyways so I thought I would look at what was there and seems there is upload capability for sftp using a subscriber and ftp watcher (no sftp). Am I missing something?