Using readers and writers to extract and load data.
Recently active
Hi expert, I have a question about once publishing relationship classes and the related feature layers from ARCGIS, how to overwriting it from FME? Do I only need to overwrite the feature layers or also need to overwrite the relationship class from FME? Thanks!
Hi, Looking to extract the transformation matrix information from an E57 pointcloud file. Is there a way to do this? I know the information can be found in FME Data Inspector. Thanks
I'am trying to set the top and bottom elevation for the BuildingStoreys.. The writer does not have the ifc_elevation attribute to set global and local elevations. Now the bottom elevation is always 0 and the top elevation is relative to ground zero and not the floor how it should be.
Hello everyone, please, does FME support LERC format (https://github.com/Esri/lerc)? If not, are You thinking about it? :-) Thanks a lot!Lubo
I have a sde writer. When I do an update or a delete the translation is succesfull. But when I do an insert I get the following error:An error occurred while attempting to create a feature using the feature class 'db.schema.table'. The error number from ArcObjects is: '-2147220655'. The error message from ArcObjects is: {DBMS table not found [db.schema.table]}The backend is postgres: PostgreSQL 10.5, 64-bitArcgis version 10.6.1FME 2019.0 64bit also tried 2020 beta.Writer mode: versioned edit session
I am trying to write a table to a postgres geodatabase and I am using an SDE writer. I am using FME 2020.0.1.0. I get the following error: An error occurred while attempting to create the table 'test2'. The error number from ArcObjects is: '-2147220655'. The error message from ArcObjects is: {DBMS table not found [ERROR: relation "gisowner.i23" does not existLINE 1: INSERT INTO gisowner.i23 (id_type, base_id, num_ids, last_id... ^::SQLSTATE=42P01] [dbtest.gisowner.test2]}A fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for details There seem to be nothing wrong with the database, I can insert and create objects from ArcGIS Pro.
I have FME and ArcGIS Pro installed. Can I extend FME into ArcGIS Pro?
Hello!Having to write millions of homogenous point features to a file geodatabase (default Esri File Geodatabase Writer 3D, Vector), I noticed that the duration for a completed writing transaction/commit increases as the writing to the FGDB progresses. While the first transaction takes 0.4 seconds for 1000 features, the duration increases up to 1.5 seconds per 1000 features where it seems to level until the end of the writing process (there are no other process running):0.0|INFORM|Transaction #1 was successfully committed0.4|INFORM|MULTI_WRITER: multi_writer_id `1': Writing feature 10000.0|INFORM|Transaction #2 was successfully committed0.5|INFORM|MULTI_WRITER: multi_writer_id `1': Writing feature 2000...0.0|INFORM|Transaction #328 was successfully committed1.0|INFORM|MULTI_WRITER: multi_writer_id `1': Writing feature 328000...0.0|INFORM|Transaction #503 was successfully committed1.4|INFORM|MULTI_WRITER: multi_writer_id `1': Writing feature 503000...0.0|INFORM|Transaction #2289 was suc
I'm just looking to be able to drop a .shp file into the workspace and extract a list of the fields/attributes contained within, into a .csv file
How different is SQLCreator from SQL SMS when writing an update query?.Note: Not spatial data, just basic Feature to Feature compare to update and create my tblIriRut2020 table. This is our SQL SMS Code from last year, the 2020 will be a .csv reader in FMEUPDATE [Preservation].[dbo].[tblIriRut2019] SET AADT = tblAnnualTrafficSCD.AADT_Year1 FROM tblIriRut2019 tblIriRut2019 LEFT JOIN tblAnnualTrafficSCD tblAnnualTrafficSCD ON tblIriRut2019.RoadName = tblAnnualTrafficSCD.ROADNAME AND tblIriRut2019.FromKM >= tblAnnualTrafficSCD.FromKM AND tblIriRut2019.FromKM < tblAnnualTrafficSCD.ToKM Replace tblIriRut2019 with my Initiator (currently only 3050100MUA feature)I'm not sure how to share my SQL connection data in a .fme so you can have a real life sample. Another option:If the SQLCreator cannot handle this, how do I make a where clause in a transformer like FileMerger so I can have a multiple WHERE clause with Functions like Less than or equal to?
Hi,I'm facing a strange situation with MsWordStyler and Word Writer. I need to add a table to create a report from a feature. If I don't use a template, I can chose different styles for a table with the styler. The output of the table is correct. Trying to use a template, the only option to use a template is to select "Normal Table" as table style. Any other style produce the following error:"Microsoft Word Writer: Rejecting Feature. The msword_type value 'msword_table' is invalid. Please use a MSWordStyler prior to this writer to set the msword_type attribute". Is there some hints or best practices to follow creating the template?Paragraph and image work fine with the same template.ThanksRoberto
Has anyone ever encountered an issue with applying updates to an Oracle Non Spatial database using the writer and fme_db_operation? Have a number of records exiting a ChangeDetector that are a mix of inserts and updates. If there are any updates, the workspace hangs and fails to complete. Applying the updates using the DatabaseUpdater works fine and the process completes in 20ish minutes. Is there anything in the Writer that I might be missing before I rejig the workspace? There are 6 match columns (there is a 6 part primary key that also references these columns) The process should be making a couple of hundred updates to a table of ~1.5 million records. If there are updates present, the logging stops as soon as the first feature hits the writer and never progresses (left 14+ hours) FME 2019.2.3.1
CityGML writer created the following line automatically. <core:CityModel xmlns:brid="http://www.opengis.net/citygml/bridge/2.0" ..... I would like to change the text after <core:CityModel to other text.Could you tell me the procedure?
I am creating a CSV file in a Featurewriter with a filename created as follows:-litmap-@DateTimeFormat(@DateTimeNow(), %B-%d-%Y)This is dropped into a directory on a fixed pathHow can I pass this filename to the "File To Upload" parameter in the S3 uploader?
Hi there,I'm trying to read attributes from a shapefile and write them into a SQL database. I need to write also the data type for every attribute, exactly as written in shape (not based on their values). How can I extract data types from data source? Thank you for any help!
I transformed SHP to DGN, but all features are in one color. I need to apply features in color set by level. Even with seed file set or DGN file with right colored features as a color source, features from SHP data are in the right levels, but have no individual color by level. Seems like transformer is putting SHP feature in right DGN level (by attribute) but with default color, not color by level.
My translation writes features to spatial and non spatial Oracle tables in a given order. The problem is that any eventual DB related error should be reported to a web service and also logged to an xls file.I'm using Featurewriters to control the writing order but the Featurewriter transformer has no Rejected port. How do I catch DB errors then?SQLExecutor is fine for non spatial tables but not for spatial tables with complex geometries (due to the character number limitation for sql statements).Should I keep the Featurewriter approach and use a shutdown python script to catch DB errors and do the Excel and web service part? Is there any other option?Thanks for the help.
Hello, can someone help me with FME convert .GDB to ESRI Shape format much appreciated
So I learned that *.fts files are part of the ongoing tuning efforts in FME and are written to FMETable subfolder in FME_TEMP directory.I was literally shocked yesterday when my FME_TEMP drive (256Gb SSD) suddenly ran full because FMETable seemingly "exploded" without limit from reading and processing 5Gb of ffs files.My impression is that this is a first in FME 2020 (maybe 2019 too ?) as the FME processing active at the time was little more than reading 5Gb (190 different ffs files) and writing them out as a single set of ffs. This process up to now never was in any way critical but now is a blocking point in my environment. Is it in any way explainable why 60 million features consume 250Gb+ as *.fts files - when they only need 5Gb as ffs files ?I expect not more than 40-50Gb in the FileGeoDB which will receive this whole dataset !B.T.W.: Memory use was next to nothing during this whole adventure ...I came across excessive disk space use when FME writes raster data to disk i
Hi all, I wondered whether anyone had come across any issues reading in data from an Oracle DB with type LONG RAW. It seems FME cannot read in data of this type and 'skips' that column when reading in an Oracle DB table. Does anyone have any pearls of wisdom on how I could load this data in to my FME workflow? Thanks all, Amber
I've been trying to run an FME Workspace using PowerShell but I'm getting errors. At the moment, it's just a test Workspace with a Creator and an Emailer.When the FMW is on a different server in a different domain, I get an error saying the FMW file could not be opened. I am mapping a drive to the other server in the PowerShell console before I try to run the Workspace.When the FMW is on the same server as the EXE and PowerShell window, I get "A fatal error has occurred. Check the logfile..." although the Workspace did seem to have completed.I've tried the same things in a Command Prompt window with no errors so I'm going to use a Batch File for now.
Hi everyone I have an interesting question, and looking for some inspiration or advice to a problem I would like to solve. I thought I would ask the question before the FME Webinar on Excel that will be this Thursday (24.09.2020) There are a few workspaces that I need to adapt for multiple languages (English, German, French). The result is that all my outputs should be adapted for the language, meaning all texts and even the header in documents should be edited. My workflow is as follows: GoogleForms csv Input > FME Desktop Transformers > HTML Output As an exampleIn JSON one would build a multiple language dictionary like this: var arrLang = { "en-gb": { "HOME": "Home", "ABOUT": "About Us", "CONTACT": "Contact Us", }, "zh-tw": { "HOME": "首頁", "ABOUT": "關於我們", "CONTACT": "聯絡我們", }}; I am pondering what the best way to do this for my FME Workspaces. In my attached excel, I have used Lists to achieve a similar result, but how c
I have some LandXML files containing points (CgPoints) and lines (PlanFeature) with some attributes. As per the LandXML schema, the <CgPoints> are defined with the coordinate geometry as a <CgPoint>, and the attribute information as <Feature> with properties: <CgPoints> <CgPoint name="TRAU201" code="" oID="TRAU201">1256922.890706 84309.502725 165.818283</CgPoint> <Feature code="Gemini attributes"> <Property label="S_OBJID" value="TRAU201"/> <Property label="S_FIELDCODE" value="41050"/> </Feature> </CgPoints>What I am struggling with is to read the Feature information. The LandXML reader gives me an option read both CgPoints and CgPoint, but not Feature. CgPoint will give me the name, code and oID above, but my Feature attributes are not there... I need to extract the "S_FIELDCODE" value along with the geometry, but how?
Hello, I'm reading multi dwg files using dwg reader and need to get the version chossed when the user saved dwg file. i can see it in translation log when i run the reader but i couldn't get it as an attribute. any ideas or maybe transformator that i didn't find ´?
I am experiencing an error when reading AGOL feature services that are publicly available as REST services and writing them locally to a file geodatabase. I am using the Esri ArcGIS Server Feature Service reader and the Esri Geodatabase (File Geodb) writer. However, I am having an issue where the translation fails when writing to the file geodatabase.To clarify, I have no issues reading the data into FME however when writing to file geodatabase I get a single error message in the translation:2020-06-16 12:02:03| 4.0| 0.0|FATAL |GEODATABASE_FILE writer: An unknown exception occurred Attached is the workbench: Data source: the AGOL REST service URL I am reading is here: https://services1.arcgis.com/8CpMUd3fdw6aXef7/ArcGIS/rest/services/Parcel_Service/FeatureServer Trouble shooting this issue found:I am able to write to shape file with success for the most partHowever I've observed that when writing to shapefile in some cases some fields are written with no values and in small numb