Data

Has anyone ever encountered an issue with applying updates to an Oracle Non Spatial database using the writer and fme_db_operation? Have a number of records exiting a ChangeDetector that are a mix of inserts and updates. If there are any updates, the workspace hangs and fails to complete. Applying the updates using the DatabaseUpdater works fine and the process completes in 20ish minutes.  Is there anything in the Writer that I might be missing before I rejig the workspace? There are 6 match columns (there is a 6 part primary key that also references these columns) The process should be making a couple of hundred updates to a table of ~1.5 million records. If there are updates present, the logging stops as soon as the first feature hits the writer and never progresses (left 14+ hours) FME 2019.2.3.1

CityGML writer created the following line automatically. <core:CityModel xmlns:brid="http://www.opengis.net/citygml/bridge/2.0" ..... I would like to change the text after <core:CityModel to other text.Could you tell me the procedure?

I am creating a CSV file in a Featurewriter with a filename created as follows:-litmap-@DateTimeFormat(@DateTimeNow(), %B-%d-%Y)This is dropped into a directory on a fixed pathHow can I pass this filename to the "File To Upload" parameter in the S3 uploader? 

Hi there,I'm trying to read attributes from a shapefile and write them into a SQL database. I need to write also the data type for every attribute, exactly as written in shape (not based on their values). How can I extract data types from data source? Thank you for any help!

I transformed SHP to DGN, but all features are in one color. I need to apply features in color set by level. Even with seed file set or DGN file with right colored features as a color source, features from SHP data are in the right levels, but have no individual color by level. Seems like transformer is putting SHP feature in right DGN level (by attribute) but with default color, not color by level.

My translation writes features to spatial and non spatial Oracle tables in a given order. The problem is that any eventual DB related error should be reported to a web service and also logged to an xls file.I'm using Featurewriters to control the writing order ​but the Featurewriter transformer has no Rejected port. How do I catch DB errors then?SQLExecutor is fine for non spatial tables but not for spatial tables with complex geometries (due to the character number limitation for sql statements).​Should I keep the Featurewriter approach and use a shutdown python script to catch DB errors and do the Excel and web service part​? Is there any other option?Thanks for the help.​​

Hello, can someone help me with FME convert .GDB to ESRI Shape format much appreciated

So I learned that *.fts files are part of the ongoing tuning efforts in FME and are written to FMETable subfolder in FME_TEMP directory.I was literally shocked yesterday when my FME_TEMP drive (256Gb SSD) suddenly ran full because FMETable seemingly "exploded" without limit from reading and processing 5Gb of ffs files.My impression is that this is a first in FME 2020 (maybe 2019 too ?) as the FME processing active at the time was little more than reading 5Gb (190 different ffs files) and writing them out as a single set of ffs. This process up to now never was in any way critical but now is a blocking point in my environment. Is it in any way explainable why 60 million features consume 250Gb+ as *.fts files - when they only need 5Gb as ffs files ?I expect not more than 40-50Gb in the FileGeoDB which will receive this whole dataset !B.T.W.: Memory use was next to nothing during this whole adventure ...I came across excessive disk sp

Hi all,  I wondered whether anyone had come across any issues reading in data from an Oracle DB with type LONG RAW. It seems FME cannot read in data of this type and 'skips' that column when reading in an Oracle DB table.  Does anyone have any pearls of wisdom on how I could load this data in to my FME workflow? Thanks all,  Amber  

I've been trying to run an FME Workspace using PowerShell but I'm getting errors. At the moment, it's just a test Workspace with a Creator and an Emailer.When the FMW is on a different server in a different domain, I get an error saying the FMW file could not be opened. I am mapping a drive to the other server in the PowerShell console before I try to run the Workspace.When the FMW is on the same server as the EXE and PowerShell window, I get "A fatal error has occurred. Check the logfile..." although the Workspace did seem to have completed.I've tried the same things in a Command Prompt window with no errors so I'm going to use a Batch File for now.

Hi everyone I have an interesting question, and looking for some inspiration or advice to a problem I would like to solve. I thought I would ask the question before the FME Webinar on Excel that will be this Thursday (24.09.2020) There are a few workspaces that I need to adapt for multiple languages (English, German, French). The result is that all my outputs should be adapted for the language, meaning all texts and even the header in documents should be edited.  My workflow is as follows: GoogleForms csv Input > FME Desktop Transformers > HTML Output As an exampleIn JSON one would build a multiple language dictionary like this: var arrLang = {    "en-gb": {        "HOME": "Home",        "ABOUT": "About Us",        "CONTACT": "Contact Us",    },    "zh-tw": {        "HOME": "首頁",        "ABOUT": "關於我們",        "CONTACT": "聯絡我們

I have some LandXML files containing points (CgPoints) and lines (PlanFeature) with some attributes. As per the LandXML schema, the <CgPoints> are defined with the coordinate geometry as a <CgPoint>, and the attribute information as <Feature> with properties:  <CgPoints>    <CgPoint name="TRAU201" code="" oID="TRAU201">1256922.890706 84309.502725 165.818283</CgPoint>    <Feature code="Gemini attributes">      <Property label="S_OBJID" value="TRAU201"/>      <Property label="S_FIELDCODE" value="41050"/>    </Feature>  </CgPoints>What I am struggling with is to read the Feature information. The LandXML reader gives me an option read both CgPoints and CgPoint, but not Feature. CgPoint will give m

Hello,  I'm reading multi dwg files using dwg reader and need to get the version chossed when the user saved dwg file. i can see it in translation log when i run the reader but i couldn't get it as an attribute. any ideas or maybe transformator that i didn't find ´? 

I am experiencing an error when reading AGOL feature services that are publicly available as REST services and writing them locally to a file geodatabase.  I am using the Esri ArcGIS Server Feature Service reader and the Esri Geodatabase (File Geodb) writer.  However, I am having an issue where the translation fails when writing to the file geodatabase.To clarify, I have no issues reading the data into FME however when writing to file geodatabase I get a single error message in the translation:2020-06-16 12:02:03|   4.0|  0.0|FATAL |GEODATABASE_FILE writer: An unknown exception occurred Attached is the workbench:  Data source: the AGOL REST service URL I am reading is here: https://services1.arcgis.com/8CpMUd3fdw6aXef7/ArcGIS/rest/services/Parcel_Service/Feat

I need to get geometry and attributes out of AIXM 5.1 into ESRI geodatabase.

Hi list.Does the FeatureReader reading WFS 2.0.0 data handle paging ?If a service is known to be limited to return a maximum number of features per call, paging, i.e. fetching the complete dataset in chunks, is a way to handle this.However, the only options I see are "Max Features" and "Count", but they don't incur paging, as far as I can tell.So how does FME handle WFS 2.0.0 paging ?CheersLars I

For some reason, I am unable to write to two consecutive specified columns in an excel spreadsheet. I have specified the Column B and 3 rows of that for one set of data.  I have also specified Column D and 3 rows of that for the other set of data.  It doesn't matter if I use the featurewriter or the xlsx writer. I am unable to get Columns B and D to populate together. My export comes from a template that has calculations in it. There is a ROW attribute that works correctly with fixed values of 37, 38, and 40. The column is specified as the field B and D for each data stream which is correct. They are both going to the same sheet and I have been unable to make the other column that is not writing write to another column or sheet somewhere.  I do this often with other reports and have not yet had this issue. Driving me crazy. Any suggestions would be appreciated

I have over 100 Excel files with standard format: each Excel file has multiple sheets corresponding to multiple days in one month on recorded hourly well flow data, and the format for each sheet is fixed. The top part of sheet has well header info while the lower part are recorded hourly well flow data. I need to combine the well header info and hourly flow data into standard table format and load into SQL Server database table. It is easy to read the hourly flow data into. My challenge is to also read well header info from the same sheet , combine with hourly flow data, and write all these data into a table. I am looking for examples and help on similar Excel data loading. Thanks in advance.

Hello, I would like to know how ca I read the Python data. I need to build a Workbench which as reader will be a Pyton script.py Is there any transformator? Thanks Tereza

I have a JPG image and a CSV file with data that can be used to geo-reference it (attached).I've built a Workspace to apply the geo-referencing data to the JPG. AttributeManager makes FactorY a negative number as I found I needed to do this when working out the process using ArcGIS. In the RasterGeoferenencer, I've selected the relevant fields from the CSV file as shown in the screenshot. OutX and OutY are the Ordnance Survey Eastings and Northings.When I run the Workspace in FME 2017.0.1.1 (64-bit), I get the following error:2017-06-08 15:39:10| 0.8| 0.0|ERROR |@GeoreferenceRaster: Failed to retrieve X Upper Left Coordinate parameterI've tried setting the coordinate system on the JPG Reader and/or the CSV Reader, and setting OutX and OutY to x_coordinate and y_coordinate in the CSV Reader and then as real32. None of these make a difference.Any ideas?

Hello I've created a workspace, writing an IFX 2x3 file with two Property Sets per feature, which works well.Changing the writer format to IFC 4 the two Property Sets are not written. I've no Idea, what the problem could be and hope, that somebody could tell me, what I'm doing wrong.You'll find the workspace and the Data attached. Regards, Hartmut

Hi everybody, I need to write to a sqlite database containing tables with foreign keys constraints, but FME seems not to enforce the foreign_keys pragma directive when connecting to the database. I discovered this by running a pragma foreign_keys; query against the database with an SQLCreator (it returned 0).This is obviously a problem, because in this way the SQLite Writer can insert records that violate referential integrity.Is there a way to make the SQLite Writer execute thepragma foreign_keys = 1;directive before start writing? Any suggestion is welcome! Thanks

Hi,I have a postgresql table pre_val_error with following fields GRID_ID|ERROR_LEVEL|ERROR121|1|ERROR1121|2|ERROR2121|3|ERROR3 The requirement is to write all the records to a csv file and insert a record in Oracle with count grouped by error_level. The Oracle table details are below GRID_ID|ERROR_LVL1_COUNT|ERROR_LVL2_COUNT|ERROR_LVL3_COUNT121|1|1|1 As you can see, the number or records has to be grouped by error_level and inserted in Oracle. I have tried aggregator, counter and nothing worked. Can anyone suggest a solution for this problem. 

I have some text with HTML tags and properties. I need to strip out the HTML parts and leave plain text. I'm using the HTMLStripper which does the job pretty good, but replaces accented letters with non-accented ones plus adds question marks.How this behaviour can be fixed? Text example (before and after):<p>Iš liet. <em>šveñtas</em>, <em>-à </em>‘<span class="g7"><span class="g7">pagarbiai saugomas, laikomas; iš pagarbos neliečiamas</span></span>’.</p>Iš liet. šven?tas, -a? ‘pagarbiai saugomas, laikomas; iš pagarbos neliečiamas’. 

HelloI would like to put points on a single line to use the named transformer and get the length as a new attribute, but it seems that the feature merger used in this examplehttps://gis.stackexchange.com/questions/30518/fme-calculate-distance-of-point-along-a-linedoes not work on Esri Shapefile format, I don't know why.Any idea on how to fix points on a curve, while keeping each point as a line/different entity in the visual preview ?Thanks Edit: MeasureGenerator does not work as the curve has much more vertex than needed and they can't really be sorted