Using readers and writers to extract and load data.
Recently active
Hello there.I'm having trouble with an Excel writer.Where the value being read in FME is completely numeric, the data value is output with an additional '.0' suffix. I've tried changing attribute data types to auto or string, and I tried choosing 'Treat as Text @' from the attribute formatting/'Edit...' button in the writer - no luck.Example...I've got the following values being written to an attribute in an Excel writer...TEST VALUE HERE 12341234567ABC1234And it is outputting the following values to Excel...TEST VALUE HERE 12341234567.0ABC1234I don't want the ".0" attached to the end of values that are fully numeric, rather I want all of the values in the attribute to be treated as a string.Perhaps this is just an issue with Excel itself. When I look at the cells with these particular values, Excel gives me a warning box that shows 'Value stored as text'; when I choose 'Convert to number' the formatting appears as expec
Hello, I just moved to fme 2019 and in this example I'm using workbench FME(R) 2019.0.1.0 (20190506 - Build 19253 - WIN64) I have very simple workspace: creator -> featurereader (postgis) -> gml writer When I run it I don't even get to the breakpoint. On reader there is log: 2019-07-18 21:46:06| 7.6| 7.1|FATAL |POSTGIS reader: An error occurred. FME will attempt to provide more information on the error, but this may cause the translation to be terminated2019-07-18 21:46:06| 7.6| 0.0|INFORM|Successfully closed POSTGIS database reader2019-07-18 21:46:06| 7.7| 0.1|INFORM|Successfully closed POSTGIS database reader2019-07-18 21:46:06| 7.7| 0.0|FATAL |POSTGIS reader: stk::ex::bad_expected_access I discovered that problem is with one row. In column of type:timestamp with time zone value is:-infinityIn version fme 2016 I don't have that problem. I executed that workspace with fme 2016 and 2019 and here I can see the difference in fme postgis reader version: I did
I'm experiencing an issue writing into file geodatabases using the FILEGDB writer. The issue occurs when eitherThe geodatabase has been created by ArcGIS Pro, orAn existing geodatabase has had a feature class pasted using Pro, thenTrying to create, or drop and create, a feature classAs with many things the problem is not always consistently apparent, but occurs much more frequently than not.The issue shows itself by either not being able to drop and create an existing feature class, or by not being able to write a new one. Instead, a non spatial table is created with the schema, but no data. Deleting this sometimes seems to leave behind ghost feature classes that appear if the geodatabase is repaired, or if a feature class is pasted in that has the same name.Using the GEODATABASE_FILE writer appears to be fine (but not an option for us when publishing to FME Server), and truncating and inserting into feature classes also appears to be fine (with the FILEGDB writer).I'm using de
When I post a new question on this forum, the attachment button does not work. Clicking on the button does nothing. When I hover over it, my cursor becomes a hand symbol.I would like it to work, as sometimes I need to attach a file to clarify my question.
Greetings.I am trying to export a Sqllite (geopackage) to SQL Server.Keep getting an error despite changing the options.Reader: Writer: Error:Transactions are being used by the Geodatabase WriterAn error occurred while attempting to open the table, feature class or relationship class 'main.airports'. The error number from ArcObjects is: '-2147467263'. The error message from ArcObjects is: {}An error occurred while attempting to open the table, feature class or relationship class 'main.airports'. The error number from ArcObjects is: '-2147467263'. The error message from ArcObjects is: {}A fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for detailsStored 1 feature(s) to FME feature store file `C:\\Users\\User\\AppData\\Local\\Temp\\wb-cache-geopackage2mssql_spatial-NJVZFF\\Main_airports -1 10 -1 0 89fdbd78da335154a0ddf39d89823152eee47e98.ffsupdating' Any suggestions?? Thanks,Clive
I'm trying to take an RGB raster and convert it to Gray+Alpha. I do the following:Use RasterExpressionEvaluator to calculate linear luminance from the three RGB bands into a single band with interpretation Gray8Use RasterBandAdder to add a band with interpretation Alpha8Using RasterBandPropertyExtractor and Inspector in the workspace, I see that the result have two bands with the correct interpretations. However, once the result is written using the ECW writer, all GIS tools agree that the two bands in the file does not have an interpretation (I have checked the file with QGIS and FME Data Inspector and the bands come up as "Undefined" or "UInt8).I tried swapping the ECW writer for a GeoTIFF writer and in this case the file came out with correct band interpretations. Is this a bug in the ECW writer or is there another way to set the interpretation?
But i have Always the same message :Polygon feature must have at least 4 coordinates to be valid for the shape file. The feature will be skippedREJECTING BELOW FEATURE:And i dont understand what is really the problemCan you help me pleasethanks
The MS Access (JDBC) Reader gives an error reading table schema's in FME 2019. The workspace still works fine in FME 2018.1, but generates the following log in version 2019.0: MS Access (JDBC) Reader: Connected to 'UCanAccess driver for Microsoft Access databases using HSQLDB' version 'V2007 [VERSION_12]' using driver 'Ucanaccess' version '4.0.4' built against JDBC version '4.0'MS Access (JDBC) Reader: Error reading schema for table 'qry02_Energiesnoeiers'. Error: <null>java.lang.NullPointerException at COM.safe.fme.jdbc.msaccess.MsAccessBackendHelper.createColumnMetadata(MsAccessBackendHelper.java:343) at COM.safe.fme.jdbc.JdbcBackendHelper.getTableSchema(JdbcBackendHelper.java:129) at COM.safe.fme.jdbc.JdbcReader.readSchema(JdbcReader.java:948) at COM.safe.fme.jdbc.JdbcReader.readSchemaHelper(JdbcReader.java:872) at COM.safe.fme.jdbc.JdbcReader.readSchema(JdbcReader.java:830)java.lang.NullPointerExceptionFailed to obtain any schemas from reader 'MSACCESS_JDBC' f
We are trying to upgrade our SQL Server to 2016, does the latest version of FME Workspace compatible with SQL Server 2016?
I am suddenly receiving a pipe separated text file with imbedded pseudo-unicode characters that are supposed to be a macronated 'o'. Unfortunately it translates to a ^Z in the ASCII file.All the vowels can have macrons in Maori and there is a new policy that all government departments must add macrons. If all software was unicode aware then this might work.Some programs will handle this, reading the whole file regardless of the ^Z but many stop. The FME CSV2 reader stops. Oddly the FME Textfile reader does handle them with encoding set to DOS-Latin-1 (ibm-850)What can I do?The simplest idea is to translate the pair of characters ^Zo back to a plain ascii o.Surely tr could just strip the ^Z...nope.I have tried to use utf-8 encoding parameter on the CSV reader and other tricks with tr without success.I have attached a test sample.asc of two records.Unix wc -l returns a count of 1, not a good start since I can cat two records.
Hi I have a list of grid tiles on Esri shape format. Those tiles are not clustered, tiles can be anywhere in the country. I need to extract geometry within those Tiles, from an Oracle spatial DatabaseHow do I go by without reading all the features on the entire Database?thanks
Hi all,I have a set of 8000+ GML files that i wish to batch process into a geodatabase, i have found that putting them a workspace runner is effective but slows down massively past 50 GML files. Therefore, i want a way to write a new geodatabase file every 50 features, to reduce the 8000 GML files to 160 geodatabases to then combine afterwards.Has anyone any ideas? Apart from a huge conditional value in attribute manager!CheersJack
I am having some problems writing extended attributes to a dwg, I have attached the source dwg and my workflow.The source dwg contains a polyline that has several fields of extended data, my aim is to be able to change a few of the fields with a string replacer, for example in this case change “JSY” to “CWG”.I am able to inspect the extended data list in the reader and change the values, however when it comes to writing to dwg the attributes don’t come through. Running the command XDLIST, shows no extended entity data on the entity.Any help would be appreciated.
Hi there - I'm trying to make schema changes to an SDE feature class as well as an SDE table.... both have attachments and the obligatory relationship class. When I try and output to the writer using "Drop and create", the attachments (and relationship class) are deleted. But when I output using another option (e.g. truncate), they are not deleted. I'd like to use "drop and create" because we need to reorder fields and add new ones. Wondering if I'm doing something wrong, or not understanding the process, or not using a much better alternative. Or possibly all 3!
I have multiple FME workbenches that read from a single SQL Server Spatial Database. This is a global database so I often have more than one workbench trying to access the database. However, it seems like the first workbench is locking the table preventing others from reading from it. This seems more likely to be an issue if the SQL table has triggers enabled. Is there away to get around this problem?
Hello everybody, I need to create a kml file with 3D geometry in .dae format (SketchUp). The links are in the table of my source file with point geometry. I need to obtain this: Is there anybody who knows how to do?Thank you!
HiI juste use an AttributeManager after a reader which works fine. My value is changed.but the writer doesn't update my record in the table.I tried all options in the writer to match the row selection ... nothing works.Do you have an idea about this issue ?Thanks
Hello, I would like to write some data from my statisticscalculator to a sharepoint list. If the list with the autocad input name does not exist, it should create a new list with the same name as the autocad input. After Running my current workspace it tells me the following:Cannot find a matching schema named 'C:\Cloud\Sync\_Projecten\FME\Inwerken Progress Checker/Input\Fme Generated\Karteringen&Areas.dwg' in the known set of schemas: ''. Known schema sources are: 'SHAREPOINT_2'. Please verify writer feature type configuration.Python Exception <KeyError>: 'C:\\Cloud\\Sync\\_Projecten\\FME\\Inwerken Progress Checker/Input\\Fme Generated\\Karteringen&Areas.dwg'A fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for details I am confused as to why it it wont create a new one. My writer has been set up like this: my Current workspace looks like this T
I have a input file geodatabase that just has points. The workbench first uses the file name extractor transformer to get info on the input file. I use the results from the file name extractor to build out the output file path because I want it to be dynamic. For ExampleInput: C:/Temp/Input.gdbOutput: C:/Temp/Output.gdb (Dynamically created based on the file dir of the Input, name would also be generated)On the output file geodatabase destination fanout directory I put in the user param "OutputDir" that is blank to start but filled out by an attributeCreator that overwrites the value after the file name extractor transformer runs, same for the output filename but it does not seem to work dynamically and the value must be hardcored in the writer to work?
Hi all,I am trying to find a solution that will allow me to query a record in AGOL and compare the attachment globalID to the local attachment globalID. Ideally, I want to either keep the existing photo in our system as it is the same as online or download a replaced photo or download only any added images to the record.Using the updatedetector is the obvious way. I have tried to explode the attachment list etc. and even make the globalID populate another field for comparison but I get nowhere.A few things about the jobs being audited via collector.the file name isn't processed until fme brings inhouse so I cannot compare via filename only.The user may add additional photos at a later date or may delete the existing attachment only to replace with a new one. In that case, they have the same name.Any help and suggestions would be appreciated,Thanks all.
FME has a WLAS reader, but i do not see a WLAS writer. Will FME be developing this in the near future? and if not, can you suggest a workflow for transforming a csv file to a wlas file format? thank you!Dan
I am having massive problem in the time taken for a workbench to read an FGDB.Is there a way (or a different reader) which can speed this up? It's laughably slow at the moment and completely unusable and this is before I've even done anything with a clipper transformer.
Hello friends,I am stuck at as to how to determine parameters to do a georeference using transformer Rastergeoreference.Please see attach sup file (renamed it to .txt). What I understood (I maybe wrong) is the parameter LSR_CAMERA is the center point and OPK_LSR is the rotation (3 values in radians ) but I dont know how to convert into degrees ( 1 value). Basically what I need is the following parameter to do a georeferenceBy Point and AngleXY Upper Left CoordinateXY cell spacingRotation (Degrees) Appreciate your help
I have a workflow which writes data to Esri SDE (Enterprise Geodatabase) via the Geodatabase Writer.It is dynamic and reads schema definition from a CSV file. In the Geodatabase the target schema is already defined at FME write time. It is created beforehand in ArcCatalog by importing an XML workspace document.This workflow produces compatible results for Personal GeoDB, FileGDB and SDE with identically configured writers for MDB, FileGDB and SDE.Up to now I used SDE based on SQL Server or ORACLE. So far so good. Now my problems start when I try the same workflow on an SDE based on Postgresql.The symptoms I notice are:1) In ArcCatalog: After Import of the XML workspace document all Table names are as expected (mixed case) but all column names are converted to lower case in contradiction to what happens on ORACLE or other environments.2) Writing data gives No WARNING, NO ERROR not any hint something went wrong but all columns are empty After studying Esri SDE Postgresql docu this is no
I received the following error message when running the job on FME server (2018.1). But this problem does not happen when running on FME desktop (2018.1). Any suggestions ? I suspect that the problem may be the path reading issue for FME Server. The filename and path works when checking in window explorer. Thank in advance for all help.Error in the Kingdom Well Reader engine: The file could not be found.: G:\\SMT\\1 Production Projects\\Barnett (SQL Server)\\SMT_Barnett\\SMT_Barnett.tks