Using readers and writers to extract and load data.
Recently active
Hello, I am trying to read from a SDE feature class. when I try an add the reader I get the error "Error while retrieving layer info structure for layer 'shape' in table 'VEG.NONPRODUCTIVE_AREA_EVW'.:SDE_ERROR_CODE(-20) Layer not found" It the table is a a postgis table with versioning. I can see the table in my table list when connecting. Any one have any advise?
Hi all,I am doing my first steps with FME.I am trying to parametrize a CSV reader as follow:But parameter is replaced by its value:How to do this? Many thanks for your help!
Hello, I've geoereferenced a raster map using ArcGIS and exported it as GeoTIFF, however, I can't read it properly in FME data inspector, the image appears all black. Have anyone before faced the same problem ? Thank you.
Hi all,I am doing my first steps with FME.I am trying to read a MongoDB collection using the Mongo reader. To retreive the unique document identifier _id, I use the mongodb_id format attribute. Is it correct?Then when data are loaded, this attribute does not seem well encoded: Id (encoded: utf-8): ??{y?q?M????z?'How to fix this? Many thanks for your help!
Hi,i want to geocode addresses by my own ArcGIS Server geocoding service. The adresses are in a csv-format. In a second step I have transform the adresses from csv in to JSON. After that i want to get the geocoded adress via the HTTP-Caller because it is not possible to post adresses via the Geocoder-Transformer in the JSON-Format.It doesn`t helped me to post the address in a single LineString.Can anyone help me to geocode the adresses?
Dear All,I have an issue while using Dissolver and Aggregator I get multiarea of 5 polygons, which look merged in the Inspector. But when writing to PostGIS, aggregated geometry is split again into separate polygons. PostGIS is accepting only polygons as geometry. I know that if the PostGIS accepts only single polygon, but writer attempts to load a collection, then a collection will be split. The question is if there's a way to aggregate multiple polygons into one without collection. Single polygon needed only to set the extent of the layer, so envelope like feature will do as well.Thanks a lot for your answer.
Hi! I received an IFC file from a costumer and when I tried to inspect the file in Data Inspector, I received the attached error message. I don't know much about Revit so I'm at a lost. Any help to what this means, would be greatly appreciated! Thanks,David
Hi,When I try to open a workflow file that has a PostGIS reader or writer FME Workbench crashes immediately, without any dialogs or crash logs. This happens whether I open the file by double clicking, right click "Open with...", drag and drop the file or "File > Open".Similarly, if I try to open a PostGIS table in the data inspector it crashes too.I can open the database and its tables in PGAdmin so I know the database is up and running.I've just updated to the official release of FME Desktop 2018 on Windows 10 (I've previously been using the beta versions without issues). Thanks,Aiden
Hi I have a set of .asc files. I am looking to use FME to generate a point cloud then build a Terrain in an ESRI's dataset from the asc files. Is this something I can achieve using FME Desktop or do I have an ArcGIS 3D extension license.
Hello,I'm new in FME but have some basic knowledge. I am trying to fetch some data from excel file and use it for analysis and making graphical representations (charts) but I am stuck with the steps much prior to this analysis. Unfortunately, excel file is not very well organized nor structured so I'm trying to overcome this problems and I managed to read some amount of data in structured form.What I'm having problem with is this: excel is organized in many sheet: first (main) sheet has summary data from all the rest of sheets and one column is hyperlink to a specific sheet which holds the data in more detail. I would like that after the running of the workbench I have the ability to choose the specific sheet for analysis based on list of sheets I have already obtained from hyperlinks in the main sheet.I tried to figure this out for the whole day without success. I would appreciate any suggestions or pointers.Thank you in advance!
Feature writer transformer does not expose all writer parameters. I'm passing fme_db_operator to it with the value of update, but it tries to insert. In the past I have been better able to troubleshoot with bulk insert off (it's on by default), but I can't find it to turn it off. Is that because it's not exposed?
I am getting the following error,when trying to write all the NITF attributes to the PostGIS table.Bulk copy failed on table 'public.EGPL' using delimiter ':'. Error was 'ERROR: value too long for type character varying(4)CONTEXT: COPY EGPL, line 1, column nitf_fhdr: "NITF02.00"'A fatal error has occurred. Check the logfile above for details... Last line repeated 2 times ...FME Session Duration: 3.2 seconds. (CPU: 2.0s user, 0
Hi,I am getting the following error when I run a workbench in Desktop 2017Deatils of the error areProblem signature: Problem Event Name: BEX64 Application Name: fme.exe Application Version: 2017.7.26.17259 Application Timestamp: 58b68360 Fault Module Name: ucrtbase.DLL Fault Module Version: 10.0.10586.212 Fault Module Timestamp: 56fa10e8 Exception Offset: 00000000000698fe Exception Code: c0000409 Exception Data: 0000000000000007 OS Version: 6.3.9600.2.0.0.16.7 Locale ID: 3081 Additional Information 1: bef8 Additional Information 2: bef885c27b607af464c2616e642a10f8 Additional Information 3: fcaf Additional Information 4: fcaf8a62e8bcb47b1e98dbc1383ebc13 Read our privacy statement online: http://go.microsoft.com/fwlink/?linkid=280262 If the online privacy statement is not available, please read our privacy statement offline: C:\\Windows\\system32\\en-US\\erofflps.txtThe log file error message ischild killed: unknown signal The workbench is using workspa
We are performing an update to ArcGIS Online where the source data is from ESRI ArcGIS SDE database. This is the error that I encounter right now. I already tried to filter all fields using the NullAttributeMapper to replace Nulls with Empty String, but still I encounter this error. What is meant by this error? ArcGIS Online Feature Service Writer: 'addResults' error for a feature in 'Sewer Connection'. The error code from the server was '1000' and the message was: 'Data is Null. This method or property cannot be called on Null values.' ArcGIS Online Feature Service Writer: 3772 features successfully written to 'Sewer Connection', but the server rejected the 2 features in the last request due to errors. See warnings above. Aborting translation
When writing a table with oracle writer (type: spatial object) fme cannot create primairy key or index when the name of index is getting long. For example : CREATE INDEX "SPOT.ACCRES_KNOOP_OLVS_ID01" ON "SPOT.ACCRES_KNOOP_OLVS" ("ID") It gives a error: SQL Error: ORA-00942: table or view does not existHowever , the table does exist. Copying pasting the command from fme -logs to sqldeveloper gives the same error as in FME. However, if i shorten the indexame in command like e.g. ACCRES_KNOOP_OLVS_ID the command executes fine: index createdShould FME not fix the indexname by itself so it does not give error messages when making indexes ? Is this a bug ? Current FME version is Desktop 2017.1Best regards, Ed
Hello,I want to create a workflow that will monitor updates to tabular SQL Servers tables, which would send email notifications when my workbench has updated "error" tables. My workspace is effectively processing data and writing these error tables. But I am unsure of the best way to create database "listeners" that would note when new data has been added to an error table and then send out an email notification via FME Server. We have FME Server up and running and it does send email notification for when the workspace fails to run. But we have never sent email notifications for when a SQL Server table has been updated. Can anyone provide some suggestions on how to best do this with some links and possibly an example work bench that "Listens" for database updates? Thank you!
Details :I tried to add Dataset & Pathname reader followed by StringSearcher, FeatureReader and writer as format JPEG.I am getting desired output till feature reader , when i checked with logged but i am not getting files in output folder.
MapText Labeler seems to have an issue over offsetting lower case text characters g,j,p,q and y when the output is dwgThe source data is a shp fileI use MapText Styler to create a text buffer around each line.In MapText Labeler I set the Line Rule Properties toHas anyone experienced this before?RegardsRazza
I am trying to compare and update a field in a table. I have several tables from sde that require a date field to be updated. This worked in an earlier version of FME. In the workspace I brought the tables in and duplicated on writer. In the latest version of FME I get the following message:"Using ArcSDE Writer to write Spatial Database Engine 3.0 dataset `gis'ArcSDE Writer: Connected to version 'SDE.DEFAULT'Writer `SDE30_2' of type `SDE30' using group definition keyword `SDE30_2_DEF'Required columns 'GlobalID, ' not specified for predefined table 'SDE.SWGRAVITYMAIN'. Using Definition from DatabaseGrid size 0 (-6) for table 'SDE.SWGRAVITYMAIN' doesn't match that specified in mapping file (0)Existing SDE table 'SDE.SWGRAVITYMAIN' allows the following shapes: SDE_NIL SDE_LINE SDE_SIMPLE_LINE SDE_MULTIPART . Shapes specified in mapping file for table allows: SDE_NIL SDE_POINT SDE_LINE SDE_SIMPLE_LINE SDE_AREA SDE_MULTIP
Hello, i Need to write the data to ESRI Geodatabase(Personal DB) mdb: after start the process -> the data will be writen, message 'Translation was Successful' will be written as well, but the process runs until the button 'stop translation' will be pushed. If the Writer is disable, and put inspector instead: everything works fine. Any idea? What could it be? Even if i get the data written, im afraid, that something goes wrong and will be done not until the end (as long as the process could not stop). p.s. i dont have any workspacerunner in workbench. Only Attributecreator and tester. I'm working with FME Workbench 2015.
Hi All,I'm having trouble with developing room polygons from walls for a building from an autocad file. The difficult part is snapping lines together. I have a workflow, but it only completes about 50% and the rest will not budge. Attached is the workbench along with the CAD file. Any suggestions would be appreciated!David building-spaces.fmw
According to the CityGML v2.0 standard, the recommended namespace prefix in case of Bridges class is "brid" When i'm using CityGML writer to output my model of Bridges, the inline definition of my CityGML profile contains the namespace and path to the .xsd schema file. In case of bridge the namespace writes :bridge", whereas in the case of other schema definition it contains the namespace prefix (tun for tunnel,bldg for building). Could this be a problem with the GML writer?
I can only use JDBC for my msaccess database in the office (no ODBC or MSACCESS DRIVERS in locked machine).. trying to load ~600,000 features causes the error : java.lang.StackOverflowError eventually.. tried changing as described here: https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/msaccess_jdbc/msaccess_jdbc.htm FME_JVM_MAX_HEAP_SIZE variable, re-started FME, rebooted machine, doesn't seem to do any different.. I know I'm close.. I just don't know how to make this variable setting to add more memory to Java..
Hi,I need to read approx. 1.4M records within a single workbench process. No getting around it. They must all be read since they are participating in a FeatureMerger later and any one of the features might be a candidate.The reader starts out fine reading 2500 records a time under 10 seconds a pop. However this slowly degrades so that after 800K records it is now 30 sec. a pop and near the end close to 50. Soup to nuts, the entire read takes about 4 hrs and 45 min. RAM/Network speed really isn't a problem. So the gradual increase of record processing time seems odd.Is there any tip/trick for reading a large number of records (>300K ) from PostGIS (or any) reader so that the amount of time is significantly reduced? I was thinking of amping up the "Number of Records To Fetch At A Time" but I don't want to make matters worse.Thanks very much,Pete
Dear allI am trying to compose a PostgreSQL function in FME using the SQLExecutor. My function installs correctly within pg admin, but since there is a dollar($) symbol included in the query, my function won't install correctly via FME and I receive the following error:Error executing SQL command ('CREATE OR REPLACE FUNCTION gv.create_tables_from_foreign_schema(_foreign_schema character varying, _local_schema character varying) RETURNS void AS $BODY$'): 'ERROR: unterminated dollar-quoted string at or near "$BODY$" The function looks like this:CREATE OR REPLACE FUNCTION $(p4_p3_schema).create_tables_from_foreign_schema(_foreign_schema character varying, _local_schema character varying) RETURNS void AS $BODY$;declare selectrow record;beginfor selectrow inselect 'CREATE TABLE ' || quote_ident(_local_schema) || '.' ||quote_ident(t.table_name) || ' AS SELECT * FROM ' || quote_ident(_foreign_schema) || '.' ||quote_ident(t.table_name) || '' AS qry from ( SELECT table_name FROM