Using readers and writers to extract and load data.
Recently active
Hello I have an FME Server (2019) instance hosted on FME Cloud (standard instance size). One of the hosted workbenches allows users to upload PDFs as input, then reads the pages as raster data and carries out some operations on that imagery. Most of the time this workbench works without any issue, but a large PDF (or a small PDF with lots of pages) will cause the workbench to use all available memory (8GB, standard instance), and FME Server becomes unresponsive. A reboot and cancellation of the job is required in this situation. I have a couple of ways to mitigate the risk of crashing the server (PDF file size limit, using a job expiry time etc), but I'm wondering if there is any way to manage the memory FME Server is committing to the job. E.g. only 4GB of memory is ever committed to this workbench. Or should I be revisiting the workbench to make it use memory more efficiently? Looking for a pointer in the right direction, appreciate any help.
Hi there, I'm working on a workbench where I write DGN V8 data. I would want to use a custom linestyle from my seed file but it does not seem to work. What I do is I use an attributeCreator to create the attribute igds_style and I try to assign the custom linestyle value but I don't know what it's supposed to be. From the documentation, it is said that igds_style takes negative integer to represent custom linestyle.My question would be how to know which number is assigned to my custom linestlye?Also , do you have an other idea as to how to write my custom linestyle ? Thanks in advance !
I want to read a specific selection from an Excel spreadsheet that varies the data displayed based upon the values selected in two drop down picklists. (See attached.) My Excel knowledge is not great....any suggestions gratefully received.
We have a ESRI FGDB file available with .z02 file extension. Is it possible to read FGDB data on FME without ARCGIS ? Can we upload FGDB file to Oracle spatial database through FME ? Any pointer on this would be appreciated
I cannot import a file geodatabase into FME 2014. I am using ArcGIS 10.1. I checked with the data provider and they are on the same version. Also the file geotabase does open in ArcGIS but not FME. Anyone know why this may be.
I have 3,144 geotif files I want to mosaicI get the error "Too many recursive macro substitutions"Is there a maximum number of files that can be read?
Howdy, I'm running FME 2019.0 and I am having problems writing a file geodatabase relationship table, specifically working with geodatabase attachments.In my situation I am using an ArcGIS Online Feature Service Reader to read in data collected with the ArcGIS Collector App. For my purposes I have filtered out unwanted attachments and now I need to write the data as a file geodatabase with the desired attachments.The error message I am consistently getting is:|ERROR |Failed to retrieve origin row for a relationship feature with OBJECTID '558' from table/feature class 'RC_Fire_Hazardous_Trees_Removal_CIP2260'This error implies that in the origin table (the point geometry) the 'geodb_oid' is written to the 'OBJECTID' field. However, testing out the "Writing ArcGIS Geodatabase Attachments" template file (https://knowledge.safe.com/articles/45301/writing-arcgis-geodatabase-attachments.html) it does not appear to be necessary to be feasible nor necessary to write the 'geodb_oid' to 'OBJECT
Hi community, I'm confronted to a problem with DWG Writer. The problem is simple: A DWG is used to be validated and, as a report, a dwg is sent to user to show him what's correct/incorrect in the DWG... The problem is with some DWG's that contain shape files ... My writer use a template dwg file to display point as a block. At this particular feature writer , I get this error: Shape defined within template is not stored. Error When I open the original dwg in autocad I get this alert window:
Hello all,I have several hundred geoTiff tiles that I want to mosaic into a single ecw.How can I set the background of the ecw to white?Currently the ecw has a full black background, which is a waste of ink when printing.My workbench is simple; geotiff reader => raster mosaicker => ecw writer
We are looking at implementing a solution similar to the demo shown at https://knowledge.safe.com/articles/1463/data-upload-validation-and-real-time-display-1.html Can you let me know if the features and steps mentioned on the above page are possible with FME Cloud?
Currently using FME 2018 Desktop. I have a workbench using the AGOL Writer to write a large data set to an ArcGIS Online Feature Service layer as follows:Writer mode: INSERTTruncate First: YesFeatures per request set to 1000When executing the workbench, sometimes it works and sometimes it Fails and gives the output time out error 504. What's the best approach to optimize the AGOL Writer or the workbench to avoid timeout issues with AGOL? Thank you.
I have a feature layer in AGOL. What I try to do is when there is a new record added into the layer, the FME workspace published into the FME server can auto detect the changes, then trigger the workspace to run. FME Schedules can do the job, but not idea. Any ideas? Thank you.
I'm reading an Excel file with UUID fields looking like this {c52aff68-61fb-4004-bd58-84a3eb35e878}. How do I transfer them to an Oracle raw(32) fields in the Writer?
I am trying to use a WFS FeatureReader. I'm not getting any errors and it is outputting the schema and initiator but not the actual layer that I have selected It's almost as if it isn't in the correct coordinate system however I have cheked multiple times and with multiple WFS links and it's just not working. I am trying to select the "WFS Output Format" but there are no options in the drop down menu. I'm wondering if this is the issue? Or is anyone else having the issue of WFS FeatureReaders not wokring. I'm using FME 2019
I am writing data to an AGOL feature but when the process runs, one field of the data does not get written. Everything else writes properly except for the one field. The field types are correct as other similar data is written out during the process.Any ideas?I have included a screen grab of the data preview in the reader, and the data table in AGOL.Thanks,--gary
Hello !I am trying to import an IFC model into Minecraft, but some parts are causing a fatal error :PointCloudCombiner___VectorMerger(VectorToPointCloudFactory): The input geometry could not be converted to a pointcloudA fatal error has occurred. Check the logfile above for detailsI get this error with my own file, but I also get it with the file from this article.More specifically, these two readers are causing the problem : IfcCurtainWall and IfcWallStandardCase. When I disable them, I get the desired output, minus these two elements.this is what I got with my successfull export, you can see that the walls are missingI'm very new to FME, so I must be doing a basic mistake. Can someone help me figure out which one ? Thanks !
I have never used FME before and I am just trying to view a file I need for a report but I do not have the correct software to open an .las file. How can I convert it to a .pdf so I can open it?
Hello,I have an FME 2018 workbench with an AGOL Writer set up to write to a Feature Service layer in AGOL by Writer Mode: Insert, Truncate First: No (I want to keep appending different records to the table). (See screenshot below)Steps to reproduce the FME warning (error):1. First time run the FME workbench from a January data set csv file that gets geocoded to arcgisonline_polygonResults: All column fields get written to AGOL geodatabsae and feature service layer perfectly fine2. Second time I run the FME workbench from a February data set csv file that gets geocoded to arcgisonline_polygonResults: FME gives me a warning: "ArcGIS Online Feature Service Writer: Attribute 'PLAN' on feature type 'Land_Lots' does not match any field on the corresponding layer/table. The attribute will be ignored"The workbench translation is still successful. However, when I look at the table in AGOL, I now notice that the second time I had ran the FME workbench, the PLAN field go
In FME 2018 when reading out the SQL_STATEMENT from the Transformer Parameters reader, the SQL comes out formatted roughout like this example:SELECT<space><lf>SITE_ID_FS<comma><lf>LIFEFORM<comma><lf>PLANT_CODE<comma> <space><space><space><space><space><space><space>from<space>my_table<lf><space> where <space> LIFEFORM <space>= <space><apos>TR<apos> Is there an easy way to decode this back to a simple text that will run again in a SQL window ?It looks like FME 2019 handles this better, but I am limited to 2018 for now.
Hello,I tried to add attributes from Esri File (Points-at the end it were no Points, just attributes = sum of counts etc) to the Esri Polygone. It has everything worked, till the last result form aggregator. If I check result in Inspector, the result is there as I wish. But when I inspect the writer, the result is empty... I checked the Shape in ArcGIS Pro, and there is also nothing. Any ideas why? Thanks
Hello,I 've processed some data sets into one using FME 2018 and now I'm trying to write this data set to AGOL. On the AGOL account I don't have Content (Feature Service (Layers). When I insert a Writer (AGOL) I manage to 'Add a Web Connection'->Connection Name->Authenticate, which then opens a window to ArcGIS Online and I insert my credentials. Once this is complete, it takes me back to FME.I can't finalize the Writer (See screenshot below) because I need to fill the Feature Service. When I select the Feature Service it just loads for a long long time not doing anything (see screenshot below). Am I supposed to create an empty feature service in AGOL first, then attempt the Feature Service connection (See screenshot below)?I was under the impression once I finalize the Writer "If the Feature Service directive refers to a Feature Service that does not exist, and the writer mode for all feature types is INSERT, then the ArcGIS Online Feature Service Wr
Hello, I'm trying to write tags to a dgn-file on 3D solids which i have generated in FME but no tags appear. It works fine if I use other geometry types i.e. igds_shape but then I do get a lot of features which I would like to avoid. This message makes me want to ask if anybody out there has found a workaround: DESIGN WRITER: Tag writing is currently not supported for the associated element Best regards Olof
I have an AttributeFilter that creates multiple Esri shapfiles (filter by an attribute value) that use one esri shapefile writer to write out each shapefile. Is there a way to compress (zip) each of these shapefiles individually? I know there a shapefile compression option to create a .shz, but a .zip file is required.
I would like to transfer the fmesuperuser role privileges to an Active Directory role.In the FME Server documentation, there is an article about how to do this using the SECURITY_SUPERUSER_ROLE parameter in the fmeCommonConfig.txt configuration file. Unfortunately, this does not seem to work. The parameter line mentioned (SECURITY_SUPERUSER_ROLE=fmesuperuser) is not present in the configuration file. Also just adding the line as a parameter does not seem to work.The answer in the article already present in the knowledge base is not sufficient, because this only concerns assigning an Active Directory user to the role.I ruled out errors in the Active Directory distinguished name by testing with a test FME Server role (non-AD) and using this in the configuration file (e.g. SECURITY_SUPERUSER_ROLE=testsuperuser).How can I accomplish transfer of privileges on the AD role?
Hello we installed the new FME 2019 and when i try to use the LDAP reader i recieve the following error:Is there something required to ahve java work in the new version of FME? The workspace may run slower because features are being recorded on all output ports.The Java Virtual Machine could not be started. CLASSPATH = '-Djava.class.path=C:\\Program Files\\FME\\common-webservices.jar;C:\\Program Files\\FME\\plugins;C:\\Program Files\\FME\\plugins\\commons-compress-1.17.jar;C:\\Program Files\\FME\\plugins\\dropbox-core-sdk-3.0.11.jar;C:\\Program Files\\FME\\plugins\\hsqldb.jar;C:\\Program Files\\FME\\plugins\\ili2c.jar;C:\\Program Files\\FME\\plugins\\ili2fme.jar;C:\\Program Files\\FME\\plugins\\jackcess-2.1.11.jar;C:\\Program Files\\FME\\plugins\\jackson-annotations-2.9.8.jar;C:\\Program Files\\FME\\plugins\\jackson-core-2.9.8.jar;C:\\Program Files\\FME\\plugins\\jackson-databind-2.9.8.jar;C:\\Program Files\\FME\\plugins\\jackson-dataformat-cbor-2.9.8.jar;C:\\Program Files\\FME\\p