Using readers and writers to extract and load data.
Recently active
Hello,I'm implementing a workflow where I need to move data from a file geodatabase to a versioned SDE geodatabase. In this workflow, I need to keep GlobalID values while moving records from source to destination.I set the "Preserve GlobalID" to "Yes", but I'm getting the following error:"Could not unregister GlobalID column 'GlobalID' in table 'Table_Name'. The error number from ArcObjects is: '-2147212936'. The error message from ArcObjects is: {Unregister GlobalID column is not supported for versioned or replicated data.}" Appreciate if you guide me to any solution or workaround for that. Thanks
HiNew to FME. Familiar with ETL/ELT tools.I would like to read rows from a Postgres DB and load them into Snowflake DB.I want to do it incrementally, i.e. read from Postgres only the rows that have changed since the last time the Workspace run. I have some timestamp field in the table, named "last_updated".The query should look like: "select * from table where last_updated > /previous_max_last_updated",I thought maybe doing it using a special management table, that will hold the values of last_updated for each source table, but it will require some more reader and writer in the workspace. Is there a way to hold variables from session to session? I mean, from 1 workspace run to the next? Thanks!
I have a File Geodatabase (ArcObjects) Writer that points to a FileGDB I want to update. When the Writer Mode=UPDATE, the feature count from Reader to Writer is very slow, at a rate of ~1 feature per second. If I were to perform DELETE first and then INSERT as a way to update, then it's very fast. Why might UPDATE be so slow? There are 2 bottlenecks I think might be occurring:The field I'm updating on is not a unique field - This field represents a "tile" of records, by which I want to update on a tile-by-tile basis.Grid 1 is set to 100. When updating database tables, it's recommended that one removes spatial indexing, perform update, then recreate the index. Is there a way to do that with the FileGDB ArcObjects Writer? Might I have to use PythonCaller to call arcpy.RemoveSpatialIndex()?
I have a workspace that runs just fine on deskop, version 2019.2.I publish this workspace to FME Server, version 2020.2 and I have two problems:It is VERY slow. The whole workspace on desktop runs in 2.5 minutes. On Server, it runs for over 20 minutes. The part that failed, buffer and snipper, takes about 5 seconds to do on desktop with about 4000 records. When it fails on server, it has only processed 1000 records in the 20 minutes.It erred out with this cryptic error: 856 FFS writer: Failed to open file '' for writing. Please ensure that you have sufficient privileges to write this file. If the file already exists, please ensure it is not open in another application857 UnitSegmentCreator_Centerline_Input1589901888 Input Splitter (TeeFactory): Internal Error: Failed to build feature table858 Closing the Geodatabase reader859 Internal Error: Failed to build feature tableI'm not sure if the two are related. I would appreciate any help on how I can debug where the issue might
Hello all,I have been trying to convert a topjson/geojson file to a cesium 3d tileset. I have been able run the conversion but i cannot get it to display in cesium. I feel that this may be caused by the coordinates not being converted correctly. I cannot figure out how to fix it. I tried using no coordinate system selected and LL-WGS84, but neither worked. I did notice the area cesium zoomed to changed but i could still not see the shapes. Any help would be greatly appreciated. Below is a link to the geo and topo json files i tried. https://le-temp-public.s3.amazonaws.com/counties-us.topo.jsonhttps://le-temp-public.s3.amazonaws.com/counties-us.geo.json Again thanks
Hello.Can I read data from AGOL using the editor account? I see all the objects when reading and writing data (hosted) with the admin account. Objects are shared with the editor like for "organisation". But when I add a reader / writer and try to read the available objects, I get a notification Note. I use FME 2017.1.0.0 (win 64).
In my workspace, I've three ESRI GeoDB reader Feature Types with WHERE condition. Here values in the WHERE condition are passed from a private/published parameter input values.Few things to be considered -There are approximately around 100 values to be passed in sequential order from Excel sheet to Parameter values.Workspace has to run completely for every input parameter value Currently I was passing each value manually to the parameter and is time consuming.Any thoughts on doing this more efficiently and quickly? Thanks in advance!
Hi, We have implemented a FME script that an ESRI GIS database on several computer. However the script fails on one computer and succeed on all the other. Here is the error messge return in the FME log file.2020-03-25 14:45:29| 23.0| 0.0|ERROR |FFS writer: Failed to open file '' for writing. Please ensure that you have sufficient privileges to write this file. If the file already exists, please ensure it is not open in another application2020-03-25 14:45:29| 23.0| 0.0|ERROR |BADNEWS: Internal Error: Failed to build feature table class StatusInfo *__thiscall STFFeatureTableWrapper::WrapperFeature::FTFeature::initChangedValuesWriter(void)(c:\\code\\fme\\foundation\\framework\\engine\\stffeaturetablewrapperfeatureftfeature.cpp:764) - class StatusInfo *__thiscall STFFeatureTableWrapper::WrapperFeature::FTFeature::initChangedValuesWriter(void)(c:\\code\\fme\\foundation\\framework\\engine\\stffeaturetablewrapperfeatureftfeature.cpp:764)2020-03-25 14:45:29| 23.1| 0.1|INFORM|Cl
Hi,I have been trying to create a multi-component polygon consisting of line, linestring and arc. The arc parameter consists of Start/From, Centre, End/To, the Radius in metres as well as the arc direction, clockwise or anti-clockwise. Negative radius indicates anti-clockwise arc. Using the python script posted by @takashi in here, I was able to generate most arc except for some instances. In the sample data, I have included 3 polygons. While ID=47 works fine, the other two polygons (ID=407 and ID=482) failed. I tried the Arc Property Setter method in the same post, unfortunately it yields an undesired gap at end points. I have attached the csv file containing the 3 polygons records and the FME workbench. Any help will be much appreciated. Thanks in advance.Lawrence Correct output polygons for ID=407 and ID=482 as shown.
When publishing to ArcGIS Portal the layer has some default configurations that I would like to change. For example, share to a group/everyone, disable editing and prevent the layer from being deleted. Any ideas in how to do that using FME?
I am working on land xml coding in primary stage and I need some samples of basic geometry (point, line, polygon etc.)
It is possible to get the units of a Revit model with the Native Revit reader? I can't find it defined anywhere. Anybody know if this is anywhere? https://www.cad-notes.com/revit-units/
Hello all, Last week we have upgraded FME Server from version 2018.something to version 2020.0.2. Initially everything seemed to be running smooth: scheduled jobs are run on schedule, and can be run manually as needed. But today I ran into a problem: it proved impossible to run a workspace manually from 'Run Workspace'. All I got was an error message: 'There was an error submitting the job.'.Delving into the logging, at last I found something in log file <server_name>_jobsubmitterservice.log: (located in Resources > Logs > service >current): the job was submitted as user guest, and this user was disabled.After enabling the user, I tried to rerun the workspace. THis gave me the same error message, but the log file provided new information: user guest lacked proper permissions.So I turned to the FME Server Documentation, where I learned that a user needs to have 'Run permission on the applicable repository'. As users (can) get their permissions from
Hi, I have a huge dataset sitting in a table in PostGIS, there are loads of duplicate geometries that I would like to identify and hopefully remove. I am trying to see if there is a faster way than doing a geometry match. Is it possible to create a hash of a polygon so that I could compare that? I can see its possible for point but not polygon data in PostGIS. In there anything FME can bring to the party?Thank you
Hi, I am working with an ifc extension file containing 11 floors. I worked with separate workspaces for each floor and created their topology. I want to calculate the shortest path in the building. For this, I have to combine the topology of each floor with stairs, how can I do this?Since the nodes created for topology slowed down the system, I had to work on each floor separately.
I have a shp-file containing Picture frames with attributes showing the name of the frame. I want to use this shp-file to select the correct raster images for the TIFF-reader. There are so many that it would take me some time to select the right ones... Fme_basename, the name of the TIFF-Picture in my folder photoID, corresponding name of the Picture in a subset of Pictures that I want to select for the reader
Is their any reader in fme available to read data from getech and convert into fgdb??
Hello,I'm looking for some help running a DXF to KML. I've not done this type of conversion before and wondered if there is anything else that should be added to the process?I'm currently running it on a generating workspace and a dynamic schema to write. The DXF contains:Point, poly, line, annotation and the coordinate system should be WGS 1984 UTM Zone 29NAny help appreciated.Thanks
Hello there we have this type of structure in our data Attvaluecity1ph1,ph2,ph3 and we want to get this structureattvaluecity1ph1city1ph2city1ph3 Any idea, please Thank you
Dear FME CommunityI have 70 different species datasets - Species 1, Species 2, Species 3, ..., Species 70. Each dataset is stored in ArcGIS Online. I want to write each dataset to Shapefile. I am trying to create a reader / parameter that will enable me to pick a single species to write to shapefile when I run the FME script. Can anyone assist please?The ArcGIS Online reader requires the following parameters for each species:Feature Service : MyFolder/Species 1/Species 1_WFLLayer: Species_1Regards, Damian
I'm running a process to generate around 1500 separate DEM's. Seems without incorporating break lines this process will complete, however incorporating break lines for the extents of the models has resulted in FME breaking the process about 1/10th the way through the series of groups with the following error message: get_next_capacity, allocator's max size reached I couldn't find anything with this error. The group by is set to blocking to ensure all features are loaded into the Generator, Both contours and spot heights are filtered to ensure groupings meet the minimum requirement to generate the model and carry the same group ID, as do the break line polygons (as these are also used later to crop the DEM). Any advice would be gratefully received . CheersChris
We are running into this issue https://knowledge.safe.com/questions/71601/mysql-database-connection-error.html and don't know if this is representative of what we should expect.
Hi Guys,i have a block on Layer 0 which includes also another block which is called Heizhaus.... i explode the block and Use block feature type for components so that i have them in the original layer in the Output: i also use a template filethat are the Basics:so at the end of my workflow (rot 1) the text is in the right Rotation and everything is fine ...but when i write it to the ACAD File teh text gets a Rotation which is false and i don't know where this Rotation Comes from. (rot 2)i have tried to write in the real dwg writer….. i have tried to fill certain Attributes like AutoCAD_rotation, fme_rotation, AutoCAD_text_rotation.. i have tried to read the Output DWG and set a new rotation and no Logical number (e.g plus 180, 360 Degrees or something like that)Nothing happens...Always the same false rotationAny ideas or helpsGreetzFranco
At the moment, the FME script extracts a dataset from ArcOnline and creates a new document with a filename of the previously edited date. Now, I want to have the data imported into Google Drive using a GoogleDriveConnector. However, when doing so, it creates multiple copies of the same document in the drive. Furthermore, when using a Creator instead of an excel reader, I am greeted with this line: Features not written - verify feature type fanout/dynamic settings. I was wondeirng if anyone could help me with this issue. Thanks!
I writter from oracle 9i reader to oracle geodatabase 18c by fme desktop 2018 it comes error running translate as file attache