Using readers and writers to extract and load data.
Recently active
We're having significant performance issues with Xref drawings created by FME. In AutoCAD there are options in the "Save As" dialog to allow the drawing to be saved with layer and spatial indexes, but I can't find a way to set this in the DWG or Map OD writers in FME. Is this available somewhere or simply not possible with FME 2018? If it turns out this is not possible in the currently available writers, then as a work -around, if I save the template drawing with layer and spatial indexes, will this carry through to the drawings created by the writer in my workspace? Thanks,Gary
Hi Folks,I understand that the jobs on FME Server (v. 2018.1.1 - Build 18567 - win32 ) are executed with the user that uploaded/published the workbench to the server. We work with active directory on FME Server. So some people have rights to publish and schedule jobs on FME server.Where can you easily change the user that runs/executed that job in the web interface of FME Server?We also configured the fme engine service runs with a specific user with access to certain network drives. Does it mean that this access is only used in the workbenches that were uploaded on FME Server with that specific user account we configured for the engine service?Thanks for sharing your knowledge,Francis
I am trying to read from two large csv files with one FeatureReader for each file. Each FeatureReader is connected to a separate FeatureWriter to write to a Postgres database. I experience the problem that all data is cached first and then delivered to the writer, which will eventually exceed my memory. Since there are no transformers in between I do not now how to solve this issue. I experienced this problems in the past when I used ordinary writers, but never with a FeatureWriter, so I guess it has something to do with the usage of FeatureReader.
Hi Suddenly that the FME can't load the CSV file.When I select the csv file as input of the reader, there is exclamation mark on the Parameter. I checked the parameter is fine (delimiter, fields name, data start line) as the preview also look fine.But the "OK" button can't be clicked. Anyone know what is wrong? FYI, I can open the file normally with excel. I'm using FME Workbench 2018.
Dear people,I have an excel file which contains a dynamic table, in this table there are formulas referencing to parameters on another sheet. Without going into detail, there needs to be a recalculation of certain coordinates. So far i was able to get an excel sheet with the extracted coordinates into the right order and structure. At this point I just want to write away this coordinates into the excel file dynamic table and let excel do the calculations so i can use these new coordinates further on into my module. So the problems i have are: 1) How do i write away the data into a dynamic table? Now it just puts my data underneath the table...2) Is it possible for FME to get the values of parameters which are written on other sheets but in the same excel file to do this calculations (also the sheets don't look the same, different columns etc.) Any ideas that can put my in the right direction will be greatly appreciated, If you need any further info, just let me know, I hope you peo
I have come across some examples where FME 'appears' to change the names of levels which are read in from a dgn file. When viewed in Microstation and Bentley View (v8) features will be on a level called 'UT-UT-CAT_Survey_Underground_Unknown' but FME says these features come from a level called 'AR-AR-CEILING FINISH-Z'.What is FME reading to get this alternative level name?
I have a solar potential raster file which shows the solar potential on each building pixel wise at 0.5m resolution and no data in the rest of the area. I want to show that potential map on top of my 3d Building citygml. is there any way to overlay the raster over the 3d buildings.
Hi,When a job is run on our FME Server system, I see this list of shared folders for formats, transformers, coordinate systems and coordinate system exceptions:How does FME Server determine these folders? Which user is used? Does it depend on any user logged in onto the server? Is it documented somewhere?Thankx for any answer.
I often get this error, while the Workspace-Runner was started with new parameters. Reducing the log-level did not help Any idea how to fix this? I found no comparable community-Item .. I am calling a Workspace-Runner within the project. The workspace is called thousends of times. The calling workspace and the called one work each into their own log-Files. In this example 954 of 1461 calls crashed. In the logfile of the called wsp there are now errors mentionend.Many workspace-calls crash because the newly initialized workspace can't access the logfile because the last call has not yet closed it.This is the error description:I would like to use the option with concurrent processes, but it increases the error rate.The called wsp has one logger configured like this:What else is needed to give you an idea of the problem?Looking forward to a solutiion,Christoph
I have a logger output excel spreadsheet where the easting, northing, height, and sensor value are in one column but I need them each to be an independent column. So I need to add four new columns to the excel and populate them from the one column while leaving the loggercode and dateutcdate alone.
i have information table1 like below Colomn\\RowABCD1SNSFruitCOSTQuantity21Apple20per Peace32Banana3per Peace43Orange8per Peace54Mango50Per KG65Cherry250Per KG76Papaya40Per KG87Graps80Per KG98Dragon200Per KG109Kiwi30per Peace1110CustedApple60Per KG1211Fine Apple40per Peace1312Green Apple25per Peace and having another table2 Colomn\\RowAB1Fruitapple2Price i need write value at table2 Cell position B2 with 20 from table 1
hello,i am trying to texture a building but the image just stretches over the whole wall.what i want is for it to stay the size it originally was and if the whole wall is not filled in that it puts another one next to it.
HI,how can I adjust the writer, so I can specify the destination folder every time different?I have the same Workspace, but I need to write the results all the time in the other Folders. I do not want to create/add all the time a new one. And I need to publish it into a Server, so the writer, and also the reader need to be a flexible.Thanks
Hi. I'm a new to FME and so far I am excited and overwhelmed. I am trying to connect to an exteral SQL database (CAD 911), run query, geocode query results, and write to an existing esri point featureclass. I'd like this to be a scheduled job where it updates the featureclass with new sql database records daily. This seems like FME 101...
I have a set of the CityGML data (LoD2). I have to add the missing ground floor layer “building footprint”. Also, repair other errors in the geometry. Is there an automatic way to do that?
I am trying to connect FME desktop to ArcGIS Online. Taking hint from the article in this url, the networks team whitelisted www.arcgis.com and also bypassed authentication. Attached is the image showing the steps carried out by them (for people with knowledge of proxy/firewall). I have rubbed out some parts.I have been able to create Web Connection however unable to retrieve data from AGOL. I get the error file attached agol_fme_error.txt when trying to fetch Feature Service in the AGOL in Esri AGOL Feature Service Parameters dialog box.I didn't mention filtering to the networks team before carrying out the work. Could it be a reason? Any other suggestions are welcome.Extra information:a. FME Desktop 2018 64bitb. Able to login to AGOL in web browsersc. Able to connect to AGOL via ArcGIS desktop v 10.6 Thanks in advance Vidya
Hi,My problem is about a process that update a postgis table from an other geographic database. Sometimes the import stop working nearly at the end as you can see :POSTGIS writer: 6589 of 6765 features writtenPOSTGIS writer: 6601 of 6765 features writtenPOSTGIS writer: 6606 of 6765 features writtenPOSTGIS writer: 6628 of 6765 features writtenPOSTGIS writer: 6649 of 6765 features writtenand then, no more log for hours.The fact is that it doesn't seems to come from data, cause when i start the process by little packet sometimes it works, actually this slowness seems to be unpredictable. But always occur at the end of the process. And yes computer is working and doesn't seems to be saturated : Proc 8%; Memory 21%. Does someone have any idea of what can i try to understand what happen ??Thanks
Hi all,I noted that coordinate precision of the objects is changed when loaded into the ESRI FGDB.Using the coordinate rounder, all objects in my migration process are rounded on three decimals (on a mm), and even the data in the source system have only 4 decimals.I want to load them as such into the ESRI FGDB using FGDB writer. Source for writing is FFS file.After successful loading process, I checked results in ArcMap and in Inspector. What I can see is that objects and vertices have many more decimals then in the data, which I loaded.The resolution of the database is 0,0001 and tolerance is 0,001. This is also not clear to me, how I managed to write so many digits with 0,0001 resolution.I removed all coordinate systems in order to avoid coordinate transformations. I tried to set same coordinate system on the target as on the source, but unfortunately, the result is the same.Does someone have an idea why does extra vertices are appearing? How I can simply write the data which I have
I have a ESRI Geodatabase (ArcSDE Geodb) writer which is returning: An error occurred while attempting to start an edit session. The error number from ArcObjects is: '-2147217150'. The error message from ArcObjects is: {The current version does not support editing (base, consistent, or closed) [An open transaction was detected. All user transactions must be closed prior to StartEditing.]}The problem is there are no locks on this feature class layer so no open transactions?
I saw on this page ( https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/arcgisonlinefeatures/ft-parameters-w.htm ):The ArcGIS Online Feature Service writer performs a truncation by reading all feature IDs from the layer, and then making deletion requests in batches according to the Features Per Request advanced parameter.I was wondering if there were plans to incorporate the ArcGIS REST API Truncate operation?https://developers.arcgis.com/rest/services-reference/truncate-feature-layer-.htm
Hello FME Community, i am currently trying to combine stock and flow simulations with CityGML. As a tool in between i try to utilize FME.My question:How can I edit the height of a citygml building (LoD2)? I am trying to increase the number of floors and try to show a before and after version.Can i just change the z-axis of the building?Best regardsTobias
I'm an infrequent user of FME so apologies if this is a simple solution. I have an IFC file that was created by exporting from Aecosim and I'm trying to expose the custom attributes (See image below) that I can see when opening the ifc in Solibri. I've searched this community and found nothing that can help me so far. If anyone has a solution or a way forward, your help would be much appreciatedI should add, my goal is to get this information out into an Excel document.Thanks for your help
I get the error above and the following warnings<SOURCE_GML Reader> - Unable to determine features from the parsed XML Schema files, the following namespace URIs were processed<SOURCE_GML Reader> - XML Namespace URI: http://www.w3.org/1999/xlink<SOURCE_GML Reader> - XML Namespace URI: http://www.w3.org/2001/XMLSchema<SOURCE_GML Reader> - XML Namespace URI: http://www.w3.org/2001/XMLSchema-instanceThe same file is read by QGIS without any problems.Any Ideas how I can find out the reasons?
I am looking to take a point feature class that acquires a GPS location from our Utility trucks every 15 seconds and create routes driven based upon historical data. End goal is I would like to build a polyline feature class to reduce the amount of data that I am publishing to our Portal to improve the performance of querying data, as we are acquiring approximately 2.5-3 million points within a 30 day span.Below is an example of the data being received.Here is what the data means:Vehicle is Offline = IsIdle - 0 & GpsActive - 0Vehicle is active but in a Idle State = IsIdle - 1 & GpsActive - 1Vehicle is Actively Moving = IsIdle - 0 & GpsActive - 1The part I am getting stumped on is how I can define routes driven. In the example above, there would have been 2 routes driven. The first route would be fromto and the second route being toBelow is an example of where I would like to take the data, with the addition of some sort of RouteID field. Any help is greatly appreciated.
I have to generate approximatively 850 Excel workbook and I was wondering if it was possible using only one Writer or if I had to use 850 Writers.I thought of the possibility of generating 850 sheets in one Excel workbook, but I would have trouble actually opening the workbook with my computer (lot of memory used).Also I work with a 2017 version of FME (I stumbled in the past on issue that could be esaily resolved with 2018, but I had to work in the limit of 2017).Thanks