Using readers and writers to extract and load data.
Recently active
Hi everybody,I have a question about copy file to another folder the same name.I have 2 folder that have name Input and Output.- In the folder Input, there are two sub-folder A,B. In folder A have file names test_a.shp, test_a.txt ; in folder B have file names test_b.shp, test_b.txt- In the folder Output, there are two sub-folder A,B too but empty.My target: - Copy test_a.txt file in folder A (Input) to folder A (output) - Copy test_b.txt file in folder B (Input) to folder B (output)Could you please tell me how to the solution to make that in FME?Thank you,
I'm currently working with osm-data. Each feature is getting a new attribute as a weighting. I do already have done the whole weighting and am just trying to visualize the results. The best visulaization would be to create some kind of a heatmap based on that data, but I'm not quite sure how to do so. The first approach of me was to create areas for the different weightings using the HullAccumulator with a Concave setting. It seems to work, but I'm not having the color graduiation of a real heatmap. The second approach was to use the MapnikRasterizer which leads to a better result, but it does still look aweful.
I can add a new field in the [GEODATABASE_FILE] writer under "User Attributes" and as long as I delete the feature class before writing the field shows up. But is there a way to do this without deleting and just adding a new field? Seems pretty easy but????
I am able to create 3d room by using floor elevation. And for stairs i also 2d shapefile polygon with from 2 to floor munber and junctions with level info, but how to elevate it diagonally in FME for KML output??
I have a large workspace needed to load tens of millions of spatial records into our ESRI SDE geodatabase (built on Oracle sdo_geometry). I have noticed a large performance advantage in using the Oracle Spatial writer compared to the ESRI SDE/geodatabase writers in FME but am wary if there are any concerns in using the Oracle Spatial writer as the tables are registered with the geodatabase. As long as I creat the tables using ESRI tools and switch them into LOAD_ONLY mode would it be safe in using the Oracle Spatial writer or would I be bypassing certain SDE protocol that will break the tables for use in SDE?
Hi everyone,I have a script which contains two readers, an Oracle Spatial-Object reader to connect to the Oracle database, and a Schema reader to get information about the database.I use this script to get all geographical tables from the database and it's work find.But when I try with a complex/largest database I'm getting an Oracle ORA-00600 error for the SQL SELECT statement FME made. This happened when I use FME 2014 but not when I use FME 2013. I ask a database analyst who tell me that the SQL statement made by FME it is not optimized and saturate the Oracle SGA. I think this is because the user has access to many Oracle schemas so there are like 500 tables.Is there a better solution to get all geographical tables with FME ? Did the SQL statement change with newer FME versions ?Thanks in advance
I want to synchronize (INSERT,UPDATE, DELETE) 2 databases, source is Informix and target is SQL), anyone has an example to do it??.Finally i want the SQL database gets all changes of the Source Database (ifx),Thanks for your help
I have a workbench that creates a single ECW file. It is intended that this process will be run, from server, up to 100 times, daily.The problem is that if I execute this workbench from desktop, the process completes in sightly under 1 minute. The exact same process from our server implementation takes 16-17 minutes. THis has a huge impact on our productivity.The resulting file is just 7Mb and intentionally contains large areas of black, where there was no-data.I have done some analysis and come to the conclusion that it is the writing to ecw that causes the delay. If I replace the ecw writer with a logger, the rest of the process (reading, mosaicking etc) completes equally quickly in both environments.This does not appear to be a question of server resources, only a small fraction of the available memory & cpu are used. Also, the temp directory is located in a sensible location, I believe. In both instances we are writing the file locally, so this is not a result of network issue
Hi All, I really would like to be able to export Revit/IFC files for use in Minecraft. Can anyone shed some light on how to do this?
Specifically, I would like to know how to abstract the lat/long coordinates from AIXM 5.1 and convert them into a readable csv file....(for aviation purposes)....can this be done? Thank you, Specifically, I would like to learn how to acquire the lat/lon coordinates and turn them into a readable csv file....can this be done? Thanks.
I am trying to get attribute names from multiple input MapInfo files into one column in Excel with PythonCaller.I can get it to print in the Log but it doesn't go out to the Excel reader. Not too sure what the problem is - I use the script below:import fmeobjects def processFeature(feature): pass class FeatureProcessor(object): def __init__(self): pass def input(self,feature): feature.removeAttrsWithPrefix('mapinfo_') feature.removeAttrsWithPrefix('fme_') feature.removeAttrsWithPrefix('multi_') attrNames = feature.getAllAttributeNames() inputAttrNames = [] for attrname in attrNames: inputAttrNames.append(attrname) feature.setAttribute('_inputAttrNames', inputAttrNames) self.pyoutput(feature) def close(self): passI have also tried in the for loop - for attrname in attrNames:feature.setAttribute('_inputAttrNames', attrname)Thanks!!
I have pdf files stored as a blob in Oracle (11.2). I am trying to convert to PostGIS (9.3) bytea. The tables gets created when running the workbench but the records fail to be written and the workbench hangs - no error and does not complete. The workbench does complete if i exclude the blob column. I have the same results if i use the PostGRES writer. Uinsg FME 2014.
I have a workbench (FME 2013 SP2) that reads a view from PostGreSQL and writes the same table to MS SQL 2008. (Non Spatial) Permissions have been set for my AD account to create/upate/delete to the SQL database schema and there is plenty of storage space. I have tried numerous times to write the data without success and get the following error message in the log file:MS SQL Server Writer: Failed to commit database transaction. Provider error `Description: Not enough storage is available to complete this operation.' A fatal error has occurred. Check the logfile above for details ... Last line repeated 2 times ... Successfully closed POSTGRES database reader POSTGRES reader aborted! A fatal error has occurred. Check the logfile above for details Successfully closed POSTGRES database reader Successfully closed POSTGRES database reader Successfully closed PostgresConn database reader A fatal error has occurred. Check the logfile above for details MS SQL Server Writer: Aborting write o
Hi,I have 2 polygons files: one for cities and one for provinces. I need to have a table in excel which allow people to choose a province and the result is all the cities which are in the selected province and the cities which are in the provinces which touch the selected province.-How can I get this table in excel-If I want to let people use FME server, how can I do it?I start using Spatial relator (using province polygon as requestor and as supplier), then ListExploder but I do not know how to go farther.. Thanks
Hi there, I have some features coming from a 3D DGN as lines, and I want to convert these into a solid or brep surface. Can't see any easy way to do this, anyone tried this? You can see the output I get from reading the features below:I've tried various methods already including surface modeller, chopping the lines into points and rebuilding, but nothing seems to work. It helps that each distinct object is from a block so they have different block numbers on which they can be grouped, but still fazing me...
I am using a dynamic writer to generate shapefiles. It is almost working fine except the geometries (Points, Lines and Polygons) are always generated with Z and M... even if the input (also over a dynamic reader) has no Z and M.Any Idea how to solve this problem?? (Using FME Desktop 2015.0 Build 15253)
Hi,I'm trying to convert a dxf file to postgis using group by attribute schema. This works fine but if I "select Store Layer Properties on Features", I do not get new columns describing autocad_layer_linetype, autocad_layer_color, and autocad_layer_lineweight as I expected.Why ? I'm using FME Desktop 2016.1.0.0 (20160419 - Build 16492 win32) on x64.Thanks,Olivier"If you select this option, the AutoCAD Reader will add additional attributes describing the layer properties for the layer of each feature. These include autocad_layer_linetype, autocad_layer_color, and autocad_layer_lineweight."
I have a KML file with lots of text in the attributes, and the balloon puts this text onto multiple lines. In KML you can set the width of the table in the description tag to make the balloon wider, like this:<table width='300px'>Is it possible to do this with FME?
Hello,I am working to pull information from autocad block attributes and need help overcoming a problem. Currently, each block's attributes have their own record in the table I am writing them to (they are organized this way straight out of the DWG reader). Looks like this:Attribute1Attribute2Attribute3<Null>AB<Null>CDE<Null><Null>What I want to do is combine the records somehow so the table looks like this:Attribute1Attribute2Attribute3EABECDAny ideas how I can do this? I have tried FeatureMerger and InlineQuerier but have had no luck because there is nothing to join on. Thanks,Mike*EDIT*Initially in the DWG reader I was Grouping Entities by Attribute Schema. I just tried grouping them by Layer and got the same results.
Hi All,I want to perform Insert and Update operations in smallword by using FME workbench.I want to update the existing cable features with new values.About Datasets:I am performing update operation on Cambridge database in network data cable feature. I want to update existing cable data based on cable id. The updated data values are available in Excel format. How can I perform update operation based on excel values using FME workbench.Now I want to update “914668, 914698, 914712, 914748”id Known As values as below.I am facing problems in creating workbench in FME. I need to know the clear process for creating fme workbench for Update operation in Smallworld data.What are my possible solutions?Thanks in advance for your help.
Hi guys,I need to write about 30 excel files (xlsm) into a sql server database. Each excel files has the same structure, but have different data inside.I have a workspace that reads the excel file and write data int othe database, without any problem. I tried running a workspace runner to run the 30 excel files. The problem is that it only writes NULL value data. It writes the good amount of entries, but each attribute is NULL.I have FME desktop 2015.1, and SQL Server 2014.Thanks,maxime
Hello Guys ,We do have a large number of excel we are moving to GIS , but certain column are colored and we want to extract this value and add it as an attribute to output. in order to do some analysis Thanks
Hello, Once a week we receive an excel file. You can see on the attached image how the excel file looks like when you open it with FME Inspector. I would like to create two new tables: one for the new units (row 6 till 9) and one for the new cells (row 14 till 23) including the headers (unit, unit title, south limit etc). How can I extract these rows using FME? The structure is the same every week (new units, then new cells) but the number of rows is variable.
Here is what I am trying to do: When someone puts a file in a certain folder, I want a notification on my Google Calendar on the day the file was put there. I guess my first question would be, Is there a way to add things to Google Calendar?My second question would be, assuming there is not a way to access the Calendar: I am able to create a spreadsheet in Google Docs. Then there is an add-on "From Sheets to Calendar" that will take the information from the spreadsheet and add it to the calendar. Is there a way for FME to access and run that Add-On?
On writing data using the ArcSDE 10.1 Geodatabase writer in FME 2015 to an existing featureclass ( ArcGIS 10.0 client), the translation reports a success but no records can be found in A or base tables. I then delete the spatial index for the featureclass and then load and this time it works. My questions are: a) Why does the above happen without a good notification? b) What are the best practices for loading- delete spatial index, load and the rebuild?