Using readers and writers to extract and load data.
Recently active
Hi, I am trying to pass a schema name (database_username) for a postgis table as Publishes Parameter: TYPE: Text NAME: test PROMT: Schemaname After starting the workbench from a batch file with --test verden_test as parameter, I can see in the logfile that the parameter gets passed to FME: 2014-05-09 08:51:32| 19.5| 0.0|STATS |AttributeRenamer_3_OUTPUT -> verden_test.verkehr Correlator(TeeFactory) But when FME tries to write into the database the logfileoutput is: =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Features With No Schema defined =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- $(test).verkehr 5 and the Database is empty. I am using FME2013 SP2. Any idea why the schema name is not used when writing to the database? Thank, Iris
I'm hoping this is an easy fix but for some reason the writer fields are not matching the reader fields even though they are exactly the same. The writer I noticed has capitalised all the field names and because of this they appear red(not matching). I'm using FME Desktop 2016 and haven't come across this problem before. I have tried casechanger to Uppercase the fields and this still doesn't work. Not sure why this is happening.
mapinfo tab to sql server spatial - need to add an attribute and update with a sequential number for each feature has anybody done something similiar
Good day!I have an issue with reading email messages. We plan to utilize an information about vessels (some information and current location). Contractor provides this information in email message. Looks like simple message in email:As a result of process this email content in WB i have next table:But i don not need data in excel table (it's only for test). Result should be a shape file and all attributes should be stored in separate columns where (for example) vessel_name is column name and Vinsky Star is value...that is for all records.How i can do it?Thanks before hand)
Hi All, i am reading data from a webservice (creator - xml templater - httpCaller) and the data i receive back is not in the format i expected..... Do i need to play with encoding or something else here ?i have truncated the xml to just a small section included below.i receive:<DocumentElement><Results_x0020_for_x0020__x0027_Index_x003D_survey_x0026_StreetName_x003D_KASHMIR_x0020_RD_x0026_StreetNo_x003D_31_x0027_><Global_x0020_Council_x0020_ID>20060926T154516_3_Rodney</Global_x0020_Council_x0020_ID><Asset_x0020_No.>36848</Asset_x0020_No.><Contract_x0020_No.>3853</Contract_x0020_No.><Contractor>Project Max</Contractor><Date_x0020_Inspected>26/09/2006</Date_x0020_Inspected><Completion_x0020_Status>IC</Completion_x0020_Status>i was expecting more like this below , ie without the "_x0020_" etc valuesDocumentElement>…<Resultsfor'Index=survey&StreetName;=KASHMIR RD&StreetNo;=31’><Global Co
Is it possible to convert an ArcGis Geodatabase to Microsoft Access Database?
When adding a Bentley MicroStation Design (V8) reader, my imported .dgn works fine and is in the correct unit scale/coordinate system.When using a generic reader, every now and then the .dgn will come up as being in the wrong scale.I've worked out that the .dgn reader allows you to set the "Coordinates Unit" between Master and Sub, whereas the generic reader doesn't. Is there a way to expose this setting within the generic reader?Thanks
HiI have a WB with a writer, writing data to oracle table. I can see the table columns now.I have modified the table in oracle, but I dont see the new column added in the WB/writer.How do I refresh the WB/writer to see the new column?
Hi everybody,I have a question about copy file to another folder the same name.I have 2 folder that have name Input and Output.- In the folder Input, there are two sub-folder A,B. In folder A have file names test_a.shp, test_a.txt ; in folder B have file names test_b.shp, test_b.txt- In the folder Output, there are two sub-folder A,B too but empty.My target: - Copy test_a.txt file in folder A (Input) to folder A (output) - Copy test_b.txt file in folder B (Input) to folder B (output)Could you please tell me how to the solution to make that in FME?Thank you,
I'm currently working with osm-data. Each feature is getting a new attribute as a weighting. I do already have done the whole weighting and am just trying to visualize the results. The best visulaization would be to create some kind of a heatmap based on that data, but I'm not quite sure how to do so. The first approach of me was to create areas for the different weightings using the HullAccumulator with a Concave setting. It seems to work, but I'm not having the color graduiation of a real heatmap. The second approach was to use the MapnikRasterizer which leads to a better result, but it does still look aweful.
I can add a new field in the [GEODATABASE_FILE] writer under "User Attributes" and as long as I delete the feature class before writing the field shows up. But is there a way to do this without deleting and just adding a new field? Seems pretty easy but????
I am able to create 3d room by using floor elevation. And for stairs i also 2d shapefile polygon with from 2 to floor munber and junctions with level info, but how to elevate it diagonally in FME for KML output??
I have a large workspace needed to load tens of millions of spatial records into our ESRI SDE geodatabase (built on Oracle sdo_geometry). I have noticed a large performance advantage in using the Oracle Spatial writer compared to the ESRI SDE/geodatabase writers in FME but am wary if there are any concerns in using the Oracle Spatial writer as the tables are registered with the geodatabase. As long as I creat the tables using ESRI tools and switch them into LOAD_ONLY mode would it be safe in using the Oracle Spatial writer or would I be bypassing certain SDE protocol that will break the tables for use in SDE?
Hi everyone,I have a script which contains two readers, an Oracle Spatial-Object reader to connect to the Oracle database, and a Schema reader to get information about the database.I use this script to get all geographical tables from the database and it's work find.But when I try with a complex/largest database I'm getting an Oracle ORA-00600 error for the SQL SELECT statement FME made. This happened when I use FME 2014 but not when I use FME 2013. I ask a database analyst who tell me that the SQL statement made by FME it is not optimized and saturate the Oracle SGA. I think this is because the user has access to many Oracle schemas so there are like 500 tables.Is there a better solution to get all geographical tables with FME ? Did the SQL statement change with newer FME versions ?Thanks in advance
I want to synchronize (INSERT,UPDATE, DELETE) 2 databases, source is Informix and target is SQL), anyone has an example to do it??.Finally i want the SQL database gets all changes of the Source Database (ifx),Thanks for your help
I have a workbench that creates a single ECW file. It is intended that this process will be run, from server, up to 100 times, daily.The problem is that if I execute this workbench from desktop, the process completes in sightly under 1 minute. The exact same process from our server implementation takes 16-17 minutes. THis has a huge impact on our productivity.The resulting file is just 7Mb and intentionally contains large areas of black, where there was no-data.I have done some analysis and come to the conclusion that it is the writing to ecw that causes the delay. If I replace the ecw writer with a logger, the rest of the process (reading, mosaicking etc) completes equally quickly in both environments.This does not appear to be a question of server resources, only a small fraction of the available memory & cpu are used. Also, the temp directory is located in a sensible location, I believe. In both instances we are writing the file locally, so this is not a result of network issue
Hi All, I really would like to be able to export Revit/IFC files for use in Minecraft. Can anyone shed some light on how to do this?
Specifically, I would like to know how to abstract the lat/long coordinates from AIXM 5.1 and convert them into a readable csv file....(for aviation purposes)....can this be done? Thank you, Specifically, I would like to learn how to acquire the lat/lon coordinates and turn them into a readable csv file....can this be done? Thanks.
I am trying to get attribute names from multiple input MapInfo files into one column in Excel with PythonCaller.I can get it to print in the Log but it doesn't go out to the Excel reader. Not too sure what the problem is - I use the script below:import fmeobjects def processFeature(feature): pass class FeatureProcessor(object): def __init__(self): pass def input(self,feature): feature.removeAttrsWithPrefix('mapinfo_') feature.removeAttrsWithPrefix('fme_') feature.removeAttrsWithPrefix('multi_') attrNames = feature.getAllAttributeNames() inputAttrNames = [] for attrname in attrNames: inputAttrNames.append(attrname) feature.setAttribute('_inputAttrNames', inputAttrNames) self.pyoutput(feature) def close(self): passI have also tried in the for loop - for attrname in attrNames:feature.setAttribute('_inputAttrNames', attrname)Thanks!!
I have pdf files stored as a blob in Oracle (11.2). I am trying to convert to PostGIS (9.3) bytea. The tables gets created when running the workbench but the records fail to be written and the workbench hangs - no error and does not complete. The workbench does complete if i exclude the blob column. I have the same results if i use the PostGRES writer. Uinsg FME 2014.
I have a workbench (FME 2013 SP2) that reads a view from PostGreSQL and writes the same table to MS SQL 2008. (Non Spatial) Permissions have been set for my AD account to create/upate/delete to the SQL database schema and there is plenty of storage space. I have tried numerous times to write the data without success and get the following error message in the log file:MS SQL Server Writer: Failed to commit database transaction. Provider error `Description: Not enough storage is available to complete this operation.' A fatal error has occurred. Check the logfile above for details ... Last line repeated 2 times ... Successfully closed POSTGRES database reader POSTGRES reader aborted! A fatal error has occurred. Check the logfile above for details Successfully closed POSTGRES database reader Successfully closed POSTGRES database reader Successfully closed PostgresConn database reader A fatal error has occurred. Check the logfile above for details MS SQL Server Writer: Aborting write o
Hi,I have 2 polygons files: one for cities and one for provinces. I need to have a table in excel which allow people to choose a province and the result is all the cities which are in the selected province and the cities which are in the provinces which touch the selected province.-How can I get this table in excel-If I want to let people use FME server, how can I do it?I start using Spatial relator (using province polygon as requestor and as supplier), then ListExploder but I do not know how to go farther.. Thanks
Hi there, I have some features coming from a 3D DGN as lines, and I want to convert these into a solid or brep surface. Can't see any easy way to do this, anyone tried this? You can see the output I get from reading the features below:I've tried various methods already including surface modeller, chopping the lines into points and rebuilding, but nothing seems to work. It helps that each distinct object is from a block so they have different block numbers on which they can be grouped, but still fazing me...
I am using a dynamic writer to generate shapefiles. It is almost working fine except the geometries (Points, Lines and Polygons) are always generated with Z and M... even if the input (also over a dynamic reader) has no Z and M.Any Idea how to solve this problem?? (Using FME Desktop 2015.0 Build 15253)
Hi,I'm trying to convert a dxf file to postgis using group by attribute schema. This works fine but if I "select Store Layer Properties on Features", I do not get new columns describing autocad_layer_linetype, autocad_layer_color, and autocad_layer_lineweight as I expected.Why ? I'm using FME Desktop 2016.1.0.0 (20160419 - Build 16492 win32) on x64.Thanks,Olivier"If you select this option, the AutoCAD Reader will add additional attributes describing the layer properties for the layer of each feature. These include autocad_layer_linetype, autocad_layer_color, and autocad_layer_lineweight."