Using readers and writers to extract and load data.
Recently active
Hello,I have a problem to generate a unique ObjectId in Oracle. This is a Number.I want to copy data from a shape to Oracle. No problem for the data, but Oracle requires a Unique ObjectId. I can generate this once with a Counter, but I want to run the workbench daily with different shapes. So if I use the counter and let it start at 10, the next day it will also start with 10 and then Oracle doesn't accept te data because the ObjectId isn't unique.How can I let FME generate a Unique ObjectID each transformation?Thank you, Marlies
Hello!I use spatialfilter to know if 2 layers match each other. I would like to be informed if they match or not and export the result in a text file such as: "6 entities of layer A doesn't match layer B".I guess it's possible to do this with FME by including a SQL query but I don't know wich transformer or structur I should use?Thanks for helping meHugo
I have had some great success using the KML "Generate Super Overlays" to create tiles of imagery that can be easily viewed using Google Earth. Now I would like to go the next step and show my DEM information textured with the imagery also in KML using Google Earth. I can certainly generate a KML file with the DEM data textured with the imagery as a 3D model that Google Earth can view. The problem of course is that I need to keep my files small (~1MB) so Google Earth can open them. And my DEM data is just as detailed as my imagery. I figure the solution must be similar to what the "Generate Super Overlays" does now. So the question is: How can I generate tiled 3D models and KMLs at various resolutions that will mimic the behavior and file setup of the "Generate Super Overlays"? What transformers should I be playing with to get this behavior? Thanks for any help you can give.
From Spring 2016 OS will be upgrading OS MasterMap Topography Layer data to the version 9 schema: https://www.ordnancesurvey.co.uk/business-and-gove...Will this have any impact on the OS (GB) MasterMap Reader in FME?
I'm trying to write a GeoPackage-Layer from a Shape file with linear Features. It' s not possible for me to define the Geometry parameter (it is grayed out), nor the geometries are transferred to the layer. I'm using FME 2016.1 on a Windows 10, 64 Bit-Computer. Any Help are appreciated.
Is there a way to validate the file version aside from parsing the log file?I am trying to validate if the file passed to the reader is the right version. If I pass to the reader a Microstation v7, but it expects v8 the job will fail with a message being written to the log file.
I am trying to get used to the new FMEpedia community. I am missing a possibility to upload images (instead of needing to publish them in internet and to indicate an url) as well as files (eg. a workbench file). Please discuss if you may implement this functionality! Regards, bd
Is there some way to retrieve the URL to the specific list object when reading from Sharepoint Online? I read the list and got the attributes but I need the URL back to the object so I can make an email/slack-message with a hyperlink.
I am writing to FME 2016 and this worked in previous versions but not in 2016 so finding it quite frustrating that this does not work. I keep getting an error Column 'Type' of type 'char(10)' specified in mapping file but not defined in existing table. The type is based on conditional values. I've checked values in data inspector but it keeps falling every time I go to write my data.
Hi, I am trying to pass a schema name (database_username) for a postgis table as Publishes Parameter: TYPE: Text NAME: test PROMT: Schemaname After starting the workbench from a batch file with --test verden_test as parameter, I can see in the logfile that the parameter gets passed to FME: 2014-05-09 08:51:32| 19.5| 0.0|STATS |AttributeRenamer_3_OUTPUT -> verden_test.verkehr Correlator(TeeFactory) But when FME tries to write into the database the logfileoutput is: =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Features With No Schema defined =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- $(test).verkehr 5 and the Database is empty. I am using FME2013 SP2. Any idea why the schema name is not used when writing to the database? Thank, Iris
I'm hoping this is an easy fix but for some reason the writer fields are not matching the reader fields even though they are exactly the same. The writer I noticed has capitalised all the field names and because of this they appear red(not matching). I'm using FME Desktop 2016 and haven't come across this problem before. I have tried casechanger to Uppercase the fields and this still doesn't work. Not sure why this is happening.
mapinfo tab to sql server spatial - need to add an attribute and update with a sequential number for each feature has anybody done something similiar
Good day!I have an issue with reading email messages. We plan to utilize an information about vessels (some information and current location). Contractor provides this information in email message. Looks like simple message in email:As a result of process this email content in WB i have next table:But i don not need data in excel table (it's only for test). Result should be a shape file and all attributes should be stored in separate columns where (for example) vessel_name is column name and Vinsky Star is value...that is for all records.How i can do it?Thanks before hand)
Hi All, i am reading data from a webservice (creator - xml templater - httpCaller) and the data i receive back is not in the format i expected..... Do i need to play with encoding or something else here ?i have truncated the xml to just a small section included below.i receive:<DocumentElement><Results_x0020_for_x0020__x0027_Index_x003D_survey_x0026_StreetName_x003D_KASHMIR_x0020_RD_x0026_StreetNo_x003D_31_x0027_><Global_x0020_Council_x0020_ID>20060926T154516_3_Rodney</Global_x0020_Council_x0020_ID><Asset_x0020_No.>36848</Asset_x0020_No.><Contract_x0020_No.>3853</Contract_x0020_No.><Contractor>Project Max</Contractor><Date_x0020_Inspected>26/09/2006</Date_x0020_Inspected><Completion_x0020_Status>IC</Completion_x0020_Status>i was expecting more like this below , ie without the "_x0020_" etc valuesDocumentElement>…<Resultsfor'Index=survey&StreetName;=KASHMIR RD&StreetNo;=31’><Global Co
Is it possible to convert an ArcGis Geodatabase to Microsoft Access Database?
When adding a Bentley MicroStation Design (V8) reader, my imported .dgn works fine and is in the correct unit scale/coordinate system.When using a generic reader, every now and then the .dgn will come up as being in the wrong scale.I've worked out that the .dgn reader allows you to set the "Coordinates Unit" between Master and Sub, whereas the generic reader doesn't. Is there a way to expose this setting within the generic reader?Thanks
HiI have a WB with a writer, writing data to oracle table. I can see the table columns now.I have modified the table in oracle, but I dont see the new column added in the WB/writer.How do I refresh the WB/writer to see the new column?
Hi everybody,I have a question about copy file to another folder the same name.I have 2 folder that have name Input and Output.- In the folder Input, there are two sub-folder A,B. In folder A have file names test_a.shp, test_a.txt ; in folder B have file names test_b.shp, test_b.txt- In the folder Output, there are two sub-folder A,B too but empty.My target: - Copy test_a.txt file in folder A (Input) to folder A (output) - Copy test_b.txt file in folder B (Input) to folder B (output)Could you please tell me how to the solution to make that in FME?Thank you,
I'm currently working with osm-data. Each feature is getting a new attribute as a weighting. I do already have done the whole weighting and am just trying to visualize the results. The best visulaization would be to create some kind of a heatmap based on that data, but I'm not quite sure how to do so. The first approach of me was to create areas for the different weightings using the HullAccumulator with a Concave setting. It seems to work, but I'm not having the color graduiation of a real heatmap. The second approach was to use the MapnikRasterizer which leads to a better result, but it does still look aweful.
I can add a new field in the [GEODATABASE_FILE] writer under "User Attributes" and as long as I delete the feature class before writing the field shows up. But is there a way to do this without deleting and just adding a new field? Seems pretty easy but????
I am able to create 3d room by using floor elevation. And for stairs i also 2d shapefile polygon with from 2 to floor munber and junctions with level info, but how to elevate it diagonally in FME for KML output??
I have a large workspace needed to load tens of millions of spatial records into our ESRI SDE geodatabase (built on Oracle sdo_geometry). I have noticed a large performance advantage in using the Oracle Spatial writer compared to the ESRI SDE/geodatabase writers in FME but am wary if there are any concerns in using the Oracle Spatial writer as the tables are registered with the geodatabase. As long as I creat the tables using ESRI tools and switch them into LOAD_ONLY mode would it be safe in using the Oracle Spatial writer or would I be bypassing certain SDE protocol that will break the tables for use in SDE?
Hi everyone,I have a script which contains two readers, an Oracle Spatial-Object reader to connect to the Oracle database, and a Schema reader to get information about the database.I use this script to get all geographical tables from the database and it's work find.But when I try with a complex/largest database I'm getting an Oracle ORA-00600 error for the SQL SELECT statement FME made. This happened when I use FME 2014 but not when I use FME 2013. I ask a database analyst who tell me that the SQL statement made by FME it is not optimized and saturate the Oracle SGA. I think this is because the user has access to many Oracle schemas so there are like 500 tables.Is there a better solution to get all geographical tables with FME ? Did the SQL statement change with newer FME versions ?Thanks in advance
I want to synchronize (INSERT,UPDATE, DELETE) 2 databases, source is Informix and target is SQL), anyone has an example to do it??.Finally i want the SQL database gets all changes of the Source Database (ifx),Thanks for your help
I have a workbench that creates a single ECW file. It is intended that this process will be run, from server, up to 100 times, daily.The problem is that if I execute this workbench from desktop, the process completes in sightly under 1 minute. The exact same process from our server implementation takes 16-17 minutes. THis has a huge impact on our productivity.The resulting file is just 7Mb and intentionally contains large areas of black, where there was no-data.I have done some analysis and come to the conclusion that it is the writing to ecw that causes the delay. If I replace the ecw writer with a logger, the rest of the process (reading, mosaicking etc) completes equally quickly in both environments.This does not appear to be a question of server resources, only a small fraction of the available memory & cpu are used. Also, the temp directory is located in a sensible location, I believe. In both instances we are writing the file locally, so this is not a result of network issue