Using readers and writers to extract and load data.
Recently active
Hi, I have 2 custom transformers embded in my main workbench. All are using same set of parameters. Hence, instead of each time changing all parameters, i tried to link parameters of 1st custom transformer to publish parameters of main workbench in Navigator. Workbench is executed successfully. but when i link any parameter of 2nd custom transformer, workbench is failing with following error. "Undefined macro `USER_ID' dereferenced in file `C:\\Users\\mypc\\AppData\\Local\\Temp\\FME_138424666970_7432' Undefined macro `%0' dereferenced in file `%1' ... Last line repeated 2 times ... Oracle Writer: Translation aborted -- rerun specifying "ORACLE8I_1_START_TRANSACTION 0"" 2nd custom transformer has one SQLExecutor, 1 test filter and 1 attribute creator. Please let me know how to solve this issue. Thanks.
I am generating new features in a workspace and wants to write to 2 already defines features in ArcSDE: Feature1: fme_feature_type: Road geodb_oid: 1 Feature2: fme_feature_type: RoadFeature geodb_oid: 2 MY_FOREIGN_KEY (guid): 1 The issue is that I only get an error when I try to insert Feature 2 in another table: |An error occurred while attempting to insert a value into the field 'MY_FOREIGN_KEY' for the table 'RoadFeature'. The error number from ArcObjects is: '-2147219887'. The error message from ArcObjects is: {}. I suspect i need the UUID from Feature1 to insert as the MY_FOREIGN_KEY in Feature2? However how can I do this when I am writing both features at the same time? I have other tables with M:M connections and a temporary geodb_oid on each object and a table describing the relationship and these goes through smoothly with correct connections in ArcSDE. Any suggestions what to try to be able to write to an attribute of type GUID in ArcSDE Enter
Hi All, I have just installed FME Server on a machine here at work (Build 13545) with only one engine - pretty simple huh? Well all is going fine so far, a test workbench which reads a TAB stored in a network location reads fine and writes to a local CSV. All good there. Then I upload a workbench which also writes a CSV locally, but reads from the Corporate SDE. Chaos ensues... The error message I am getting says: "Unable to perform any licensing related tasks. This is a 64-bit version of FME which requires a 64-bit version of ArcGIS Server" The issue is that ArcGIS Server IS 64 bit... Any suggestions?
How to set Subtypes and Domains are written here: However how do I read the allowed subtypes from a feature? Ie for the "Diameter" attribute I want to extract the value:text pairs of choices (0:Unknown,12:12",2:2" etc...) Schemareader does not work as far as I have seen. http://fmepedia.safe.com/articles/How_To/Working-with-Geodatabase-Subtypes-and- Domains
I would like to to use the DirectoryAndFilePath Reader to assemble a list of file paths, and then feed tha to a JPEG reader as the list it should read. I have also looked at the FeatureReader, to see if it could be used under program control. But I am drawing a blank. Any hints?
Does anyone know of a fast and simple way to "smudge" an ECW file? I know this sounds strange but I essentially want to read a large ECW file and smudge it so that you cannot see any details within the resulting output ECW image. Any ideas? Thank you in advance.
Hey all, I have a question about translating spatial data from a PostGIS database to Bentley Microstation DGN V8. Just to get an idea of what I am doing: the superior goal of my work is to store spatial data from DGN-V8-file in a central PostGIS-database, so that the spatial data can be accessed from any other place. So far, so good. The other way around, a DGN-V8-file should be the result when retrieving information from the PostGIS-database. The translation from DGN-V8 to PostGIS with FME works very well, all spatial information as well as additional attributes are transfered. On the way back, translating the PostGIS-tables to DGN-V8, the problem occures. All the geometry information gets into the new file as well as five attributes (igds_color, igds_weight, igds_style, igds_class, igds_graphic_group). But the rest of the attributes stored in the PostGIS database are ignored. They don't appear in the resulting DGN-V8-file. For instance, there is a table, which contain text infor
Hi, I have a 3D Microstation v8 DGN file which I need to convert to shapefile. How do i get the elevation data out of the DGN and into an attribute field in the shapefile? Thanks!
Hi, I have a doubt, Would it be possible to obtain the name of EsriShape file as an attribute of his reader? Thanks
This question was asked in February by SWach I'm having the same problem as Sarah with writing point clouds to 3D PDF and retaining colour. I assign the colour from a raster using the PointCloudOnRasterComponentSetter transformer. Then Coerce to points preserving the colour as an attribute and use this attribute in PDFStyler to assign the colour. Stills comes out black. Sarah's soloution "I needed to add an ElevationExtractor, Bufferer and 3D Forcer between the PointCloudCoercer and PDFStyler." If you're out there Sarah can you explain how you used these transformers to assign the colour from the imagery that is accepted by 3D PDF? Anyone else with ideas? Martin
Dear All , We are using datadownload service to extract data and sending it by email , output files excel and filegeodatabase , excel is zipped and sent by email , but file geodatabase is creaetd on the server but not zipped , that is why email is not contained the file geodatabase , is there is any reason for that. Thanks ,
Hello, I having issues creating a 3D pdf from a coloured LAS file. I can make the points display in the pdf but it is not displaying the colour of the points. What am I missing? Thanks Sarah Wach Manitoba Hydro
I working within my organization to help fellow team members understand the differences between FME Workbench and FME Server. Could someone in the community provide an explanation of where FME ETL development occurs? Is it in FME Workbench; or, FME Server?
When I go to run my scripts written in earlier versions the csv reader fails all features, but wastes time reading them all with no errors. After fiddling around for half a day I found a workaround. Delete the old reader and add a new one with the same parameters. Just saving the workbench in the new format is not enough. So I will have to edit every single script written that uses a CSV reader. Not Happy.
Hello all I have had it several times, that i cannot write to Oracle Spatial DB apparently correct (at least by GeometryValidator Transformer) geometries. I can write these geometries with other writers (i tested ESRI shapes and ESRI geodatabase). I know that oracle has his own strict geometry validation rules. Strange enough, the ORA-Error echoed back (ORA 20263) is not a common error found here for example: http://docs.oracle.com/cd/B14117_01/server.101/b10744/toc.htm Is there a way to check before the insert, if a geometry is valid (in strict Oracle DB terms). Or is there a parameter within the writer that can catch the Ora-Error, skip the geometry, and continue the process of writing with the other pending geometries? I'm working with FME Desktop 2013 (20130124), DB is Oracle Spatial 10.2.0.4.0 Yes, you guessed right, english is not my native language. I appreciate your help. Bernard
Hi there, I am doing a conversion from a .TAB file to a .JSON file. When i run the work bench normally it works fine. However, when i try to convert it to a batch file i get an error saying that it is unable to open output file. My reader is... G:\\spatial\\Manage\\ParkingBays\\Data\\PAT\\Road_Marking.TAB My writer is.... G:\\spatial\\Export\\External\\YellowLineParking\\Data\\Road_Marking.json and the error i get is....... Unable to open output file: 'G:\\spatial\\Export\\External\\YellowLineParking\\Data\\Road_Marking.json\\PAT' Can anyone explain to me how and why this error is occuring? Where does the "PAT" bit come from? And how can I stop it from happening? Many thanks in advance for your help. Matt
Hi All, Encountered an interesting problem today... The background is that we are currently migrating from MapInfo to Esri and are in the process of migrating the data. With MapInfo on life support we need to provide users with the data now residing in the SDE back into TAB format. So to do this we've written quite a few workbenches. What we have noticed is that the .MAP file is consistantly 20-30% larger in size than the original .MAP before it went into the SDE. I would normally attribute this to picking up some extra "stuff" in the double translation process, but if you take the TAB into MapInfo and pack the table, the .MAP returns to it's original size... Very strange. Can any-one tell me why? It's not an issue (for me) but I would love to know what's going on!
Hi guys, Pretty much written in subject. But got a few gis esri products. Shp, layer and geodatabases. I am wondering what is the best method to get these into a oracle database. Does anyone have any examples or point me into how to get this setup? Thank you
Hallo everyone, I tried a lot, but can't find a solution. I have a polyline feature class in a file geodatabase and want to create several annotations out of it. That means, the non-annotation-feature has already been written. Writing multiple annotation classes according to the feature's attributes is already possible in my workflow, but they are not feature-linked yet. It is stated here, that the "geodb_linked_feature_id" attribute connects the feature's Object ID to the ID of the annotations and thereby virtually the two datasets. But what am I supposed to enter in this field? When I choose the OBJECTID attribute of the polyline feature nothing happens. A second point that confuses me: If the polyline feature would not be already written, the documentary (here) tells me to use the 'geodb_text_feat_class_name' format attribute to link annotations to the feature. In the example, the annotation class name is entered for this attribute. But what does it he
Hi all, I’m using FME Server and ActiveMQ to chain together a series of workbenches, running each in turn depending on the notification messages sent between FME Server and ActiveMQ (JMS). The notifications sent from ActiveMQ are JSONs with the parameters required by the workbench to run successfully. For example, the notification will contain Source Dataset, Coordinate System, File Type, etc. My problem is that I need to pass the parameters defined in the notification to the workbench at runtime and don’t know how to accomplish this when the notification is being read from an FME Server Topic. Initially I was going to use scripted parameters to read a json containing the required parameters from a url and extract the required information. This works really well if the notification and its endpoint is well defined but, now that I’m trying to read my notification message from an FME Server Topic, I don’t have a well defined JSON (notification message) to read from. As an alt
Hi Guys, I'm loading data from the Swiss interlis 1 reader (ili2fme) into Oracle Spatial Relational. All run fine but the oracle geometry is not created. Instead of this I have a my_table_sdgeom table created and inside a lot of columns and coordinates(sdo_X..). I'm a bit confuse because I would have expected the Oracle Spatial Relational writer to to create a sdo_geometry column. How can I create this sdo_geometry column? Regards!
I'm new to FME, so my question may be quite simple: In ORACLE I would like to output the content of a table into a new table. Except for two attributes, the structure of new table is the same as the one of the input-table. The input-table has a field "Geometry" with the type "SDO_GEOMETRY" and the output-table has to have it too. (We don't have Oracle Spatial though). I first defined a reader (format: Oracle Spatial Object) and tried to define a writer. But what format do I have to choose for the writer? With oracle non-spatial I loose the geometry and with oracle Spatial Relational the geometry is no longer saved in an "SDO_GEOMETRY"-field, but in four new tables. How could I do this (is it possible at all without oracle spatial)? Many thanks in advance!
Hi I have a workbench that create a kmz file with placemark and overlay within some nested folder. My placemark and photooverlay use a style that is referenced onto a web server. I want my folder to use a custom icon. All folder the same icon as my placemark and photooverlay. Any idea how to do this in FME ? thanks!
Hello, Our source control team asks that we use the major, minor, build, patch identifier on our FME scripts. When they go to production they drop the patch. So...we start with blah_1.2.0.1.fmw and when promoted to production we have blah_1.2.0.fmw. What I'm struggling with is ensuring that the log generated for the blah_1.2.0.1.fmw is named the same; blah_1.2.0.1.fmw. Moreover, when in production...I need the log to be named blah_1.2.0.fmw. I've tried unsetting the log value among the workspace properties, but this only works one time in execution - i.e. the log being named the same as the script. How do I ensure this behavior is consistent? Note - I cannot, at this time, introduce additional flags when we call fme on the command line, nor do we allow scripts to be touched (edited) when in production...i.e. manually set the log name. Any help or advice would be greatly appreciated. -abe Longmont, Colorado
Hi, This simple task has been stumped. I'm trying to extract 3D nodes from 3D polylines and 3D polygons, to be stored as point features in a separate dataset.. I've tried TopologyBuilder, GeometryExtractor and a handful of other transformers, but I can't seem to find the right combo. I'm sure it's quite simple, but I do need advice on this. Cheers. Lars