Using readers and writers to extract and load data.
Recently active
I have a data conversion issue. I'm updating a .DGN from GIS data. The feature i'm trying to update is a line feature in GIS but has a specific .CEL file associated with it in the Microstation file so the feature looks the way it should. I currently have the feature passing through a CenterPointReplacer (in order to associate the feature to a .cel file it needs to be a point) then a DGNStyler to choose the appropraite .cel file. In the DGNStyler I choose FME_Rotation for the Cell Rotation but the cells still come in at the same angle. I'm not sure if this is caused by the fact that i'm trying to rotate a point feaure?
I'm looking for some guidance on what transformers to use to create a multi-page PDF map book based on a pre-defined grid. I have a shape file that represents the page extents (the grid) with a page number attribute. I'd like each page in the PDF to correspond to a grid square extent. And each page should contain the page number from the grid shape file. Any guidance on which transformers I should be looking at would be much appreciated. Thank you!
I am trying to write data to an SDE Geodatabase, but am unable to do so. I am running FME 2015, ArcGIS 10.2.2, my SDE database is in 10.2.2, and I'm on SQL Server. I am able to write the file into an 'older' (it's less than a year old same version and on the exact same SQL database) SDE database, but when I try and change it to write to the 'newer' SDE database on the exact same server I get the following error... "Error creating table 'Property_Owners'.: SDE_ERROR_CODE(-218) Table already registered. SDE_STREAM_ERROR_CODE(-51) SDE_EXT_ERROR(2617) SDE_ERROR_MSG1([Microsoft][SQL server Native Client 11.0][sQL Server]Violation of UNIQUE KEY constraunt 'registry_uk2'. Cannot insert duplicate key in object 'sde.SDE_table_registry'. The duplicate key value is (PROPERTY_OWNERS, BOZEMAN, BOZEMAN).) SDE_EXT_ERROR_MSG2()" There is nothing in the new geodatabase with the same name or even anything close to it. Therefore, I'm not und
Hi All, I have a requirement where i should export the complete Arc SDE geodatabase to a new file geodatabase. This should be done using FME workbench. Note : File Geodatabase should be generated newly on the fly and it should have all the subtype and domain definition as of ArcSDE geodatabase. Kindly provide your inputs. Thanks, Srini
Or is SharePoint 2013 required?
I have a set of doc files and need to retrieve XY. attaching an example here. the problem is worsened by the fact that almost everything is in cyrillic. I tried to read it as txt and then use StringSearcher but my regex knowledge is probably not sufficient. Any help would be appreciated.
Hello, After Upgrading ArcGIS from 10.2.2 to 10.3 FME fails to run any workbench and shows this massage. “Unable to perform licensing related tasks. Please ensure that ArcGIS is correctly installed A fatal error has occurred. Check the logfile above for details ... Last line repeated 2 times ... |ERROR | A fatal error has occurred. Check the logfile above for details |ERROR | A fatal error has occurred. Check the logfile above for details” Is this means that FME desktop 2015 doesn’t support ArcGIS 10.3?? because form the massage it shows that the FME 2015 Do not recognize the ArcGIS 10.3, Have any one upgraded to ArcGIS 10.3 and face the same problem ? Regards, Ahmad
Hello, I am struggling to convert DGN cells that contain 3D models into ESRI File Geodatabase Multipatch in a way to create a single row (single multipatch feature) in an ESRI Geodb for a single DGN cell. While converting, the DGN cell object is getting exploded in the destination ESRI multipatch into a number of rows, each corresponding to a 3D model face/polygon rather than referring to a single multipatch object. In other words, it gets exploded into separate features. I have the “Expand named Cells” checked in the DGN reader which according to FME help “expands the cells into separate features”. However, when I uncheck this option teh output ESRI geodatabase is empty. How I can translate DGN cell containing a 3D model into single multipatch feature in ESRI File Geodatabse? Help much appreciated. Thanks, Magda
I have an Oracle Spatial database that is composed of tables created by FME Workbench. Although I can see these tables in Data Inspector and QGIS, when I try to add them to the map in ArcGIS 10.2 I get "Could not add the specified data object to the map. Underlying DBMS error[ORA-00936: missing expression]". I have added a spatial index to these tables and manually added a primary key and non-spatial index.My user account has full permissions on these tables. I am able to see tables in our other Oracle Spatial databases when I add them to ArcMap 10.2, and their properties look the same as the tables that FME has created. These other spatial tables were probably created with AutoCad tools, not FME. I am wondering if I am missing something in the FME process for creating Oracle Spatial tables? Any suggestions would be welcome. Thanks
Hi all, Is there a way to create a list of valid drive letters for the user to select as a published parameter? That is on computer 1, the user could select from (C:, D:, F:) whereas computer 2 could have the options (C:, D:, R:, Z:). Using python I can get the list of available drives, but I can't figure out how to parse that into the equivalent of a choice, nor can I figure out how to limit the folder (existing) type to just the drive. Any thoughts?
I am trying to read a number of Microstation DGN (v8) files with tags into a number of ESRI shapefile attributes. I found that selecting a Group Elements by "Schema - Level Names" option from within the DGN V8 Reader Parameters works for a single DGN. It exposes tag values in User Attributes on the DGN Reader. However, I found that I cannot develop a single workbench to handle multiple DGNs with different set of tags (i.e. attributes), as the User Attributes are different for every DGN with different tags. For example, if I used an AttributeCreator and assign tag values to attributes, it would work for one DGN, but the parameters would be invalid for a DGN with different set of tags, i.e. other user attributes. How is it possible to read DGN v8 tags dynamically, i.e. so that they are read dynamically for every DGN and I can work with the tag values as attributes? I am a new user and would appreciate a step by step guide if possible.
I have some classfied Lidar and would like to generate 2D building footprints from them. I used a point cloud filter to separate the points with building classification and then used GeometryCoercer to turn them into points. I now have point cloud and points that look like buildings in the Data Inspector as shown: Point Cloud with building classification Points created by GeometryCoercer I'm not clear where to go from here. Buffer by certain amount? Is there a best transformer here? Thanks
Hi All, I am trying to create a PDF on which a title block in the bottom right hand corner is all ways visable for quaility control. i have had a look at a few examples and most people seem to do it by having a vewport within the PDF and zooming in/out from within the viewport and having the title block as a static element on the PDF is there a way i can creat a viewport for the PDF within FME or if you can think of a more effective way that FME could handle this?? thanks, in advance
Hi, I would like to know if anybody has any experience on how to access files on an FMECloud instance. To clarify a bit, I have a xls file in a folder in the resources section that I would like to access in mid-translation via FME desktop. The idea is to verify details that are on the xls file before continuing with the translation. I was thinking on using the HTTPCaller, but couldnt access the resources section on the instance. Any tips would be appreciated. Itay
Hi ppl, My input are XML files that are triple zipped (zip in a zip in a zip) I know I can read from a zip file, but is there anyway to read from a triple zipped input? If not does anybody have a tip on how to handle such a situation? ( any python/ tcl savy's advice?) Cheers, Itay
Hello, I am having some more performance issues with the workflow displayed below, basically my inputs are ~11 TB 1m Lidar Surface~500,000 - 3,000,000 points and goal is to extract elevation values using average 4 of average 16. Original, I just had the LIDAR reader directly connected to the PointonRasterExtractor but that caused memory issues I have taken these steps so far Added a bounding AccumlatorDissolver into 1 featureClipper to extract only the areas of LIDAR I needThan extracted the points I am open to any other solutions anyone might have to increase the performance
Hi All, I'm trying something that should be super-easy but it's simply not playing ball. I have a creator that creates a single point (X:500, Y:-500 for example). I feed that point into the MapnikRasterizer (MR) transformer, changing it to "Text" symboliser. I set a massive size to the raster (1000*1000), and "Use input data ground extents". But 9 times out of 10, there is no text anywhere on the raster. On the 1/10 times that I've had text, it hasn't been near the point, instead using the top-left as its anchor. I've tried just about every possible combination of settings I can think of, all to little avail. I've also looked at the examples Mark Ireland created for his blog post - those work, but when I try and copy the values to my data... it fails. So, incredibly simple question: How do you use MR to create text on a point? Thanks, Jonathan (Surprisingly few questions about the MapnikRasterizer transformer on here.)
Hi, I'm using the validate Output File option on the GML writer in application schema mode. i can see in my workbench log the number of fatal errors, errors and warnings it finds. But it doesn't fail the translation when it detects errors. How can I configure it to fail when validation finds errors? I'm testing in FME desktop and this workbench will be deployed to FME Server in production. example messages in log: <GML_1 Writer> - Setting external schema location for validation 'D:\\temp\\GML_Validation/myschema.xsd' XML Validation: Error in 'D:\\temp\\GML_Validation\\output.gml' on line 11, column 40: 'value '1.11' does not match regular expression facet '[+\\-]?[0-9]+'' <GML_1 Writer> - Found '0' fatal error(s), '1' error(s), and '0' warning(s) while validating dataset 'D:\\temp\\GML_Validation\\output.gml' Translation was SUCCESSFUL with 3 warning(s) (2 feature(s) output)
Hello, I want to create a SHAPE or KML from Oracle spatial table. I can do that by using FEATUREREADER (FME Desktop 2014). But I need table name to be passed as parameter, as every time I have diff table, to workbench. Since we can't pass table name to FEATUREREADER. How can I create SHAPE from oracle spatial table. Cheers, John
Hi, I write many Data from an ESRI enterprise Geodatabase to a PostGIS Database. All this data are copied by only one fme workbench. This means FME reads and writes the schema dinamically. So far so god. The Input Data has datefields wich are written to PostGIS as fileds in the format timestamp (2015-02-16 00:00:00). How can I tell FME that a datefield in PostGIS has to be created as date (2015-02-16) and not as timestamp (2015-02-16 00:00:00)? Thank's a lot Roman
Hi, so, is there a way to round parameters of tfw file (e.g. 6 decimal places) while writing a tiff file. I'm having a problem since FME changes the last (10th) decimal place of tfw file. And I'm using no transformers whatsoever. PS. The resolution of original tiff is 0.2 and the last decimal of output tiff is 4. Does this have any correlation or is it just coincidence?
Hi All, I have a workbench that I'm calling with a WorkbenchRunner. I want to be able to set the output filename (it's a CSV writer) dynamically, based on a parameter. There will be one unchanging filename per run of the workbench. But I do not want to use a Fanout because it caches results to RAM/disk and sorts them before writing at the very end. This is a problem because the datasets I'm processing are too large to want to do that, and as noted, there's no need as there's only one filename. Is there a way to do this? Maybe with Python? (I've already put in a request for a "features are ordered by group" option on the fanout, which would solve this problem) Thanks, Jonathan
I have three Oracle feature readers in my workspace, one each for dev, qa, and prod. Each Oracle database has a different password. I want to make a parameter so that the user chooses which feature reader to read from. I don't want the workspace to read from all three feature readers because the tables in each feature reader are very large. Two of the feature readers should be disabled each time that I run the workspace, based on the user's choice. I know that you can dynamically choose feature classes, but can you dynamically enable and disable feature readers as I want to do? Thanks
good night I wonder if there is any way to read the Features dataset within the GDB, it must have several features dataset created, with an unusual attribute. VEC01 to rivers. I want to add all VEC01 in a single line shapefile generating a rivers mosaic.
I am reading data form an Oracle database and writing it to an ESRI File Geodatabase. It works fine until I try to use the fanout feature. I get this error: Geodatabase Error (-2147219115): The row contains a bad value. FileGDB Writer: A feature could not be written It doesn't matter whether I use the fanout at the writer level or at the feature type level, I still get the same error. The data in the fanout field is a simple numerical version of the current date (20150209). There are no spaces in the field. I have tried changing the geodatabase overwrite settings, the name of the geodatabase, and creating a completely blank geodatabase. So far, nothing works. If there is another way to apend the current date to the feature type name in the writer, I would love to hear about it. Thanks!