Using readers and writers to extract and load data.
Recently active
I have a workspace set up to read features in a GDB and log the count of the number of features it finds using a combination of StatisticsCalculator + Counter + TestFilter. It logs the correct number of features in an Excel spreadsheet (Writer set to INSERT). Works perfectly to log the GDB name, the feature class name and the count found. But, when there are no features in the feature, how do I log the GDB name, the feature class name and the count of 0? The first transformer, the StatisticsCalculator, is never reached. I was thinking that a Python Shutdown script might be the way to go...? Use arcPy to append an entry to the Excel sheet only if the TotalFeatureWritten == 0...? TIA Brian
In FME Desktop 2014, I am reading a spatial dataset (point data) from an Oracle database, then doing some maniupulation like creating a balloon with HTML text, setting symbols for the points, then writing the data to KMZ (OGCKML writer). I understand that all FME Readers read dates and times into a string field using a common syntax that is database neutral (e.g., YYYYMMDDHHMMSS). Without using a DateFormatter transformer, my output KML file date attributes are being written as YYMMDDHHMMSS format. Do I need to use the DateFormatter transformer and specify each date-time attribute excplicitly? I'd like to save future hassles (when existing date-time fields are removed or new date-time fields are added to the source Oracle table that I'm reading). I'm trying to automate this FME workspace as much as possible, so is there a way to tell the KML writer to generally write all date-time attributes in a specific format (and not have to specify each individual date-time attribute
Hi, to start off I've got to admit to having no experience of Esri SHP files but have been asked by a colleague to provide some map background information in this format for use on some mobile units. I thought it would be easy to tag an additional FME workspace onto my existing GZ to TAB routines to provide this. From what I can see SHP requires a separate file for each geometry type which differs from TAB's combined approach, converstion seems simple enough as I should just be able to create a MapInfo TAB reader and then an Esri SHP writer for each type of geomtery. The problem I am having is that I don't know how to convert the text from TAB to SHP as there does not appear to be a text geometry type available in the SHP writer. I'm probably missing something simple but any assistance would be appreciated. Many thanks
Hello, I am running FME 2015, and I have been experiencing some odd behaviour for reading Excel tables, I load a feature reader, and I am reading one spreadsheet with numerous columns, let's say I close the FME workspace, and I open it again the next day, none of the columns are read, and everything appears as null, I current workaround, is just re-adding the feature reader... and this does the trick, but its starting to be a pain every time I open the workbench Thanks for any help!
I want to set my text justification to center. It has the option in the dwg styler for middle center but my text is not aligned to the center of my polygon I am labeling. I tried to set justification attribute to center but it will not work and FME bombs out. Thanks, Chad
Hi, I'm looking to process about ten large ECW files, these need to be color balanced all together so it's as seamless as possible. In terms of the color, some tiles might be brightness changes, others need color tints As a possible method, I was thinking if I manually picked a point to white balance in each file then perform cell value manipulation based on the RGB differences. I suspect it will be an average output though. I'm not sure what transformers to be using. In photoshop its an intuitive slider available but I've not seen something in FME. I could really do with ideas, transformers or processes on how to handle the color balancing. Thanks.
Hello everyone, I want to make changes to existing XML files based on Microsoft Word in FME Desktop 2015, for that I use the XMLReader (Elements to Match: *; Flattening enabled and using the workflow Option Single Merged FT) and the XMLWriter. All I did by now is connecting the reader and the writer to get an exact copy of the XML file, but it creates an XML File including tags (<fme:*>) that I don't want to be in there. For example: <fme:xml-tables xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:fme="http://www.safe.com/xml/xmltables" xsi:schemaLocation="http://www.safe.com/xml/xmltables FME_EDDH2_Testfile.xsd"> <fme:family-table> <fme:family> <Relationship xmlns="http://schemas.openxmlformats.org/package/2006/relationships" Id="rId3" Type="http://schemas.openxmlformats.org/officeDocument/2006/relationships/extended-properties" Target="docProps/app.xml"/> <fme:xml_id>id-Relationship-1.1.1.1.1</fme:xml_id> <fme:xml_
I'm working with ArcSDE geodatabases. I have a workspace that builds areas from boundary lines. If it encounters any areas that can't be built, the boundary lines for that area are written to a separate feature class table. I've set the writer to INSERT and I've set the error table to Truncate Table First: Yes. It all works fine, the error table is emptied and the new errors written. However, when the process completes successfully and no errors are written to the error table, the error table isn't truncated. As a result, the errors from the last run in which errors were detected are still found in the error table. What is the best workaround to ensure that the error table is empty when no errors are encountered?
Hello everyone, I have what I thought was a simple model to create. Basically I will run this once a week. What it is, is a table from SDE that is updated nightly I just want to write out a row with number of features (or how many new features added) and the date the model was run basically. I was just going to build a list and use ListElementCounter to sum up total features. My main problem is obviously when it writes out it always wipes the spreadsheet. If anyone has any imput on any aspect of what i'm trying to do (but mainly keep adding rows for the new dates that come in). I'm all ears. One last thing I have tried setting the Writer Mode to Update but it ends up blank so might not be what I'm looking for... Thanks for your time.
Does FME Workbench 2013 have the ability to handle oracle exceptions without terminating the entire transformation? Currently, the transformation encounters an oracle exception (on insert) and stops. I'd like to log that and continue with the loading from a geodatabase file to the table with a spatial column. Any advice or direction would be helpful. Thank you in advance. -abe
I would like to be able to make the Field Names Row (not Start Row) property in the Microsoft Excel Reader Parameters dialog a User Parameter so that users will be able to specify a different header row if the format of the Excel file is not entirely consistent. This will ultimately be a published translation in FME Server. Is this possible or is there no way to make a parameter in that dialog a User Parameter? Can anyone suggest a possible work around? Thanks.
I have two main drafting workspaces in Microstation; Civil and Survey. Each workspace has a specific set of levels that it uses. I need to map these levels to existing feature classes in a ESRI file geodatabase. There will be many reader files, but all will use the same level names. For example, design file XX01.dgn comes in and I set up a workspace to translate level names to the appropriate feature classes. Then design file XX02.dgn comes in and want to use the same workspace to translate the levels contained in XX02.dgn (which all have the same names as the levels in XX01.dgn) without having to connect each level name to the feature classes again. The drafting workspaces contain several hundreds of levels and I've already created test FME workspaces for Civil and Survey features to make sure all level translate correctly. Is there any way to format an FME workspace such that for any reader/design file, map these level names to these feature classes using these transformers?
I am trying to write raster data to a postgis database. I have a postgis spatial database and want to load raster to it. So far I have a PostGIS Raster Writer and have created the database in Postgis. When I run it I get the error message below in the log file. 2015-05-11 12:08:18| 1.4| 0.1|ERROR |POSTGIS_RASTER writer: This format cannot support palettes. Consider removing or resolving palettes that are attached to the raster Any ideas on how I can load raster into Postgis would be appreciated.
Hi, I couldn’t figure out what’s going on with the ESRI file geodatabase writers, Here is a workbench that was set to use 2 writers ( Esri FilegeodatabaseAPI, and shape file). The translation was successfully finished (21 features was written to both writers). Now when I go to ArcMAP I found that the shape file is correctly generated with 21 features on it while the feature class that was stored inside the file geodatabase API is empty. What is the issue here ? Here is the workbench and all of its related data, in the case of your intrested in testing this issue. http://www.mediafire.com/download/9rwdwe1tk5y9hj7/UMP.zip Regards, Ahmad
Hi everybody, I have run scripts (.bat files) with FME 2014 without problems, but after the update to 2015 and make some changes in my workbenchs these files don't work. This message appear: "This FME edition does not recognize the 'RoutingFactory' factory. What means that? and how can i run my tasks?. P.S My .bat files run 2014 workbenchs yet. How can update my .bat files to run 2015 workbenchs? Thanks
Hi, I've got a SDE30 TABLE with 1 attribute: the project name and the shape (a line). I would like to handle every project as one feature (for many purpose). So I did this. Reader -> Aggregator (on the project field) My problem is that I've got millions of lines of many thousand vertex each; it's big ! I would like to sort the reader so I can select "YES" in the aggregator "Input is Ordered by Group". Any idea how I could do that ?
I have a workspace that uses an XLSX writer and fans out by a given attribute that represents the names of waste collection rounds. The writer uses a template to specify the named range that data should be written to, and replicates that template across the numerous sheets it creates with the fanout. What I'd like to do is specify the order of the sheets in the workbook so that they sort alphabetically, but as the workspace determines the sheets to be written (based on the round name attribute) I'm not sure how to specify this on the writer. Does anyone have any suggestions?
Hi, Could anyone know How to convert (rlc) image format to other format detected by ArcGIS? Thank you, Rawan
How to convert the feature classes stored in SQL Server database to file geodatabase, I couldn’t figure out the best practice to convert the the feature classes stored in SQL Server database to file geodatabase. Thank you Best Jamal
“Replacing” the results obtained from the workbench with the existing ones, I wanted the outputs of the workbench to be replaced with the existing ones. This works fine if the “table handling” is set to be “truncate existing”. However, if the “no existing” data is available, then the workbench fails to write the outputs. Is there an option that can “replace” and “create” (if no existing data is available) the outputs? Thank you Best Jamal
Converting ESRI feature classes saved in file Geodatabase to shape files (in one folder), I couldn’t figure out how to convert ESRI feature classes saved in file Geodatabase to shape files (in one folder) The file geodatabase is saved here http://www.mediafire.com/download/6x08lo3h64o0pz8/H.gdb.zip Thank you Best Jamal
Hi all, Is above question possible? I try to use a parameterfetcher like this: @Value($Iterationcountattirubte) but it is always missing, at each itereation. Can this be done using python or tcl (like some GetMacroValue) or something. Or is it simply not possible? The logger seems to report the count, so should it therefore not be accesible?
The need to add *.gdb before storing each CAD layer in single feature class in it, I wanted to convert each single layer of AutoCAD into a single feature class stored in one geodatabase. The gdb destination is added to the workbench but with no use as it appears in the screenshot below. Is there a way to delete it from the workbench while still be able to store the feature classes in it? Thank you Best Jamal
The need to creating *.gdb before converting dwg files to ESRI feature classes, I couldn’t figure out if I need to create first *.gdb I order to be able to convert dwg files to feature classes stored in file geodatabase. Does this mean that I need to have ArcGIS, for example, installed in my machine to do so? Thank you Best Jamal
OK this has been asked before but the answers I've seen did not resolve the issue. Has anyone encountered this error message when running FME Server? Unable to perform any licensing related tasks. This is a 64-bit version of FME which requires a 64-bit version of ArcGIS Server What makes this strange is they are both 64 bit versions. Is this an ArcGIS setup issue? Any help would be greatly appreciated. Thanks! Tony