Using readers and writers to extract and load data.
Recently active
Dear All Converting CAD to shpae , it works only with the CAD that intially used to build the Workbench , when we upload another CAD with different schema , not output prodcued . Thanks,
Article 000002244 seems to provide the solution I am looking for (using python script to specify feature types), but I'm unclear about setting the path for each microstation file that I am loading. I can create a list of the files I want to load to the reader, but there are multiple paths. I am creating the list by iterating through a directory and subdirectories and searching for files with microstation file extension. I'm not sure where to include the path information for each file?
Hi, I want to use the FMX GoogleGeocoder but when I open it in workbench It say that my "AttributeCreator" doesn't have the right version (in FME 2013) and if I try it in FME 2012, It says my HTTP fetcher is not right too. I need to build back the attributcreator for the "GG_FullAddress". Any Idea how is the syntax? thanks
I am having a bit of a frustrating experience with the CenterlineReplacer that I am hoping someone can help with. Desired Outcome: Centerline the entire length of the polygon "tiles." The length is a user-parameter and will determin the length of the line. By having the centerline "clipped" inside the polygon I am losing the correct length. Background: I have a number of 'tiles' (ie polygons) that I want to essentially spit in half and keep the centerline. Sounds like a job for the CenterlineReplacer. However, whenever I run the transformer I get 3 undesirable results. First, it does not split the entire lengh. It essentially starts partway down the middle. Second, one of the centerlines always "snaps" to the corner of one polygon. Third, the line directions vary. I would like all line directions in the same orientation. Note, I have a process that fixes this but it's more of a hack. Here is a screenshot of the undesireable output
Hi All, I need to retrieve a path of writer to remove this writer file from its directory to another one. I couldn't retrive the writer path using Shutdown Python Script. Example : src_file = "c://temp/file1.csv" dst_file = feature.getAttribute("fme_basename") ?? shutil.move(src_file, dst_file) I can't retrive feature into my script ! Any idea? Thanks an advance. Farfar
Hi all, I need to move my Reader file (toto.shp.zip) from its location to another directory after traitment. I think the best way to do it is into Shutdown python script. But i can't find the code to do it. Could some one to help me? Thanks an advance. Farfar
Our organization is exploring the use of FME cloud to push data out to Google Maps Engine(GME). We currently have 2 FME Desktop 2014 licenses which we use to load data into GME. We run change detection to incrementally update features in GME from our on site SQL Server 2012 database. This is crucial as we have to pay for storage with GME and need to minimize update size to reduce costs. I would like to publish our workspaces to FME Cloud but am trying to figure out the workflow for such a thing before investing in it. Would our data need to be published as a shared resource in FME Cloud everytime we'd like the workspaces to run? Is it possible to direct those workspaces to our database without punching a hole in the firewall? Or is there a way to run change detection locally and then upload the new data to FME Cloud and have workspaces run only when things have been added, updated and/or deleted?
Hi, We are trying to create a 3D PDF file out of a OBJ file for a masterplan. Its a large file and we are running out of memory when making the write. This is becasue the 3D PDF writer is only available in the 32bit version. Are there any tricks to get FME to manage the memory better in this type of workflow? Thanks, Greg
On the GML reader if I leave the FEATURE_TYPES value blank I can read all feature types into a single merged feature type without having to name them in teh workbench. I'm trying to recreate this with an ESRI File Geodatabase reader. In this case I only get features back if I have explicitly named them in the FEATURE_TYPES parameter. How can I specify FEATURE_TYPES with a wildcard so that it will read all feature classes in my geodatabase?
Hi Can you use a Case Changer on an unexploded list. So all values within that list are put to the same case so it makes it easier for ListSearcher queries to work (or can I do something in the ListSearcher to make this happen) DL
For FME 2011 ESRI Shapefile Writer, what is the maximum column name length?
My tasks to do with FME looks like this: - Start the workspace and choose a shapefile.(The schema is not known before) - Write the feature type with all attributes to a Filegeodatabase. I can create a workspace with shapefile reader and dynamic fgd writer and a published parameter to get the input from the user. But my problem is the reader which needs some predefined features. If i select a shape file I get the following "unexpected Input" error: "some features were read that did not match a reader feature type...." Is there a way to define the feature at runtime out of the input? Something like a dynamic schema reader? Cheers
I've written some .net code that will run a workbench I've created in FME 2014 using: IFMEOSession fmeoSession = FMEObjects.CreateSession(); IFMEOWorkspaceRunner fmeoWorkspaceRunner = fmeoSession.CreateWorkspaceRunner(); fmeoWorkspaceRunner.RunWithParameters This works in a standalone .net application. I need to extend the program so that it also makes use of some ArcObjects code before calling FME. I'm using ArcGIS 10.2.1. The Arcobjects code also works in isolation. The problem comes when trying to integrate the two. It seems that after running the ArcObjects code a call to FMEObjects.CreateSession() will return an error message 'Session could not be created. Registry mapping to FME core DLL could not be found.' I've also tried running this on a machine with the ESRI Data Interoperability extension installed and in this case I get a success = false from IFMEOWorkspaceRunner.RunWithParameters with no log or error messages. I can see from deb
Hi, I have pointcloud xyz-files that I want to write to Esri ASCII Grid-format. I use a RasterDEMGenerator in the process with Interpolation method: Planar. It is 2 meters between the points so I use X/Y cell spacing 2 meters. But when I look at the resulting files it is a gap between them with no data (see image). How can I connect them togheter? If I process the two pointcloud-files at the same time then they will merge into one single perfectly shaped ascii-file. But the problem is that I have 234 pointcloud-files with each 1,5 million points, and I have tried to merge them into a single ascii-file. It took about 80 hours for FME to process them, but still FME didn't manage to give me a resulting file because of some strange error. Any suggestions please? Cheers Hans
I presume I can't write a .lyr file since no such writer exists (is this an ESRI restriction?). Is there any hack that would allow for setting colours based on attributes and then write this information to some other type of file that can later be used by a GIS to color a .shp automatically?
Hey all, Had a browse around on the internet for this but nothing clear popped up so asking the group. I have a SQL Server (non spatial) reader and I need to be able to specify the table name in the database to read at runtime. I've tried setting the Feature Types to Read parameter within the SS reader but all I get is that error message stating "some features were read that did not match reader feature type" - I cannot seem to parameterize the Feature Type Name. I know you can do this but I'm hitting my head against a brick wall on this. I've got potentially hundres of tables to download so I need this to work so I can let it run overnight in batch mode. I've got the writer part parameterized nicely but the read keeps defaulting to the table selection I made when I added the reader and throws that error (mentioned above) when I try to parameterize it Any ideas what I'm missing? I know it's simple but just can't work it out.
Hi. I have .csv file with name, lat and long attributes, (+ bunch of others). Problem is, that gml writer doesnt write any <gn:geometry><gml:Point> tags. What am I missing? Some transformer? Im new to this, so bear with me, please... Thank you.
Has anyone ever noticed if the output from FME as opposed to an output from an ArcGIS model is more granular? Here's why I ask ... When I run an ArcGIS model that does an overlay of 3 polygon layers on a leases polygon layer the final output has about 11000 polygon records. When I do the same steps in FME using the AreaOnAreaOverlayer I end up with about 14000 polygon records. What's funny is the acreage total is about the same. I'm thinking the FME tools may be more literal in the way they do processing. Any ideas off the top of your heads why this may be happening?
Hi, I am Sajid Ali studying in HFT Stuttgart. I am facing a problem when I am going to translate Esri File Geodatabase to Postgis. I ahve FME 2013 Version installed and the version of Poistgis is 2.1.2. Please help me out.
When I write polyline feature to dgn the file contains only single polyline segments. What's going wrong?
If i let FME copy excelfile A to excelfile B the textvalues of excelfile A gets an extra apostrofe when it is written to excelfile B. So value xxxx from excelfile A becomes 'xxxx in excelfile B. Does anyone know how to prevent this?
Hello again! I have a set of csv file pairs called e.g. 1111_AB.csv 1111_AB_type47.csv 1112_AB.csv 1112_AB_type47.csv I need to manipulate the contents of the *_type47 files and then append them, minus the header line, to the foot of the master file. In my workspace I've got a CSV reader --> FeatureTypeExtractor (to write the file name to an attribute) --> StringReplacer (to replace the _type47.csv with an empty string) --> AttributeCreator (to update the value of an attribute for each feature from 47 to 52). Once updated I'd like to write the features to the foot of the master CSV files (based on the value in my FeatureTypeExtractor) in EXACTLY the same order and format as the source. What's the best strategy for this? I'm a bit stuck... Thanks, Matt
Hi, I am reading data for MySQL and would like to prevent migrating the same data each time i run the workbence (it will be running as a scheduled task). To do this I have created an 'export' field in MySQL, with a default value of '0'. The workbench has a tester at the start, that will only allow a value of '0' through, and at the end of the workflow, I want to change all '0' values to '1'. I get an error when trying to run this writing back to the MySQL database. My question is this, normally I would use the database updater transformer, but this will not write to MySQL, so how would I update the MySQL database and change these values. Many thanks in advance.
Hi, I`m using FME 2014 to populate a table in our postGIS db. The problem is that the data is somehow not beeing loaded into the database. The logfile is telling that, "Failed to build an SQL statement because the feature lacked an 'fme_where' attribute. Update and delete features require an 'fme_where' attribute to be specified" I´m guessing I have to set the fme_where attribute, but is really lost in why and howto set it? What should fme_where point to or include? Can someone help me in the right direction? Christian
Hi Everyone, I am getting an error when trying to create a TAB file or .GDB features from a certain dataset in Oracle Spatial. The error is "Error occurred trying to create area geometry". It happens at the point where the features are attempted to be written to the TAB file. It doesn't make much sense since the table was originally loaded into Oracle from a TAB file so it should be happy to translate back to that at the very least. My thoughts were there must be something wrong with the geometry which is preventing FME from "calculating the area geometry" so I tried the steps below to fix/trouble shoot the problem. I have put the data through a geometry validator and geometry filter however that has no effect on the error I'm getting. I ran the Oracle geometry validation function over the table then deleted all geometries it found which were not valid. If anyone could give me some ideas as to what this error message actually means and how I can get FME