Using readers and writers to extract and load data.
Recently active
On the GML reader if I leave the FEATURE_TYPES value blank I can read all feature types into a single merged feature type without having to name them in teh workbench. I'm trying to recreate this with an ESRI File Geodatabase reader. In this case I only get features back if I have explicitly named them in the FEATURE_TYPES parameter. How can I specify FEATURE_TYPES with a wildcard so that it will read all feature classes in my geodatabase?
Hi Can you use a Case Changer on an unexploded list. So all values within that list are put to the same case so it makes it easier for ListSearcher queries to work (or can I do something in the ListSearcher to make this happen) DL
For FME 2011 ESRI Shapefile Writer, what is the maximum column name length?
My tasks to do with FME looks like this: - Start the workspace and choose a shapefile.(The schema is not known before) - Write the feature type with all attributes to a Filegeodatabase. I can create a workspace with shapefile reader and dynamic fgd writer and a published parameter to get the input from the user. But my problem is the reader which needs some predefined features. If i select a shape file I get the following "unexpected Input" error: "some features were read that did not match a reader feature type...." Is there a way to define the feature at runtime out of the input? Something like a dynamic schema reader? Cheers
I've written some .net code that will run a workbench I've created in FME 2014 using: IFMEOSession fmeoSession = FMEObjects.CreateSession(); IFMEOWorkspaceRunner fmeoWorkspaceRunner = fmeoSession.CreateWorkspaceRunner(); fmeoWorkspaceRunner.RunWithParameters This works in a standalone .net application. I need to extend the program so that it also makes use of some ArcObjects code before calling FME. I'm using ArcGIS 10.2.1. The Arcobjects code also works in isolation. The problem comes when trying to integrate the two. It seems that after running the ArcObjects code a call to FMEObjects.CreateSession() will return an error message 'Session could not be created. Registry mapping to FME core DLL could not be found.' I've also tried running this on a machine with the ESRI Data Interoperability extension installed and in this case I get a success = false from IFMEOWorkspaceRunner.RunWithParameters with no log or error messages. I can see from deb
Hi, I have pointcloud xyz-files that I want to write to Esri ASCII Grid-format. I use a RasterDEMGenerator in the process with Interpolation method: Planar. It is 2 meters between the points so I use X/Y cell spacing 2 meters. But when I look at the resulting files it is a gap between them with no data (see image). How can I connect them togheter? If I process the two pointcloud-files at the same time then they will merge into one single perfectly shaped ascii-file. But the problem is that I have 234 pointcloud-files with each 1,5 million points, and I have tried to merge them into a single ascii-file. It took about 80 hours for FME to process them, but still FME didn't manage to give me a resulting file because of some strange error. Any suggestions please? Cheers Hans
I presume I can't write a .lyr file since no such writer exists (is this an ESRI restriction?). Is there any hack that would allow for setting colours based on attributes and then write this information to some other type of file that can later be used by a GIS to color a .shp automatically?
Hey all, Had a browse around on the internet for this but nothing clear popped up so asking the group. I have a SQL Server (non spatial) reader and I need to be able to specify the table name in the database to read at runtime. I've tried setting the Feature Types to Read parameter within the SS reader but all I get is that error message stating "some features were read that did not match reader feature type" - I cannot seem to parameterize the Feature Type Name. I know you can do this but I'm hitting my head against a brick wall on this. I've got potentially hundres of tables to download so I need this to work so I can let it run overnight in batch mode. I've got the writer part parameterized nicely but the read keeps defaulting to the table selection I made when I added the reader and throws that error (mentioned above) when I try to parameterize it Any ideas what I'm missing? I know it's simple but just can't work it out.
Hi. I have .csv file with name, lat and long attributes, (+ bunch of others). Problem is, that gml writer doesnt write any <gn:geometry><gml:Point> tags. What am I missing? Some transformer? Im new to this, so bear with me, please... Thank you.
Has anyone ever noticed if the output from FME as opposed to an output from an ArcGIS model is more granular? Here's why I ask ... When I run an ArcGIS model that does an overlay of 3 polygon layers on a leases polygon layer the final output has about 11000 polygon records. When I do the same steps in FME using the AreaOnAreaOverlayer I end up with about 14000 polygon records. What's funny is the acreage total is about the same. I'm thinking the FME tools may be more literal in the way they do processing. Any ideas off the top of your heads why this may be happening?
Hi, I am Sajid Ali studying in HFT Stuttgart. I am facing a problem when I am going to translate Esri File Geodatabase to Postgis. I ahve FME 2013 Version installed and the version of Poistgis is 2.1.2. Please help me out.
When I write polyline feature to dgn the file contains only single polyline segments. What's going wrong?
If i let FME copy excelfile A to excelfile B the textvalues of excelfile A gets an extra apostrofe when it is written to excelfile B. So value xxxx from excelfile A becomes 'xxxx in excelfile B. Does anyone know how to prevent this?
Hello again! I have a set of csv file pairs called e.g. 1111_AB.csv 1111_AB_type47.csv 1112_AB.csv 1112_AB_type47.csv I need to manipulate the contents of the *_type47 files and then append them, minus the header line, to the foot of the master file. In my workspace I've got a CSV reader --> FeatureTypeExtractor (to write the file name to an attribute) --> StringReplacer (to replace the _type47.csv with an empty string) --> AttributeCreator (to update the value of an attribute for each feature from 47 to 52). Once updated I'd like to write the features to the foot of the master CSV files (based on the value in my FeatureTypeExtractor) in EXACTLY the same order and format as the source. What's the best strategy for this? I'm a bit stuck... Thanks, Matt
Hi, I am reading data for MySQL and would like to prevent migrating the same data each time i run the workbence (it will be running as a scheduled task). To do this I have created an 'export' field in MySQL, with a default value of '0'. The workbench has a tester at the start, that will only allow a value of '0' through, and at the end of the workflow, I want to change all '0' values to '1'. I get an error when trying to run this writing back to the MySQL database. My question is this, normally I would use the database updater transformer, but this will not write to MySQL, so how would I update the MySQL database and change these values. Many thanks in advance.
Hi, I`m using FME 2014 to populate a table in our postGIS db. The problem is that the data is somehow not beeing loaded into the database. The logfile is telling that, "Failed to build an SQL statement because the feature lacked an 'fme_where' attribute. Update and delete features require an 'fme_where' attribute to be specified" I´m guessing I have to set the fme_where attribute, but is really lost in why and howto set it? What should fme_where point to or include? Can someone help me in the right direction? Christian
Hi Everyone, I am getting an error when trying to create a TAB file or .GDB features from a certain dataset in Oracle Spatial. The error is "Error occurred trying to create area geometry". It happens at the point where the features are attempted to be written to the TAB file. It doesn't make much sense since the table was originally loaded into Oracle from a TAB file so it should be happy to translate back to that at the very least. My thoughts were there must be something wrong with the geometry which is preventing FME from "calculating the area geometry" so I tried the steps below to fix/trouble shoot the problem. I have put the data through a geometry validator and geometry filter however that has no effect on the error I'm getting. I ran the Oracle geometry validation function over the table then deleted all geometries it found which were not valid. If anyone could give me some ideas as to what this error message actually means and how I can get FME
I want to read the lat/long in a gps'd jpg and create a point with a hotlink to the jpg. Does anyone know how to do this?
I'm experimenting with incorporating Excel workflows into my FME workspaces and am stuck. My workspace reads in a raster, then I get raster properties using RasterPropertiesExtractor, then I create a few more attributes with AttributeCreator, and finally I want to write to an Excel file with each attribute name in the first column and its value in the second column. I tried many settings under "format parameters" in the excel writer, but with no luck. The main problems I am having is that 1) nothing seems to write to the excel cells no matter what settings I have under "format parameters", and 2) the image of the raster is inserted into the excel file, which I don't know how to stop. I'm obviously missing a few things in my first attempt...
Hi, Having some problem using SQLExecuter and SQLCreator with a Postgre/Postgre. Error connecting to PostgreSQL database(host='**.***.**.***', port='5432', dbname='*******', user=postgre, password='***'): 'FATAL: password authentication failed for user "postgre" Its not really a authentication error since both the postgre and postgis reader and writer works fine with the same credentials. I can connect to the tables in the SQL transformers but when I hit run I get "authentication failed" Anyone have an clue? cheers Henrik Rinne
Hi Folks, I want to do something that should be simple but I'm stymied. See the attached workspace and simple sample data. Due to the nature of the dataset, the single file in "DATA" gets a slightly different file name each time we receive it. So all I need to do in theory is: Readers -> "Import Feature Types" -> (Change to | delimiting) -> Press "ok" -> Select the updated "feature type" -> delete the old one from the workspace -> link the new one up. Done! Except it doesn't work. I've done it in the attached but as you can see if you run it, it just skips those features. Despite the fact this feature type is listed under "feature types". Even if I delete that feature type and use "Import" instead, I get the same thing. The only way to fix it is to add an entirely new reader. Here: https://drive.google.com/file/d/0B22cYd3gwE-6NjIxRHhWUVhOY0E/edit?usp=sharing Can anyone tell me what I'm d
I have a workspace that writes out one multipart shapefile (many rows in the dbf). I'm looking to instead write out separate shapefiles that would correspond to each part (i.e. one shapefile for each row in the the multipart shapefile). Not sure if my workspace requires additional transformer(s), modifying the writer parameter settings, or would involve both transformers and writer parameter settings. I tryed experimenting with fanout settings in the the writer, but I haven't got anything to work.
I noticed today that the dwg writer asks for a file name in a folder (unlike other writers that simply ask for a folder). How can I force FME to call the resulting dwg by the "feature type name" that I define in the name parameters of the writer? It seems that when I do define a name here, it still reverts to calling the output whatever I chose when I was first forced to chose a folder and file name of the writer.
I use FME Desktop Proffesional. A minor inconvience I have is I cannot drag files from ArcCatalog to FME workbench. So instead I often use Windows Explorer, which means that for a shp file, I have to spend an extra few seconds making sure that I choose the file name with the .shp extension. Is it not possible to drag from ArcCat to Workbench because thuis functionality is part of what you pay for with the ESRI FME version, or is it not possible in either case? If it isn't possible in either case this would be a nice little addition to the program.
I think there was at one point but I can't find it in the list of readers. Thanks