Using readers and writers to extract and load data.
Recently active
Hi, I'm trying to merge features from 2 excel files with FeatureMerger.. It works if I have a relation one to many but it does not when I have many to many relation.. any idea.. Thanks
My KML files have a Description element and the Description have either an attirbute/value pair or just a value. After the Description has been extracted and a ListExploder for each entry on the description, two stream were created - one for entries that have an attribute name/value pair and another one for entries that have a value with no attribute name. For the name/value pair (22 entries per feature) they are split and then @Value(_list{0}) was created and (_list{1}) assigned a value to each entry. For the value only entry (3 entries per feature), an attribute name (attr_name) is created using the element index and then another atribute using @Value(attr_name) is assigned the value of each entry. When the attributes are merged back with the geometry, the data stream from both attribute streams appear only in the feature information window when features are identified in the inspector. he transformers don't show any attributes . When I use AtributeRenamer to make the attribut
Hi! The excel writer doc says that:"The writer feature type option to Drop Existing Sheet/Named Range is irrelevant if specifying a template sheet here, since the existing sheet will always be replaced by the template sheet." [my underline]. This is not true. The template sheet is retained, and new sheets are created after it. Fanning out data on an expression like <fieldname>.xls and using <fieldname> as sheet name, and Sheet1 as template sheet produces an excel file with two sheets, Sheet1 and <fieldname>. This is not as expected (or my misunderstanding). I have tried numerous tweaks for truncate-overwrite etc etc to no avail. Please advise. Regards, Mats.E
Im creating some tables with an oracle spatial writer but its creating them without a primary key. I am using a sequence in oracle to increment the value but the created table does not have this ID set to primary key. How do I get a table I am creating to set a column to be the primary key? (Im in FME 2013)
I have a few additional generic attributes with specific values (meaning of them are in a separate codelist) in my CityGML dataset. Now I want to test them with the transformer "Filter" an sort them by the gml:id. Then I want to write them in an Excel-file or text file. Some attributes are also in the buildingpart with means I need a multidimensional output maybe as xml-file. How can I test only one attribute with the transformer "Filter"? My intention is to build a row of transfomers and every transformer is testing one attribute. At the end I want to write a protocol with invalid datasets. Any ideas? Best regards, Frank
I am looking to create a road outline (Open Street Map). We have gps traces for the left and right edges of the road (time stamped, as two seperate data sets). I realize that most folks would just want the centerline of the road, but we have an unique need, and we need the way paths for both sides of the road. No need for a full workup soluiton, but if you have tips that would be good (it is a small area, only about 30 acres of road).
How to add the result of the spatial relator as CSV in the data of requestor
Hi! I'm using FeatureMerger to merge a Shape file and a CSV file, and outputting to a GeoJSON file. The merge works as it should, but is producing seven extra attribute columns that I don't want, even though none of the Format Attributes are selected in the Feature Type Properties settings (csv_line_number, csv_number_of_fields, csv_total_number_of_columns, multi_reader_full_id, multi_reader_id, multi_reader_keyword, multi_reader_type). This is obviously making the GeoJSON larger than necessary. Can someone please tell me how to ensure these Format Attributes don't get written out to the final GeoJSON file? Thanks!
Hello, I have a bunch of shapefiles as inputs but i'm not using them all everytime, so i put them as Optional in the User Parameter. But i get this message : "Shape Reader: Failed to open dataset 'T:\\Test\\\\SHP\\test.shp' which is neither an existing file nor directory" when i run my script using a python script. Eventhough the shapefile doesn't exist, since it's set as optional, FME should ignore it, no ? How can I make it work please ?
Hi, I am trying to create a folder in "Resource Management" on our FME Server 2014 SP2 - Build 14336 - win32. But the buttons (Upload, New Folder, etc.) are not accessible. And the message "There was a communication problem" is displayed. I have added the following lines in fmeServerConfig.txt: What have I forgotten? Regards Magnus SHAREDRESOURCE_TYPE_6=FILE SHAREDRESOURCE_NAME_6=SERVER_TEMP SHAREDRESOURCE_DISPLAYNAME_6=Server Temp SHAREDRESOURCE_DESCRIPTION_6=This shared resource is for temporary files SHAREDRESOURCE_ISMIGRATABLE_6=false SHAREDRESOURCE_DIR_6=D:/Temp/
Search results for I use several readers in one script, if one is empty FME stops, how can i skip empty readers without stop?
Hi, I have GML dataset with different polygon orientation. I need to get two points in clockwise order from that polygon. E.g. (in WKT): POLYGON ((0 0, 10 0, 10 10, 0 10)) - counter clockwise Points from this polygon: First Point - POINT (0 0); Second Point - POINT (0 10) It doesn't matter which two points, but they need to be one after another, and orientation must be clockwise. How to determin or change direction of polygon in FME to know what point I need?
In below image if my excel sheet name is January then all the Fields of Januray joins with writer field "Previous reading","Current reading" etc.If my sheet name is February then all the fields of February joins with with writer field "Previous reading","Current reading" etc.I want a single Fme tool to just read from excel sheet name if its January then all the fields of Jan goes to relative field.If my sheet name is March then all the cloumns of March goes to the specific field.
Hello all, I have a problem with CSV reader with FTP path in FME Desktop / FME server 2015.1. My goal is to watch an FTP server for new files, when a new file comes in, test the name for today’s date and the extension for .csv, do some manipulation to that file and put the data in a database. Once it is done, I want to trigger a job on the database. As for now, I have a watcher on my FTP server which triggers a workbench that tests the name of the file and launch another workbench with an fmeServer_JobSubmitter. This workbench has a csv reader that takes the FTP path of the file and reads the file. It does the manipulations and put the result in the database. Then, the original workbench triggers the job on the database. I have around 150 files to load every morning and it works for around 140-145 of them every time, but there are a few files that don’t work for a mysterious reason. For the files that didn’t work, I tried the use the same JSON received by the watcher in the “test t
Hi, I have a Microstation file in which I am writing to Sketchup. The initial translation from microstation to sketchup works but when I open my sketchup file, the model is placed very far from the origin. Is there anyway that I can move model to the origin?
Hi everyone, Is it possible to change geometry names for a boundary too? I used the GeometryPropertySetter to set the GeometryName and Traits (see pic below), but it also changes the geometry name for the Boundary IFMELine. I want to set the name for the boundary to curveMember (see Example 2nd pic). The Problem is, that FME is creating a LinearRing for an ElevatedSurface, but i need an GeodesicString. I hope that the geometryname will help me with that. My geometry: It should look similar to this: thanks, Mel
Hello, I am trying to create a workflow in order to transform a dwg to a cityGML file and later to import it into a 3D citygml database. I have tried to find an example online doing something similar but I had no luck. I wanted to ask if something like this is possible with FME and if there is an available example to get a first impression of how to implement it. Thanks. Dimitris
I have an ODBC connection to a table that geocodes addresses and writes it to an ESRI ArcSDE feature class. When I run my workspace on my desktop everything works fine, as soon as I upload it to my FME Server I get this error: Database Error Message: [Microsoft][ODBC Driver Manager] Data source name not found and no default driver specified It's a System DNS connection and I checked all the drivers and 32bit connections and everything is good. So not sure what is causing it not to work on the FME Server. Thanks!
Hi, Say I have a massive table (+15million lines) with multiple columns , it has a Field called "category"..the category Field has multiple data values in it. how do i split the table based on the field category? say the field has 150 categories in it..therefore I need to have 150 tables. so if the input is 1 csv file.. the output required is 150 csv files separated per category. I think this could be a test filter with so many filters in it. thanks in advance. kind regards, Jubert
Hi, I create a MapInfo to CSV just to get a feel of how to use FME WorkspaceRunner, I tried to imitate the example: https://knowledge.safe.com/articles/Samples_and_Demos/WorkspaceRunner#toc1 which was provided in the Documentation however I am quite wondering how it works. I have 30 mapinfo files (on my target application could be 20k++ files) so when I run the normal mapinfo to csv it goes normally as below: however, when I run using the workspace runner, I get 4 times the number of files i had previously. why is this so? thanks in Advance. kind regards, Jubert
I am reading from a shapefile into a Python caller and get this error message: Attribute value of 'DESCRIPT' could not be converted to Unicode using attribute's encoding of 'utf-8' This error occurs at this line: feature.getAttribute("DESCRIPT")).strip() I have used the Python shapefile module in a standalone Python script to isolate the offending character. It is the hyphen in this string: 200 Block of W Georgia - In my standalone Python script I can convert the hyphen by converting from its Unicode number to a Window hyphen, like this: 0x96:'-' However, the exception is raised in the FME Python Caller in the line above before it gets to my conversion function. This happens with FME 2015, not FME 2011. Is there any workaround? Thanks
Hi guys, I am currently creating a 3D model for a drainage run, As they tend to be quite simple, I am using FME to do it. I have all of he information saved in .csv files (Manhole Co-ordinates, Manhole Cover Levels, Pipe Levels, Pipe Diameters etc.) Now, I have modelled the pipes just fine by using a point connector to connect the manholes with the same pipe attricute and then 3d buffering the line by the radius of the pipe, but, the manholes are a different question, as they are being modelled as Cuboids. With the cover level being the top face, and the bottom of the pit being the bottom face. In this site we have basically a different chamber depth for every manhole, and about 10 different cover sizes, so, inserting 3D Cuboid Cells/Blocks is out of the question. The only way I can get this to work is to offset vertices from the centre of the manhole cover, connect the lines using a point connector, and then extrude them to become the faces of the cuboid and aggregate them. Of course
Hello, is there a way to convert polygonal entity (geometry) into a surface or mesh or face? thank you
How one can control the order of reading of multiple feature types in one PostgreSQL/Postgis reader so you take advantage of Supliers first , Areas first , Candidates first and so on First ??
Hi all, If I have GML file (utf-8 encoding) with (e.g.) LATIN SMALL LETTER C WITH ACUTE which I want to insert into SQL Server table with SQL_Latin1_General_CP1_CI_AS collation, and want to be able to export that (imported) value from table to gml file, what should I do? I tried text encoders/decoders, but without success.