Using readers and writers to extract and load data.
Recently active
Hello, I am having problems with Mongo reader/writer. First I read from Mongo, it works fine and I add several transformers (Clipper, spatialFilter - comparing with other datasets) and then I want to write back to mongo. When I check the output from the Data Inspector, it seems to be fine, geometry is the way I expected and the result looks good. But the Mongo Writer gives back the original geometry. in writer settings, I put "Document Source":JSON Attribute -> mongodb_jsonThanks!
My workspace uses a Microsoft SQL Server Spatial reader to extract its source data and all has been working fine until told my source database is moving to a new server. Fortunately I still have access to both existing and the new one to migrate and confirm the db connection is working. The server name I was given is of the format: server\\instance,port (eg. SVRxxxx\\INSxxxxx,51433). I am using Windows authentication and have confirmed my credentials using Sql Server Mgmt Studio. When I attempt to Add a database connection in FME options, I enter the database name into the Server field of the Connection Parameters in exactly the same format as I did in SSMS (and which I had always done successfully in the past when my source db did not have a comma port number in the server name), but when I press the ellipsis to obtain the list of databases to which I can connect, I receive an error: Connection failed. Connection string `Provider=SQLNCLI11;DataTypeCompatibility=80;Data Source=WCx
The SQL Server database I'm connecting to won't support database authentication (policy), so I got a AD service account created, but I can't find an option where I can use Windows Authentication, but I can still enter in the credentials (they are greyed out when you choose Windows Authentication).FYI: I'm using FME 2018.1
(V2015). I have a V8 dgnlib I would like to output to an excel sheet the list of levels. There is no geometry in the file. Any suggestions? I have tried the reader but i think it needs geometry on the level. I think someone suggested an additional step or action but i cant remember what it was or find the post again sorry. many thanksB
I have downloaded the transportation file with pbf extention through hotosm. However, FME throws error while reading the file.The error I get as it is in the following: "Failed to obtain any schemas from reader 'OSMPBF' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading."Thanks in advance.
Hello,I am doing simple analysis selecting lines which are Within Supplier (Area) basically crated buffer followed by dissolved and the SpatialRelator for selecting features. I have use SpatialRelator for that but tacking too much time (features count 1000000). Can anyone have solution?
Hi everyone, I'm a new user of FME Desktop and I want to populate an existing database starting from a shapefile, which contains both geometries and attributes. I want to keep both of them when I create the workspace in FME Desktop, so firstly, I started adding the shapefile feature type as "Reader". To understand the geometries involved, I used "GeometryFilter", selected all the geometries, and for each one I used the "inspector" transformer.I found out that I have only "Surface".Secondly, I used "PostGIS" as "Writer" and run my workspace. The translation was successful, however, when I open the database, I have two different types of geometries: "Multipolygon" (without the "Z") and "GeometryCollection", and I cannot see both of them in the map.If I inspect with Data Inspector my output file (PostGIS), I see the geometries and the attributes. What could be the problem?I hope I have explained
HiGetting the following Tunnel error - reading online seems it might be an SSL issue - Can this be looked at in the Database connection parameters and the reader and writer for MongoDBSeems only to be an issue if using the hosted serviceMONGODB writer: Cannot connect: DBClientBase::findN: transport error: mydatabase-shard-00-00-ch90m.mongodb.net:27017 ns: admin.$cmd query: { ismaster: 1 } MONGODB writer: Unable to locate or open database 'mydatabase-shard-00-00-ch90m.mongodb.net'. Please ensure the database exists and is accessible. Note that the MONGODB writer does not have the ability to create a new database. However, creating the database manually in advance allows for subsequent data insertion
Hello,When will fme 2018 desktop or server have the ability to read / write ecw3 files?cheers
Hi there! I'm new to FME, so I apologize if I ask for a commonplace. My task is to create a 3D PDF, which will be a sequence of geological layers. Each layer is described by two files in the geotiff format - one corresponds to the top of the geological layer, the second to the sole.I converted them to TIN-surfaces, afer which I tried to convert them to mesh, but the Mesh-builder transformer rejects them. I also tried to go the way of creating 3D polygons as in this example, but, again, I could not convert polygons to mesh. Output example and 2 layers are attached. Thanks!
Hi all I'm sorry probably my SQL knowledge is too less but I tried to append some records to an existing table postgresql but I received this error Bulk copy failed on table 'Slist_ITA.List_StreetName' using delimiter ':'. Error was 'ERRORE: un valore chiave duplicato viola il vincolo univoco "List_StreetName_pkey"DETAIL: La chiave (id)=(3554) esiste già .CONTEXT: COPY List_StreetName, riga 1'A fatal error has occurred. Check the logfile above for details... Last line repeated 2 times ... I attach also the picture of wb (very simple) Thx for help Francesco
I have csv file and want to convert it in text file.
As an additional source for a transformation I need an xml-File with a given name. This file can be located online (url-adress). If its not online the XML-Reader should use a local file (with the same name). How can I implement this in a Workspace? Thanks for your help
Hi,I'm wondering if you can help. I'm using FME to interact with the https://app.traveltimeplatform.com API using the HTTP Caller which returns a field with the below JSON:[{"shell":[{"lat":51.5050330184,"lng":-0.145035260000001},{"lat":51.5054826584,"lng":-0.145484900000001},{"lat":51.5072812184,"lng":-0.145484900000001},{"lat":51.5077308584,"lng":-0.145035260000001},{"lat":51.5077308584,"lng":-0.143236700000001},{"lat":51.5081804984,"lng":-0.142787060000001},{"lat":51.5090797784,"lng":-0.142787060000001},{"lat":51.5099790584,"lng":-0.143686340000001},{"lat":51.5108783384,"lng":-0.143686340000001},{"lat":51.5117776184,"lng":-0.144585620000001},{"lat":51.5144754584,"lng":-0.144585620000001},{"lat":51.5153747384,"lng":-0.143686340000001},{"lat":51.5162740184,"lng":-0.143686340000001},{"lat":51.5167236584,"lng":-0.143236700000001},{"lat":51.5167236584,"lng":-0.142337420000001},{"lat":51.5158243784,"lng":-0.141438140000001},{"lat":51.5158243784,"lng":-0.139639580000001},{"lat":51.51492509
Hi thereI have a question relating raster/point cloud. I have a zip file with a variable number of rasters.The boundaries of each raster can be different and there could be non common cells.I have a worksheet where I can create separate csv files with x|y|z lines.Bit I need to create one single csv with a combination of all the rasters.The lines for this csv must follow this schema: x|y|zraster1|zrster2|....for non common cellsx|y|z||zraster2||zraster4| etc How can I do it? I´ve figured out a way with feature readers and concatenating strings but it´s painfully slow for big rasters (it takes days) Any help would be appreciatedThanksOskar
I'm able to run a drawing that has one Pipe network with Civil object Pipe and Pipe3d readers. When I have a drawing with Design and Existing water networks it only reads the existing. I've tried adding attribute manager and exposer which helped reading blocknames in the structures workbench. I've tried adding (importing) two layer features as all pipes are on C3D Pipes layer and Ex-Water and D-Water layers but I think using two different types of readers (objects and layers) is not working. Hello FME Community thank you for looking at my question. I'm new to FME, this is my first series of workbenches. Any suggestions would be greatly appreciated.
HelloI would like some suggestions for a task I have.I have several different shapefiles each of them with a different table structure.What to want to achieve is to merge them to a new shapefile with a new table structure that will 'pick' certain features from the columns of the shapefiles and populate the new table:Example
I'm curious to know if someone in the community has attempted to do transformation from xml to jsoninsights appreciated
Does anyone have a good way to extract the center point of a text string from DWG format?In the past I've had very good luck in DGN format using a Bounding Box and Center Point Replacer.However in these DWG's I have, the Bounding Box appears incorrect. In the image the problem is exaggerated, I believe Inspector is enlarging the texts compared tot he DWG size. The closest thing to the center point I've found is the upper right corner of the BB, but results are inconsistent, especially for text placed at an angle. Image shows text string, insertion point, BB calculated by Bounding Box Replacer, and the BB center.
I am new to fme and trying to read kml files from an http address, where the files may be spread out through different directories.I would like to recurse through the directories and find all the .kml files and write the placemarks out to a AGOL feature service.My issue is I do not know how to gather the .kml files from the http address. I keep getting errors about reading from the address and 404 with the http response. Should I be using the HTTPCaller, or can I simply use the FeatureReader or a direct KMLReader?I have tried all three, but with no success. Any help would be appreciated.
Hello, I have just started doing a bit of raster analysis in FME and was wondering if there was an alternative to the zonal statistics tool in ArcGIS? I have a raster grid containing landuse areas and need to sum them up to calculate total area, a tool to sum an entire raster (minus nodata values) would also do the job. Thanks very much, Ed
Hi, I want to be time efficient when updating a very long domain list in a SDE Geodatebase. I have created the new domain values in an excel document and would like to empty the current domain list and refill it with the values in this document. The geodatabase of course contains a name for the domain list, a field for the code and for the description. The excel i structured in the same way; a column for the code and a column for the description. Therefore it's essentially a copy/paste job from excel to geodatabase. Can anyone suggest at workflow with translators that can do such a thing?In the future it would be hugely beneficial for me to have a workflow that would read through the list and only add/write the values from the excel file that are not already in the domain list. Thanks for your time and tips,Sofia
When writing kml folders, how do I control the order they appear in the GE table of contents. It doesn't seem to be the order they are in the workbench or the creator number. Also I'm currently not getting any shape to kml translation, missing something easy in there. The goal is to eventually spilt nautical chart outlines by scale (ive done this in another workbench) and then conditionally pipe them to each folder by scale, but one thing at time.
Hi How can read an Access DB stored in Sharepoint of my company ? Thx Francesco
I know I'm well behind the times but has the formatting of an output (writer) ESRIJSON changed since FME 2012? If i use FME 2102 to extract 1 polygon from an ArcSDE 10.1 database and write it to ESRIJSON, attempting to use the standard ESRI "JSON to Features" (ArcGIS 10.4) tool errors out with a :"ERROR 001558: Error parsing json file ......". Is there a difference in output format since FME 2012?