Using readers and writers to extract and load data.
Recently active
Hi,we have just ugraded from FME 2013 to FME 2018.1. Input data of the workspace are xml-files. In the workflow a liste ("Namensliste") is created by using the transformer ListConcatenator. The liste containes names separated by carriage return and new line. In RealDWG-Writer a template DW T is specified, user parameters of the liste are "char" for type and "400" for width.Running the workspace in FME 2018 a new warning is now logged: Truncated extended entity Attribute Value in 'Eigentümer' from 'Eigentümer=Mickey MouseMinnie MouseDagobert Duck….some further names….Donald Duck ' to 'Eigentümer=Mickey MouseMinnie MouseDagobert Duck….some further names….Dona'. Cannot be longer than 255 characters in length I checked the created DWG: despite of the warning all listes are written correctly/completely to the layer "ET". How can I avoid this warning? What about the format parameters in the writer? There are some parameters wi
Hello, I'm trying to set up a workspace where I can ingest an API and send it to Socrata. My background is not technical so when I look at the example FME workspaces and research JSON transformers, I know am not identifying all the necessary transformers that would take the JSON and turn it into a CSV. Attached is my current simple test (the credentials are placeholders and do not work) and I would appreciate any insights or direction. Thank you,
Dear All, I need to convert basemap data (vegetation,roads,building) available in geodatabase format to citygml format.Kindly advice Regards,K.Jayakumar
As part of an API that i'm using I need to encode a .zip file to base64, but I haven't succeeded to do this using the attribute-, text- or binaryencoder transformers of fme. As an attachment I added the file 'receptors1.zip' that I'm trying to encode to base64 in fme. From a debugging script of the API I know for a fact that the base64 encoding that i'm looking for equals:UEsDBBQAAAAIADVVSkv67CW/DQEAABwDAAAOAAAAcmVjZXB0b3JzMS5yY3CN0l1KxDAQB/B3wTvkBDKfycxpyqLiy+4WFlbU0ztJS5KqD7b8Gyj9MZNJr7d0PV1e08fyvK639Lktp/e35QvSy3pZzvd0vmOEIhyRiEZypEQs4o8PkIRE2TlhNiueRNQVEjwBmasnTG4J9pu2dTAJ5pDzzATZglnpDKk+ustOVMt5oXAZQJrLzlSddpcjPjOu5VB9ZsUx1y65M4lwZyaK2+Y2pnZgdGAyMxqbG0y0BMtjc7Vdstm1Lin4cAxx1XLNjMHA7Nowhe23iw+PcDh3g2mYiLgNUwrWPqWDUvv02eE+ze5GvXg5FxOcXZsLi/7hHA/uUK6NRRl39q/tKSr4dHqYdT+Gn/+K9nF+A1BLAQI/ABQAAAAIADVVSkv67CW/DQEAABwDAAAOACQAAAAAAAAAIAAAAAAAAAByZWNlcHRvcnMxLnJjcAoAIAAAAAAAAQAYAABnoJijQdMBAPB4SNxC0wFgWzSbL0PTAVBLBQYAAAAAAQABAGAAAAA5AQAAAAA=On the website https://ww
I'm writing my output to an Excel spreadsheet, but the file also needs to be written to an XML. I've been provided an XSD schema file and using XML Schema Validation in the writer's parameters with the provided file. I get an error of "no declaration found for element 'xml-tables'. I think I need to declare it in XML Namespace Declarations, but I'm not sure what syntax to use for it. Could you provide any insight, @DeatAtSafe?
I have several types of report text files (start/stop, list of features with errors, ran ok no issues, number of rows, counts). to compare them to find errors and put into excel
Hi, I have a load of traffic camera images in AGOL that i want to update regularly using FME. I realise there are the AGOL feature service tools in FME but images are not feature services though they do have a URL. Is it possible to update images?
I have a file geodatabase, I am filtering various features from this and am writing it to DWG. However, I want to break down this single file geodatabase into multiple DWG tiles. I am currently using a clipper to clip to my new tile boundaries, when I go to write however I cannot name multiple tiles with different names because I also want to name the various layer names dynamically. Is there a way I can name the tile for example write multiple tiles (eg. 1234, 1233, 1235) and name the layers individually as well? I hope this makes sense, please feel free to ask questions if it doesn't. It's hard to explain over the internet. Thanks so much for any help. B
I have a workspace that reads multiple features from a CSV file, transforms them and then writes the results to a custom text format (using text_line_data).I would like to set the name of the output file at run-time based on a 4 digit integer value read from a second input CSV file. For example, if the integer is 2934 then the relevant attribute is set to OUTPUT_FILENAME=output_2934.txtHowever, I am getting in a mess trying to configure the output text writer. If I fanout on OUTPUT_FILENAME, I get two output files (rather than the desired single file) when I run the workspace. The files produced are output_2934.txt (with no content) and output_.txt (with correct content). If I don't set the fanout, I can't see how to configure OUTPUT_FILENAME.Is my approach fundamentally flawed? Any help much appreciated.
Hello, How can I add the elevation as 3rd dimension to existing segment?I have the elevation values for the starting and ending points of each segment. Thanks
Hi all,I would like to know how I can simplify some work that I do now in Excel with a very complex formula.What I want to do, is to "compress" a table. I made an example above (not the kind of data, but the idea is simple). Code 1 is leading, and is a code for a certain spell. Value A and Value B are pieces of information that belong to Code 1, but some information is fragmented and/or absent in some rules.What I want, is that I will get one table like this one:In this way, I can just use the DuplicateFilter to extract just one random Code1 feature to get the compressed data set I want, including all information. Does anyone have a suggestion? In Excel, I just took the longest answer for every cell and per Code 1, but I would like to do this process in FME since it will be way faster for larger datasets I assume. Besides that, my Excel formula had to be six sentences long in order to cover the right range for Code 1, consuming a lot of computation time. Regards, Martin
Has anyone ever encountered this error when trying to use an excel file as a template in the excel writer?I've had a new machine since the last time I tried to use a template in a writer and wondering if something is missing, just not sure what that's likely to be...(FME 2018.1.0.2 (Build 18547 - WIN32))
Hello there!I have tried to write several raster files (TIF, PNG, ..) using the FeatureWriter with the "Generic"-Format which works pretty well unless no WorldFile (tfw, wld, ...) is beeing created.Is there a way to tell the Writer to create a world file for the raster files?Thanks a lot! Regards JacobThis was the configuration I used:
How can I create/update an Oracle table using a stored sql procedure instead of a FME-writer. The procedure already has a lot of validation and logging, so it would be a great advantage to use this instead of redoing it all in FME. Is this possible using i.e. SQLExecutor? If so, how to set it up in FME?
I have FME Server 2018.1 polling an IMAP account that is with Office 365 and I am only receiving the imap_publisher_content{0} in text/html. Is this a limitation to e-mail polling of IMAP? I really would like to receive the content in plain/text as well like before when I used FME Cloud's SMTP server. Any ideas? I've tried to use the html stripper and regex, but I'm getting mixed results with that.
Hi Guys,i have an EXcel Sheets with coordinates and an attribute i have to write it in an ACAD Block...i've tried the DWG STyler with Template/BLOCK etc...bu it doesn't really works....especially to write the attribute from the ecel in the block my block looks like that (Screenshot)any helps or ideas?GreetzFranco
Hi I tried to use the Google GMail API to read (and manage) my GMail but I'm not able to configure in correct way the web connection Can you help me ? thx Francesco
With reference to the following tutorial which uses the SQLExecutor to perform a spatial query in SQL - https://knowledge.safe.com/articles/19649/performing-native-spatial-queries-on-database-tabl.htmlThis works for nodes in my OSM postGIS table but if I try exactly the same method on ways it throws an error. e.g.:select *, "id", "tags"->'highway' as "highway" from ways as osmwhere "tags"->'highway' is not Null and ST_Within(osm.geom, ST_GeomFromText('@Value(_geometry)', 4326))=TRUEThe log says a fatal error occurs at the character which I've underlined in the code above (osm.geom).How can I use this method to query for ways?
When I use the Emailer transformer and send an email with a *.xls attachement it works fine but I want to send a *.xlsx attachement. When I do that, I get an error. Is it even possible to send an email via de Emailer with an *.xlsx attached to it?
Hi,My question is quite simple but I don't find the solution:Is it possible to change the schema of a postgres reader, and even the table name ?This field is disabled when I try to edit the reader (see below).The only solution I found is to recreate the reader.Thanks for any answer. Christian
Hi,Can FME read drone log file (UBX, it captures flight path) and convert to sHP/kml?thanks,Wilson
I want to create LOD2 objects from very dense LiDAR data approx 20 points/sqm. As input i only have 2D buildings as polygons, representing outer boundary of building, with no roof-ridges or other roof details.I have tried transformers like TINGeneretor, SurfaceModeller and PointCloudSurfaceBuilder but I can't get a neat result. My main issue is going from the high resolution TIN to larger generalised planar roof surfaces.Main question: How do I use FME to make planar areas to represent a simple roof with two (or more) roof sides? Greatful for any ideas.
Using powershell to get the current token of a user I do not have problem:$uri = "http://myserver/fmetoken/view"$postParams = @{user='Myuser';password='PS78U-w&'}$foo = Invoke-WebRequest -Uri $uri -Method Post -Body $postParams$foo.Contenti receive the token.if I use postman to verify it, there is no issue.but if I want to implement the same action in c# i always have a bad request: var url = $"{fmeServerUrl}/fmetoken/view";var body = $"user={settingsUserFme}&password={settingsPasswordFme}";var bodyencoded = System.Net.WebUtility.UrlEncode(body);var byteArray = Encoding.UTF8.GetBytes(bodyencoded);var responseCode = 0;var request = (HttpWebRequest)WebRequest.Create(url);request.Method = "POST";request.Credentials = CredentialCache.DefaultCredentials;request.ContentType = "application/x-www-form-urlencoded";request.ContentLength = byteArray.Length;var dataStream = request.GetRequestStream();dataStream.Write(byteArray, 0, byteArray.Length);dataStream.Close();WebResponse response =
Hi,I am trying to read a number of excel files. Some of these files have a sheet called content. In cell A1 there is a name which is different for each file with the content sheet. On the second row there are attribute headers, and from the third row each row contains data. The problem I have is that the first file I read from a directory does not have the content sheet. So I can not specify start row 0 when reading attributes. The result I now get is that the first file with a content sheet is read but the first attribute has the name of the value in cell A1. Every file coming after this tries to read the same attribute name as the first one which is missing in this next file.Does somebody know a solution other than removing the first row from content sheet.
I am trying to use FME to produce a json object which can interact to JDE AIS. This requires several HTTP POST calls to perform actions in JDE. I am trying to get a Token which is the first step and is a very simple object. I have used a program call Postman to simulate the POST request which returns me the token successfully. I am trying to replicate this process in FME but i recieve the following error HTTPCaller(HTTPFactory): Received HTTP response header: 'HTTP/1.1 400 Bad Request' from 'http://Server:Port/jderest/tokenrequest' Does anyone have any ideas as to what i could try to get this process to work?Screenshots below.