Using transformers to modify data.
Recently active
Since upgrading to FME 2018, I've noticed my available hard drive space has decreased considerably. Poking around in my Local/Temp folder, I see there is a folder called FMETable that contains over 35GB of files.Diving deeper, there are gigantic files in there related to the FeatureJoiner:So my question: Is this supposed to be happening? Do I need to manually clean this stuff up on regular intervals?
I am trying to read in some pdfs, unfortunately when the pdf reader fails to open the pdf (if say it is corrupt) the workbench stops:2019-03-07 15:40:24| 391.6| 0.0|FATAL |PDF Reader: Failed to open document '\\xxxx.pdf' because the file is not in PDF format, or because it is corruptedI have set the workbench to ignore failed readers and continue transaction is setup under the Rejected feature handling. Is there any way I can keep it running?Thank youOliver
Hi, I am reading text from a pdf using the PDF reader and in the text I see xEF, xBF, xBE - what are these and how do I remove them.Thank you
Hi all,I'm trying to download all zip files from the URL below, keep a copy of the zip in one local folder, and a copy of the extracted csv in another local folder. http://www.nemweb.com.au/REPORTS/CURRENT/Daily_Reports/Using the workspace attached , I can successfully download and extract a single zip file and csv content.I believe there may be a list of all zip files available from the URL hidden somewhere in the response, but how would I go about extracting all available zip files and storing the resulting csv ?Thanks
Hi, I am a true knownothing on this, so here it goes: are there any people that have experience with processing in FME of file resulting from Hexagon's 3D SmartPlant application? Any answer would be greatly appreciated.
I'm having trouble locating a clear answer because of some of the upgrades to the tools that have occured in the 2017 version. PointConnector was superceded by LineBuilder, which works well when I have multiple features with the same value in one field, but sequential values in another field.What I can't figure out is how to create lines from points by specifying certain fields to connect. For example, I have around 30,000 point features in two different point layers (60k total), which need to be connected based on shared values in a shared field.I know I can combine these as Suppliers in the FeatureMerger, join them with a requester, and build lines from points, but the tool seems ambiguous on exactly how this works. In other words, I don't know how the tool knows how I want to build lines.The concept of what I need to do is as follows:VertexCreator A --> Points A (created from A field) --> VertexCreator B --> Points B (created from B field) --> ---> Connect
Hello,I am reading my oracle non spatial database with an SQL query containing couple of dates. When inputting the dates directly in the query, there is no problem and it runs smoothly.I would like to make user parameters from these dates. So I have created published user parameters choosing 'date' as type.I then try to use the parameter in my SQL query (where clause) but I get a type error over and over. I have tried couple of different notations but it doesn't seem to work... This works (without parameters) AUTO_START_DATE <= TO_DATE('15/12/2019', 'DD/MM/YYYY')Then I tried several variation to use : $(START_DATE)but I can't seem to find the right syntax. Thank you
Hi!Newbie here so i'll start by introducing. I work at a government organisation in which we use a management system and have a need for FME. I wish to learn to use it myself, to help our department and I think a lot of my 'work' can be done by FME. My question:I have a DWG of a road in which all the objects have their own layer. So all the asphalt have the same layer, grass has same layer, and so on and so on. But for the management system we need different information for the asphalt in comparison to, for example, grass. So we need shapefiles of both with different information. Is it possible that I take the DWG file and let FME translate the layers to shape, and give the different objects their needed feature table. So a asphalt DWG polygon turns into a asphalt shape with a feature table that includes thickness and year, and the grass line turns in to a shape with feature table type of grass and year. And they both will be in the same DWG. My apologies if it is not all
I have got a shapefile and I only want to extrude the boundary layer and leave the centre hollow. Any tool to help me do this? If not is there a way to do this by calculating normal vector and then using appearance setter to make the centre transparent?
See attaches screen dump.Is it possible to expose the 3d face boundary coordinates ?ie coordinates:0123No luck with GeometryPropertyExtractor (Traits) but I could be missing something.<FME Inspector does not suggest these are traits but I tried it anyway>.............Geometry Heirarchy isIFMEFace (not shown on screen dump)Area:IFMEPolygon (see screen dump)Boundary:IFMELine (see screen dump)...............Any suggestions most welcome...............RegardsHoward L'
Hello,I have data set that I need to join attributes from csv file. I am joining with ID that is combination of letters and number e.g. tk14b.Problem is with letters because i have mix of upper and lower case but tk14b is, for me, same as Tk14B and every other possible mix.Is it possible to set FeatureJoiner to be case insensitive? Or, is there any other way to join my data set with attributes from CSV file? Thank you in advance.
For 48 hours now, I have been running an ShortestPathFinder transformer, and I am worried that it is not making any progress.For context;643,312 features in the road network13,539,080 From-to lines (these are all 2 point lines) Progress so far;344 ShortestPathFinder_NoPathno other output My expectation is that ShortestPathFinder should be sending lots of output to ShortestPathFinder_Path but there is none. Is this normal behaviour? Does the transformer save up the output until the end of the process?Should I kill the process and try to tweak it? I would lose 48 hours of processing time if I kill itIf there was a constant stream of output to ShortestPathFinder_Path then I would be comfortable that progress was being made, but there is not
My name is Pelwinderpal Singh and I am currently working for AGI. We currently support the cesium 3d tiles format here in FME. Would appreciate if I could get some help on this issue I am experiencing. Thanks. I opened an esri shapefile using the shapefile reader. I then used attribute creator to create an attribute with a value. I then converted it back to a shapefile using the ESRI writer. When i open the new shapefile, the attribute is still not shown. I tried adding in an extruder after the attribute was created. I extruded vertically and for direction, I put attribute name that I created. I then converted to a shapefile using writer. When i inspected the new shapefile, i could see that the extrusion worked. This means that the attribute was created. My only concern here is how to get the created attribute to be shown?
I have a csv containing point data for series of paths so each point contains a pathID attribute. I want to run the points through a workspace but for groups of the points by path. ie run the workspace for path one, output a feature, run the workspace for path 2, output a feature for path 2 etc. Whats the best way to do this? I'm thinking its by using the variable setter and retreiver but not really sure that is the best way.
I have a dataset of local roads, which I want to use for ShortestPathFinder. The road network includes roads on islands, and those roads are not connected to the roads on the mainland.Is there a transformer that can output only those roads that are part of the mainland road network? I want to eliminate the islands.
I've been struggling with this for quite some time now, but without success...I need to write a pdf-File for each feature of my data, containing only a table with it's attributes (Attribute Name: Attribute Value), no geometry.As suggested here https://knowledge.safe.com/questions/74002/attribute-data-to-pdf.html, I first tried to write excel-Files with this tables, using a featurewriter / fanout (https://knowledge.safe.com/questions/46550/dataset-fanout-for-featurewriter.html)But my problem is, how can I write a table with the names of the attributes on the same lines as their values ? (When I'll have succeeded in writing the excel files, then I'll try to read them with a featureReader and write pdf-Files, using the TableAdder...)Thanks in advance, Vera
I have downloaded the OpenStreetMap file for Australia and successfully extracted the road geometry (tagged as "highway").I want to use this as the Network input for the ShortestPathFinder transformer.What other transformations should I do to clean up the dataset? For example, the line geometries are typically not broken at intersections, but I think that they should be.
Good morning! My input data is a series of 3D polygons that represent Administrative Units stored in an ESRI Geodatabase.I've been tasked with calculating the area of those polygons. For that i wanted to use the AreaCalculator transformer with Type parameter as "Sloped Area".No problems there. Except the final user of that data wants the area to be calculated using the Simpson's Rule. I had no idea what that was, so I've been looking for info a little bit:https://www.emathzone.com/tutorials/geometry/simpsons-rule.htmlI still don't know how to translate that to FME. Could anyone give me any pointers, please?
I have a plsql script to perform some task on db. But it doesn't contain any code for returning output(results are stored in variables). I need to get these results into FME SQL executor or creator.Is there any code sample to start with this? All I need is a example plsql code to get results into FME SQL Executor.
Hello,I have an issue when using the linejoiner. I would like to merge lineear features, some of them are arc while other are segment line.I first use ArcStoker to transform all the arc features in to segment lines and then I use LineJoiner to combine the features..It appears that the transformation with ArcStroker is creating a shift between the start/end point of consecutive features lines. Because of that it is not possible to merge the original arc features with the line segment features.Does anyone has an idea on how to overcome this issue?Thanks
Hi all, I've been playing around with the system caller, however, I've found that when I abort my FME process the process triggered using the System Caller keeps running. Part of the problem is that I'm also using the TempPathnameCreator as the output for the called process, if I kill the FME process and the sub-process keeps running then the temp files also don't get deleted. I have to manually kill and then delete the process Does anyone know of a workaround for this?
Hi all,With the SystemCaller I am kicking off an executableThat executable is looking for a file with parameters in the working directory So if I use the Command Line in Windows, I go to D:\\TEMPThat then is my working directory and it has the parameter file : parameter.iniWhen I start the executable it uses this ini file But when I use SystemCaller and I set the working directory, the executable seems not to find the .ini file somehow Anyone an idea? I now use the PUSD command to set the working directory Then starting the executable Then close the command string with POPD
This is my first question so do tell me if I'm missing anything in the description of the question. I currently have a workspace where part of the functionality includes the merging of 5 columns (two of which are always empty). The data that isn't merged should be preserved for each of the rows that are created or already in existence. Below is an Excel example of what I mean:This is the current situation This is what it needs to become As you can see the data from the first three columns are merged into one but the other three columns (ID, Type and Type 2) remain unchanged and are copied to the new rows. This causes for example the row with ID 500 to split into three rows, all of which contain all attribute information from the original that wasn't merged. I looked for similar questions but the solutions didn't work for me such as the Attribute Exploder, which does not currently have an option to select what you want to explode. The solution given in this question came
Hi,I don't find out how to transpose a part of a simple data table.I read a lot in the documentation and this kb about the AttributePivoter and AttributeTransposer transformers or other tips and tricks (with AttributeExploder and Aggregator) but I don't get to use these solutions with my test case.Here is a (simplified) sample of my input data:And here is what I want as output:As you can see, the switch has to be done between the "type" and "month" attributes but I have to keep the student column.I would really appreciate any help because I'm stuck...Thanks,Christian
Hi folks,I'm having 2 issues with my FME Server and the running workspaces.1) The session created just like documented here https://playground.fmeserver.com/javascript/server-uploads/upload-file-in-session/ doesn't give me a session like a random number but as the username the token is connected to. What am I doing wrong? Or did I miss something with the token? Or in other words: How can I delete the uploaded data after the workspace ran successfully so that further job submissions don't get/take the data already uploaded?!2) One workspace in which I read a DWG-file adds quotes to the request-URL and though cannot find the uploaded data. When I strip the quotes everything works fine. How does this happen? The workspace has a FeatureReader to read the DWG to make it as an optional Reader (the parameter "Ignore Failed Readers" doesn't have effect). Why does FME Server takes it as a multiple set of files?! FME Server 2018.0.1 - Build 18310 - win64 Cheers, Maria