Transformers

Hi, I'm using a feature reader to read a bunch of CSV's with changing column and data row numbers. I first extract the row numbers with a text file reader en feed these values into a feature reader. Like so: When running the workspace it looks like FME interprets my expression as a text:Using FME 2020.1 here. Does anyone know what is wrong? The feature reader only allows for arithmetic expressions so no option to enter text in the "Data Start Line" field Freek

I'm newbie...I adapted the code of FME's exampleFME Server Playground - Upload File In Sessionto run as custom-widget within ESRI Web AppBuilder (Developer Edition) and I have unexpected problem. This problem occurrs also if I run the exact code of the original FME's example, since the code is good, only my cloud workspace apparently lack some definitions. I'll explain - If I run FME's original code example using FME's original easyTranslator.fme workspace, then for different input files I get different results (well, it's obvious expected behaviour...).Same if I run it on easyTranslator.fme which FME has put inside "Sample" folder in my cloud (I assume it's exactly same workspace). But when I run SAME exact FME's code example on MY FME's cloud workspace that was created independently, it returns ALWAYS the results zip code of the FIRST input file, no matter if I upload other file and run on it. And if I run it from the beginning on a n

Hello, I have two shapefiles :an existing polygon shapefilea newer file containing a line (more precise) that covers part of the existing polygon fileMy goal is to obtain a polygon in which the more recent line is replaced in the initial polygon. I have identified the indexes of the points that need to be deleted in the initial file but I don't know how to add between these two indexes the points of the more recent line.I thought of making a loop in a customTransformer but it seems quite complex... Do you have any suggestions ?

HiI am having trouble speeding up the ShortestPathFinder. The input is about 7 million from-to-lines and I was hoping to speed up the calculations by setting the "Parallel Processing" to medium on my 8 core system. According to https://docs.safe.com/fme/2019.0/html/FME_Desktop_Documentation/FME_Transformers/parallel_processing/parallel_processing.htm , that shoud render the exact number of cores. Still, I don´t notice any speed improvements and the Windows task manager reports about 6% CPU load. At http://docs.safe.com/fme/2018.1/html/FME_Desktop_Documentation/FME_Transformers_HelpPane/Transformers/shortestpathfinder.htm , it says "If it is enabled, a process will be launched for each group specified by the Group By parameter." However, the most recent documentation, http://docs.safe.com/fme/2019.0/html/FME_Desktop_Documentation/FME_Transformers/Transformers/shortestpathfinder.htm , does not mention parallel processing at all. Am I missing something? How do I enable

I am finding that ShortestPathFinder in FME Desktop 2019.1.0 gets exponentially slower as I increase the number of "From-To" lines, whereas I would expect it to get linearly slower (i.e. twice as many From-To lines, twice the time) as each path calculation should be independent. Can someone explain why this would be and how I can avoid it?To give some context, I am running ShortestPathFinder over a (road) network with simple 2-point "From-To" lines whose vertices have already been snapped to the (road) network. There are (up to) 120,000 from-to lines, with a network of 280,000 edges (as output by a LineOnLineOverlayer to split all lines at intersections). For ShortestPathFinder I am using default settings, other than turning off snapping (reducing iterations from 10000 to 1000 made little difference). [Strangely, setting "Re-order From-To Line" to "No" hides all the other optimization settings - a bug?]The final output results are all exactly as I would expect, but it takes about a day

I have tried using VectorOnRasterOverlayer, Clipper, RasterBandNodataRemover and RasterClipOverlay...all being fed to an ECW Writer. And even though the results are all different, no method is giving me a clipped (i.e. no black or white boundary) ECW version of our orthophtoto: To me my method appears to be logical, but I'm obviously missing something.  RasterInterpretationCoercer parameters: RasterClipOverlay parameters: Clip polygon parameters: ECW Writer parameters:  As mentioned, I'm pretty sure I'm doing something wrong (I'm also definitely not a power FME user), but what I'm trying to do shouldn't be that difficult either. The original orthophoto looks like this: I made the background grey so it is obvious there is no white or black data surrounding the image. The clip (or mask) polygon is just something I had used to clean up the original image, and it worked well for that: The best ECW I have managed to create so far is this:  But how do I get rid of the

I'm successfully using the ImageRasterizer transformer to create images of extracted parts of a 3D model. The result is a png with a "wired optic" (see attachment). Is it possible to fill the empty spaces with color in order to get a continuous, solid colored surface? Without having any empty spaces like I'm achieving now? Many thanks for your help 😃 Regards,vill

I am using Kafka connector in Batch mode to read and process 10000 messages in a given batch execution. I want to make sure Kafka connector commits offset for 10000 messages. In case of any failure in the job, and If I restart the job (Using EARLIER option), I want Kafka connector to read messages from next offset of last successful batch run. Please advise.

Hello there, Im using the Shortest path finder transformer to analyse best routes from A 's to B's where the network is a road system. There is however a bit of flexibility in my project where the route could sometimes go "offroad" to skip going long detours. So i used my MS Paint superskills to explain what I mean.  Lets say that the black lines in the road system (network) and the yellow line represent the best result from ShortestPathFinder for getting from A to B. But it needs to take that tedious detour to west and then east again and i would want to allow it to take the green dotted detour instead (marked X), even if there is no road present there.  Pretty sure that the ShortestPathFinder does not have that option so I was wondering if anyone here has a suggestion how to solve this? And then in a way that you can set a snapping tolerance requirement for shortcuts (for example has to be max 10m a part for it to be allowed) or it wont happen. And in a way you ca

I have a folder containing a number of esri lyr files which are used to render data in ArcMap, I would like to return the name of the Esri Featureclass from the lyr file, I have attempted to do this by using both the Esri ArcGIS Layer reader and the Schema Reader and attempted to expose the ARCGIS_LAYER_DATASET using the "AttributeExposer" but it only returns <missing> .Any assistance with this is greatly appreciated. Many thanks

Hi,Which combination of FME transformers would I need to use for splitting an irregular polygon into convex partitions (and possibly also minimizing the number of resulting parts). The following figure illustrates what I am trying to obtain:I have come up with an approach based on the Triangulator which can be described as follows:Sorting all interior lines from the triangulation by decreasing lengthConsider the first occurrenceIdentify the 2 adjacent polygonsDissolve those 2 polygonsCheck convexity of resultIf convex, keep resultIf concave, discard resultThe process should for instance escape the loop when all interior lines have been consideredI created an FME workspace which does this.The initial figure:would become like this after triangulation:And ultimately the end result would be the following where all parts are convex:However the iterations are hard-coded for the moment because the custom transformer I tried to create contains blocking transformers and multiple loops which are

Hi, I've created a workspace that reads multiple dwg-files, goes through some cookie cutting and outputs the results to a pdf. The cookie cutter is dependant on a variable. I've managed to setup a second workspace that runs the above for each feature in a dataset. It all works. The problem is that the dwg-files are beeing read every time which takes some time. So my question is, is there a way to read the dwg-files in the second workspace and just pass them through the workspacerunner? Tried for some time now and can't figure it out. Thankful for any advice!

Hi All,  I'm looking for some ideas on how to get the z value from a point cloud onto a point in porformant way. As far as I can tell there is no easy way to do it. Am i missing something? Options I can see available:  Convert to Raster with RasterDEMGenerator and use PointOnRasterValueExtractor - pretty cpu and memory intensive Convert to points and use NeighborFinder - pretty cpu and memory intensive Has anyone got this process figured out?    

I've seen similar questions asked here but cannot find real solutions. So here's what I'm trying to do..I would like to get information from this page as an example: https://help.autodesk.com/view/CONNECT/ENU/?guid=GUID-03D59AAD-65B0-45E3-84F2-A12AAA5BB267.If you look at the page source, you'll see there isn't much valuable info. here and it seems to be using javascript to serve up the page (which updates when a new version is released, maintaining the original URL). If I use an HTTP caller with a GET method, I get the same page source. However I'm interested in the text you see in the loaded page. There are lots of sites out there built this way nowadays, which work in a very similar, dynamic way.Is there a solution to get data from this kind of page? The only plausible (and costly) way would be to use some service such as parsehub.com (which I have not used or tested) where you could use their REST API to get data into FME: https://www.parsehub.com/docs/ref/a

Hi,I am trying to delete files using system cleanup but no file is being deleted. I am using FME Server 2016. Any pointers would be much appreciated.Thanks.

Hey folks,Just wanted to alert you all to a new custom badge: the Inventor.This badge is awarded to any user who posts an idea that makes it to "In Beta" or "Released" (Completed) status. I've been through the existing ideas list and the badge has been awarded to the following users:If you too want to earn this badge - which is a bit more prestigious than "Pirate Chief" - then get posting new ideas for FME - and then encourage your FME friends and colleagues to vote up that idea.It's late in the development cycle, but still not inconceivable that you could post an idea that makes it into FME2017! RegardsMarkps - I've been fairly lenient so far in awarding this badge. But from now on you'll need to come up with something really unique - not functionality already on our radar or in the beta!

Hello FME-Experts!I have no experience with reading of html code, but I have problems reading data from a simple html file.If I use the HTML Table reader I get only the first record (witch contain the attribute name of the data) and not the 4 records that I need.I think, the workflow has to be simple but I tried several options without results.I attach an html example file.Thank you very much for the help!

When opening and trying to view qleader arrow types in FME from an AutoCAD file, the qleaders appears just as 2 straight lines, where as it should appear as a spline. Multileaders appear to work fine. The autocad_path_type is autocad_spline_leader See the attached dwg for an example. The 2 large straight lines on the right appear as proper spline leaders in AutoCAD. Is there any workaround to transformer these into the proper splines? I can't even see attributes carried through to be able to do this manually. Thanks in advance,Luke  

lat lon to geometry

I have attempted a few different techniques to get my desired output.1.) Reader->AttributeExposer->JSONTemplater2.) Reader->AttributeExposer->ListConcatenator->JSONTemplater3.) Reader->AttributeExposer->JSON Writer4.) Reader->AttributeExposer->ListKeyValuePairExtractor->5.) Reader->AttributeExposer->ListExploder->JSONTemplater6.) OthersI am working with values such as:objid | fme_attrib_info{}.field_name | fme_attrib_info{}.field_value |-------+--------------------------------------+--------------------------------------|1       | SERIAL_NUM                       |          12345                          |2       | TYPE                                     |          SOME_TYPE              |  My desired output would be as follows:{    "SERIAL_NUM": "123456",    "TYPE": "SOMETYPE}I've used the tutorial on site here for extracting attributes from CAD blocks. Now, I would like to take these attributes and make a json payload per unique block to be wri

Hi community,I have a very complex challenge. I have a csv with an unknown set of (dynamic) attributes. I was asked to rename the attributes so everything from the dot is removed. That is very easy I would say with the BulkAttributeRenamer (BAR), but then I found out I get duplicate attribute names and this is not allowed in the BAR. I asked what to do with these duplicates and they said I have to sum the attributevalues if there are duplicates. So for instance I have and attribute xxx17.1 and xxx17.2 the result must have an attribute xxx17 and the values have to be summed. This is no problem with a fixed schema, but I have a dynamic one and I have no idea how to do this. I have attached an example csv. All ideas are welcome.Thank you.  

Requires functionality in a CAD environment that allows anyone in the * .dwg or *.shp file layers to prioritize what can be common "Trim" the lines (TRIM function) according to the given priorities.

Hello all, Is it possible to add your own python functions to be callable from the Arithmetic/Text editors? I find I keep having to write multiple entries in an AttributeCreator to do things like find the smallest difference between two angles. ie. Situations where you need some state so you cant just use an expression. It would be nice if I could add a python function to a workspace that is then callable like the Math functions that are available in the Arithmetic editor.Let me know if this is not currently possible and I will add it to the ideas section.ThanksMichael Pascoecc: @deanhowell​, @luke.giles​ 

I know it's probably something simple, but I'm not seeing it. I thought perhaps inlineQuerier would help, but I am not versed with SQL. Essentially I want to do a "vlookup" from one file into the other based off the key field. thanks in advance!

Hello.I have calibrated route in file geodatabase (ArcGIS). I have line coordinate (kilometre) in the start and the end point. I try export this route with M-value to PostGIS in FME. But in result I have line without M-value. Do you know how it works?If i created MULTILINESTRING M in postgis directly sql it work. So metadata field geom support M-value PS GeometryExtractor have field with M-value