Transformers

HiI am having trouble speeding up the ShortestPathFinder. The input is about 7 million from-to-lines and I was hoping to speed up the calculations by setting the "Parallel Processing" to medium on my 8 core system. According to https://docs.safe.com/fme/2019.0/html/FME_Desktop_Documentation/FME_Transformers/parallel_processing/parallel_processing.htm , that shoud render the exact number of cores. Still, I don´t notice any speed improvements and the Windows task manager reports about 6% CPU load. At

I am finding that ShortestPathFinder in FME Desktop 2019.1.0 gets exponentially slower as I increase the number of "From-To" lines, whereas I would expect it to get linearly slower (i.e. twice as many From-To lines, twice the time) as each path calculation should be independent. Can someone explain why this would be and how I can avoid it?To give some context, I am running ShortestPathFinder over a (road) network with simple 2-point "From-To" lines whose vertices have already been snapped to the (road) network. There are (up to) 120,000 from-to lines, with a network of 280,000 edges (as output by a LineOnLineOverlayer to split all lines at intersections). For ShortestPathFinder I am using default settings, other than turning off snapping (reducing iterations from 10000 to 1000 made little difference). [Strangely, setting "Re-order From-To Line" to "No" hides all the other optimization settings - a bug?]The final output results are all exactly as I would expect, but it

I have tried using VectorOnRasterOverlayer, Clipper, RasterBandNodataRemover and RasterClipOverlay...all being fed to an ECW Writer. And even though the results are all different, no method is giving me a clipped (i.e. no black or white boundary) ECW version of our orthophtoto: To me my method appears to be logical, but I'm obviously missing something.  RasterInterpretationCoercer parameters: RasterClipOverlay parameters: Clip polygon parameters: 

I'm successfully using the ImageRasterizer transformer to create images of extracted parts of a 3D model. The result is a png with a "wired optic" (see attachment). Is it possible to fill the empty spaces with color in order to get a continuous, solid colored surface? Without having any empty spaces like I'm achieving now? Many thanks for your help 😃 Regards,vill

I am using Kafka connector in Batch mode to read and process 10000 messages in a given batch execution. I want to make sure Kafka connector commits offset for 10000 messages. In case of any failure in the job, and If I restart the job (Using EARLIER option), I want Kafka connector to read messages from next offset of last successful batch run. Please advise.

Hello there, Im using the Shortest path finder transformer to analyse best routes from A 's to B's where the network is a road system. There is however a bit of flexibility in my project where the route could sometimes go "offroad" to skip going long detours. So i used my MS Paint superskills to explain what I mean.  Lets say that the black lines in the road system (network) and the yellow line represent the best result from ShortestPathFinder for getting from A to B. But it needs to take that tedious detour to west and then east again and i would want to allow it to take the green dotted detour instead (marked X), even if there is no road present there.  Pretty sure that the ShortestPathFinder does not have that option so I was wondering if anyone here has a suggestion how to solve this? And then in a way that you can s

I have a folder containing a number of esri lyr files which are used to render data in ArcMap, I would like to return the name of the Esri Featureclass from the lyr file, I have attempted to do this by using both the Esri ArcGIS Layer reader and the Schema Reader and attempted to expose the ARCGIS_LAYER_DATASET using the "AttributeExposer" but it only returns <missing> .Any assistance with this is greatly appreciated. Many thanks

Hi,Which combination of FME transformers would I need to use for splitting an irregular polygon into convex partitions (and possibly also minimizing the number of resulting parts). The following figure illustrates what I am trying to obtain:I have come up with an approach based on the Triangulator which can be described as follows:Sorting all interior lines from the triangulation by decreasing lengthConsider the first occurrenceIdentify the 2 adjacent polygonsDissolve those 2 polygonsCheck convexity of resultIf convex, keep resultIf concave, discard resultThe process should for instance escape the loop when all interior lines have been consideredI created an FME workspace which does this.The initial figure:would become like this after triangul

Hi, I've created a workspace that reads multiple dwg-files, goes through some cookie cutting and outputs the results to a pdf. The cookie cutter is dependant on a variable. I've managed to setup a second workspace that runs the above for each feature in a dataset. It all works. The problem is that the dwg-files are beeing read every time which takes some time. So my question is, is there a way to read the dwg-files in the second workspace and just pass them through the workspacerunner? Tried for some time now and can't figure it out. Thankful for any advice!

Hi All,  I'm looking for some ideas on how to get the z value from a point cloud onto a point in porformant way. As far as I can tell there is no easy way to do it. Am i missing something? Options I can see available:  Convert to Raster with RasterDEMGenerator and use PointOnRasterValueExtractor - pretty cpu and memory intensive Convert to points and use NeighborFinder - pretty cpu and memory intensive Has anyone got this process figured out?    

I've seen similar questions asked here but cannot find real solutions. So here's what I'm trying to do..I would like to get information from this page as an example: https://help.autodesk.com/view/CONNECT/ENU/?guid=GUID-03D59AAD-65B0-45E3-84F2-A12AAA5BB267.If you look at the page source, you'll see there isn't much valuable info. here and it seems to be using javascript to serve up the page (which updates when a new version is released, maintaining the original URL). If I use an HTTP caller with a GET method, I get the same page source. However I'm interested in the text you see in the loaded page. There are lots of sites out there built this way nowadays, which work in a very similar, dynamic way.Is there a solution to get data from this kind of page? The only plausible (and costly) way would be to use some service su

Hi,I am trying to delete files using system cleanup but no file is being deleted. I am using FME Server 2016. Any pointers would be much appreciated.Thanks.

Hey folks,Just wanted to alert you all to a new custom badge: the Inventor.This badge is awarded to any user who posts an idea that makes it to "In Beta" or "Released" (Completed) status. I've been through the existing ideas list and the badge has been awarded to the following users:If you too want to earn this badge - which is a bit more prestigious than "Pirate Chief" - then get posting new ideas for FME - and then encourage your FME friends and colleagues to vote up that idea.It's late in the development

Hello FME-Experts!I have no experience with reading of html code, but I have problems reading data from a simple html file.If I use the HTML Table reader I get only the first record (witch contain the attribute name of the data) and not the 4 records that I need.I think, the workflow has to be simple but I tried several options without results.I attach an html example file.Thank you very much for the help!

When opening and trying to view qleader arrow types in FME from an AutoCAD file, the qleaders appears just as 2 straight lines, where as it should appear as a spline. Multileaders appear to work fine. The autocad_path_type is autocad_spline_leader See the attached dwg for an example. The 2 large straight lines on the right appear as proper spline leaders in AutoCAD. Is there any workaround to transformer these into the proper splines? I can't even see attributes carried through to be able to do this manually. Thanks in advance,Luke  

lat lon to geometry

I have attempted a few different techniques to get my desired output.1.) Reader->AttributeExposer->JSONTemplater2.) Reader->AttributeExposer->ListConcatenator->JSONTemplater3.) Reader->AttributeExposer->JSON Writer4.) Reader->AttributeExposer->ListKeyValuePairExtractor->5.) Reader->AttributeExposer->ListExploder->JSONTemplater6.) OthersI am working with values such as:objid | fme_attrib_info{}.field_name | fme_attrib_info{}.field_value |-------+--------------------------------------+--------------------------------------|1       | SERIAL_NUM                       |          12345                          |2       | TYPE                                     |          SOME_TYPE              |  My desired output would be as follows:{    "SERIAL_NUM": "123456",    "TYPE": "SOMETYPE}I've used the t

Hi community,I have a very complex challenge. I have a csv with an unknown set of (dynamic) attributes. I was asked to rename the attributes so everything from the dot is removed. That is very easy I would say with the BulkAttributeRenamer (BAR), but then I found out I get duplicate attribute names and this is not allowed in the BAR. I asked what to do with these duplicates and they said I have to sum the attributevalues if there are duplicates. So for instance I have and attribute xxx17.1 and xxx17.2 the result must have an attribute xxx17 and the values have to be summed. This is no problem with a fixed schema, but I have a dynamic one and I have no idea how to do this. I have attached an example csv. All ideas are welcome.Thank you.  

Requires functionality in a CAD environment that allows anyone in the * .dwg or *.shp file layers to prioritize what can be common "Trim" the lines (TRIM function) according to the given priorities.

Hello all, Is it possible to add your own python functions to be callable from the Arithmetic/Text editors? I find I keep having to write multiple entries in an AttributeCreator to do things like find the smallest difference between two angles. ie. Situations where you need some state so you cant just use an expression. It would be nice if I could add a python function to a workspace that is then callable like the Math functions that are available in the Arithmetic editor.Let me know if this is not currently possible and I will add it to the ideas section.ThanksMichael Pascoecc: @deanhowell​, @luke.giles​ 

I know it's probably something simple, but I'm not seeing it. I thought perhaps inlineQuerier would help, but I am not versed with SQL. Essentially I want to do a "vlookup" from one file into the other based off the key field. thanks in advance!

Hello.I have calibrated route in file geodatabase (ArcGIS). I have line coordinate (kilometre) in the start and the end point. I try export this route with M-value to PostGIS in FME. But in result I have line without M-value. Do you know how it works?If i created MULTILINESTRING M in postgis directly sql it work. So metadata field geom support M-value PS GeometryExtractor have field with M-value

I am looking to merge into a list selected attributes from nearby points and output a single feature for each group of nearby points. PointOnPointOverlayer perfectly finds the nearby points and generates the list I want, but outputs all the input features with a list of all the other features. Thus for say 4 nearby features it will output 4 features each with a list which identifies the other 3 features in the group, but without anything like a group ID with which you could select just the first in each group with a DuplicateFilter.This is almost exactly the example given in the PointOnPointOverlayer manual page which creates lists of crimes at common locations... but doesn't explain how to not have multiple copies of the same list at the same location. Am I missing something obvious? It seems that PointOnPointOverlayer has done all the hard work!The closest I could get to generating a group ID is to give all my input points a unique ID field, then set "Merge

Hello all, I need some help performing a spatial operation. What I haveA set of coordinates (sample enclosed) What I wantRemove / dissolve coordinate pairs if the are within 2 km radius of each other so that only coordinate pairs remain that have no overlap. What I've triedA Bufferer transformer with a radius of 2km connected to a PointOnAreaOverlayer.The result is a bunch of overlaps but I don't know how to further process these.  Cheers,Eduard

Hello,I am a researcher from Slovenia. I'm having huge trouble working with Slovenian datasets, as they are in EPSG:3912 or EPSG:3794. These two systems are not supported by FME. I solved this for shapefiles by using ESRIReprojector. But it does not seem to work with las datasets. I am trying to extrude footprints using LIDAR data and convert that to KML, which needs WGS84 data.Is there a sollution? I am quite surprised that FME does not support all EPSG projections.I even tried to add custom coordinate system and was not successful.Regards!Jernej