FME Form

This is more of a hypothetical question, I don't have a problem that needs solving, but am pondering the possibilities and limits of FME.What are the strategies to process huge datasets? I would imagine that there is a limit to the resource management that FME can do on its own? At some point the software might need some "help" in order to break down the data in manageable chunks? How is this done? Tiling? Memory management? Renting a super computer? Etc?Trying to think of an example I came up with the following idea. How would one go about generalizing the contour lines for a whole country in one run without watching life go by? Please note that I am not asking about how to generalize, my question is what strategies there are to speed up huge processing operations similar to the example above?

I tried to configure a http web-connector but without success. Does somebody know how to solve this?

I have multiple JPEG with corresponding location information in csv file. can anyone suggest me how to geotag those images?

Hi,We are looking to decrease the total time converting from Geotiff tiles to CADRG. The bulk of the time is in the CADRG writer. Are there any ways to process frames in parallel?If we divided the region into smaller regions and created multiple CADRG output sets simultaneously could we then merge them together?Are there any other parameters we could try settings to increase performance?Processing a 300x300 nautical mile region takes around 6 hours using a TC map type. Is that normal given the size of the input region and requested map type (resolution)?Thank you.

I have a workspace where I have lines that are clearly duplicated but the matcher does not identify them because the coordinates are flipped on one versus the other. Is there a way to identify duplicate geometries for lines regardless of whether the coordinates are flipped. For example: Line 1Coordinate 0 = 1973175.975504196, 1785187.3988771015Coordinate 1 = 1973164.445329631, 1784950.337012621 Line 2Coordinate 0 = 1973164.445329631, 1784950.337012621Coordinate 1 = 1973175.975504196, 1785187.3988771015 Both lines are identical, however the direction of one is different from the other. So how can I eliminate one of these based solely on geometry.

Hi, I seldom work with rasters so my question is basic, is the canonical way to convert MrSID to MBTiles to read pyramid level 0 from the SID, pass the image through WebMapTiler (with any zoom level filtering you need, or hands-free auto mode) then write to MBTiles with fanout expression @Value(_zoom_level) and feature type Somename_@Value_quadkey)? Thanks.

I have 8 bookmarks each are doing separate tasks. However, the 1st bookmark must be done before the others. And the 8th bookmark must be done last. How do I enforce this?

A tool in FME to remove duplicates,  I couldn’t figure out which tool can remove duplicates. For example, in case we have two lines that are identical (one on top of another), then which tools can remove this duplicate?  For example, in the screenshot below we have 4 lines that are identical, then how to remove three of them and to leave one?    Thank you  Best  Jamal

How can write a CityGML 3.0 file , what i need?

Hello, We run many hundred python scripts each night consisting of GIS, Exports, Reports etc. Reported to a single folder Logging Folder. Once finished we run a script to evaluate the Logs for Failure, Error/s, and other key words.The issue is we have been moving over the FME for many of our Exports, and we would like to evaluate thoughts logs as well. We have an Export folder with multiple folder projects, and each has a Log folder for the FME Workbench.Question is can / how can we copy the Log files from the Export logs to the Logging Folder for evaluation at the end of each workbench with the key phrase “Translation was SUCCESSFUL”?? Can we log to two locations at the same time??  How can / should we iterate the Export folder?? Mind you not all Exports run every night. Thx for any help.

Dear FME community,I have a question concerning the FME workspace runner. I have a workspace with 5 different inputs. The goal is to create geospatial PDFs. Each of the inputs represents a different layer of the geospatial PDF. Now I know that the workspace runner will import the inputs once at a time. The problem is now that in the 5 input-folders have each a different number of files. This means that at the end not every PDF will have the same number of layers. How can I guarantee that the workspace runner selects the right inputs? I have named the input files exactly the same, but they are in different folders. So it would probably be easy to just compare the base names.  I would be very happy, if somebody could help me with this. Thank you so much in advance! With kind regardsChristian

HelloI am having trouble extracting attributes from a kml for the features that have photos.I am using XQuery similar to this example https://community.safe.com/s/question/0D54Q0000848CTkSAM/extracting-information-from-different-folders-in-kml-to-convert-to-the-shapefile That method works for the features that don't have photos but the features that have photos seem to have a extra section in the HTML that is causing my XQuery to fail. The Xquery I am using is : declare default element namespace "http://www.w3.org/1999/xhtml";for $x in /html/body/table/tr/td/table/trreturn fme:set-attribute($x/td[1]/text(),$x/td[2]/text()) I am pretty sure I just need to modify the Xquery 

Hi. Create a pyramid. Easy.How I could extract only the most dense level without processing all others levels?

Hi, I have a workbench that references a ESRI GIS Connection File on my local shared network (\\gis\FME\admin@sde@sde_spatial.sde), the workbench runs fine with this as my Connection File parameter. I now want to publish this new workbench project to my FME Server, and I know I already have uploaded the SDE Connection File to the resources section, and I have found the link to be - $(FME_SHAREDRESOURCE_SYSTEM)/Connection Files/admin@sde@sde_spatial.sdeEach time I try to publish, the software wants me to upload a copy of my SDE file, but I would love to tell FME to use the one already published.  I have tried to simply plug in the server reference in my FME Desktop Workbench but when I test it on my local machine it keeps wigging out with:2021-11-14 23:36:16|   4.1|  0.1|ERROR |An error occurred while attempting to retrieve the connection parameters from the connection file '/Connection Files/admin@sde@sde_spatial.sde'2021-11-14 23:36:16|   4.1|  0.0|ERROR |A fatal error has occurred. C

What tools are replacing the jackson library with fme? (for creating database relation automaticly xml to tables)

The features are a subset of US Census tracts, and a handful of them have multi-part geometries that do not share a boundary. My goal is to treat these multi-part geometries as a single unit based on the unique ID (FIPS code) for each tract.

Hi,The problem I'm trying to solve is as follows:I have about 2,000 aerial imagery ECW files, averaging in size around 30MB (so around 60GB in total).Each of the files cover 1km x 1km on the ground at a resolution of 10cm, so are 10,000px x 10,000px.I have been asked to downsample each file to 2,048px x 2,048px and output the results as a series of 4km x 4km tiles (each tile being 8,192px x 8,192px).I have an index feature class that lists each 'FileName' and its corresponding 'Tile' attribute.I've attached an image that shows this spatially, below.Large black squares and number labels represent the tiles that I want to output. The coloured squares with red outlines represent the original files.Previously, when working with a much smaller amount of data, I've been able to use my index feature class, in conjunction with a StringConcatenater, to provide the full path of each file to an 'ER Mapper ECW' FeatureReader.From there, I used RasterResampler an

FME Desktop 2020: How to map excel table using “schema mapper”? I couldn’t figure out how to link the attribute table of a layer with an excel table. In the screenshot below, I wanted to link the attribute layer with an excel table based on the autocad_color and ColorNo fields in order to get the “type” field values transferred to the layer. How could be performed? The data is attached             

FME 2020: How to filter dwg file based on hatches and Areas (polylines)? I couldn’t figure out how to filter dwg file based on hatches and Areas (polylines).   

FME 2020: How to filter dwg file based on lines and polylines? I couldn’t figure out how to filter dwg file based on lines and polylines 

Have two workspaces that when I run it under my account or the service account on the server, it runs fine, published to FME Server and set up automation. It APPEARS to run (one workspace checks for the latest zip file in a directory on a file share and then copies to the resources directory and unzips on the server - this works as it should under both accounts and in FME server when run separately thru Run Workspace). The second workspace is to process the data that was unzipped and place in the resources directory - the files are separated into two directories due to how the vendor supplies the data for download - the script will read this data via either account. It will operate as expected when run with Workbench. Running via Server it processes, but when I look at the output data, not all of it is there! The csv files appear to be appending to the tables in the SDE. The graphic data doesn't even show that it attempted to write to the feature class. I'm stumped. The graph

12d has the ability to close polygon without making the last vertex sit on top of the first vertex. ( ie a square\\rectangular polygon has 4 vertices and 3 segments)When the last segment of this closed polygon has a radius, a 12dxml file when viewed in data inspector or workbench, does not show the last segment as curved. When compared against a polygon that the last vertex sits on the first vertex (ie 5 vertices, 4 segment polygon) then FME displays correctly. When I look at the properties of both strings in inspector, the two different properties are No. of vertices which is 5 and the field under IFME Polygon called Linear Boundary is yes for the scenario of not displaying the curve on the last segment. For the polygon that does display correctly, these two fields are 10 and No. Would appreciate anyone with any 12d knowledge to assist or what the linear Boundary field meansNote uploader wont accept 12dxml file format so you will need to rename the attached to polygons.12dxml to vie

Hi everyone, I'm currently trying to received form data via HTTP POST. There is a very good article on it which I follow every step (https://community.safe.com/s/article/send-source-data-to-fme-server-with-http-post). The connection between postman and FME server is working fine, but it look like I'm not receiving any data.  I've made a test workbench (PS) to see if my writer would received the form data, but the writer is empty as if my reader is not downloading the Data. When i published the workbench, the parameter "Send HTTP Message Body to Reader" is set to my current reader.  I have put the form data in the body section. Do I need to write it elsewhere?

Hi, I'm a bit stuck and would need some help.As you can see 2 point layers as shown in the image with different colors. All the points have same name 'iris' though their ids are different. I need to match the closest same name but the ids shouldnt repeat.For example: here in the below case iris id 11 and id 12 have iris id 2 as their closest. But what I'm wanting as the output is that if iris id 12 gets closest match as iris id 2 then for iris id 11 it should not consider iris id 1 and check for next point which hasnt got a match with any other point yet i.e. iris id 1.Let me know if there is any possible solutions for it.Thank you.

table 1table 2 Expected result is : table 3:actgeneric_id------- fNotam_id1.2.1.1.3.1 ---------- 1.2.1.1.31.2.1.1.3.5.1----------1.2.1.1.31.2.1.1.3.5.2----------1.2.1.1.3 .... .... ..... .....1.2.1.1.4.1------------1.2.1.1.41.2.1.1.4.2------------1.2.1.1.4............