Creating and organizing workspaces. How to use Workbench.
Recently active
Hi,I created a FME workspace in which I connect to a web service published on AGOL. The service consists of a point feature layer (inventory layer) and a linked table (inspection table), used with the Field Maps application to perform regular inspections. The main objectives are among others:Extract the weekly inspection results in Excel formatArchive inspection data as an existing file Geodatabase, but keeping only inspection table results for all subsequent inspectionsThen truncate the inspection table in AGOL.The first goal has been successfully achieved, unfortunately I am struggling to complete the next steps of copying the data from the inspection table to the File Geodatabase and then truncating the results from the inspection table after the execution of the first step.Could someone show me how to implement the steps to copy data from inspection table to file geodatabase and delete data from table in AGOL?Thank you for your help!Regards,
Attribute Splitter and List Exploder? or is there a better way?
I have a 2016 workspace that I'm upgrading to 2021.2.5. The basic workflow is SQLExecutor -> GeometryReplacer -> Clipper with an AOI -> FileGDB.What comes out of the DB is the geodb_type which helps to determine features get routed either the polyline or annotation feature class. GeometryReplacer is used to convert from WKT so that features can be clipped with the AOI. From SQLExecutor, geodb_type has values (geodb_polyline, geodb_arc, geodb_annotation), but when it comes out of GeometryReplacer, geodb_type values are all missing. So after clipping, everything gets routed to the polyline fc, which will produce this error: "Cannot write a non-linear feature to a polyline feature class." [geometryreplacer_geodb_type.png] My workaround is to use GeometryFilter to route the features + a new AttributeCreator to hard-code geodb_type values to ensure the right features are created in FileGDB, rather than rely on geodb_type values. [geometryfilter.png] I've tried to
I have a list of codes (over 100) in a CSV and want to use a test for each code in a TestFilter. Is there a way to load them all at the same time rather than cutting and pasting individually?
I have a workbench to process some raster imagery, each image is stand alone in the processing done, so a clear candidate for parallel processing. The workbench now looks likeI've set the group by to the image name (all unique), and run in both modes with the following outcomes:'Process when group changes (Advanced)' - Task Manager shows only only a single FME instance processing, act as blocking, processing all files before it begins writing results. 'Process at End (Blocking)' - Task Manager shows multiple FME instances launched, but only one is doing any work, acts as blocking, processing all files before it begins writing results. Both paths are giving correct results, I have removed any 'group by' within the custom transformer, I'm trying to understand what is going wrong in running in parallel. Thanks!
Is there a way to truncate a list? For example if I have a list of 30 items but only want the first 10 to be kept. I know I could manually create the list with an attribute creator using _list{0}, _list{1}, _list{2}, etc but just wanted to see if there is a transform or more automated way to do something like this. Regards Dean
I've been able to upload files to the root and to an existing path, I'm wondering if FTPCaller while uploading can create a new file path (directory)?sftp://server.com/newpath/file.txt (newpath does not exist on sftp server)ftp://server.com/newdir/file
I have a bunch of statistics that I want to add to a HTML report similar to the image below. Not all columns have the same number of rows nor is each column / row related across the table. So was thinking that if I could create a table and each cell contain a list or similar. Any suggestions would be very much appreciated Thanks Dean
Hi, Is it possible to make a Intersection and set that, work just if the two, or three pologon contains other by 90%. Thanks
I have set up a workspace which reads in an Excel Spreadsheet whose attributes may change everytime that the workspace is run. As this workspace is part of a larger chain of workspaces I would like to be able to run it without having to reload the reader to ensure that the latest attributes and features are being brought through each time.I have tried setting the 'Scan Schema in Dynamic Workflow' parameter, but with no success. Is there something I am missing?
I've successfully made an S3 Web Connection and can write a file to a specific S3 bucket. I'm not seeing how to send the a file to a specific folder within the bucket using the S3Connector transformer settings. See attached screenshot. I have the Request Action set to "Upload." There are input fields for Bucket and Path. I want to upload a file to my bucket "testBucket" and place the file in a subfolder named "Files" that's in a project specific folder named "$(projectName)." In S3 that's testBucket > $(projectName) folder > Files folder > file.png As it is, the Bucket input has to match the S3 bucket name you are uploading to, but it also creates a new folder with your bucket name, and the Path input creates a subfolder within that bucket. In S3 that's testBucket > testBucket folder > $(projectName) folder > file.png. Any suggestions on how to target testBucket > $(projectName) folder > Files folder
Is it possible to use one a basemap with the MapnikRasterizer similar to the way you can use it in the HTMLReportGenerator
I'd like to learn how to extract end nodes (as opposed to nodes at intersections) from a list of nodes coming out of the TopologyBuilder. I'm only putting in a few alignments that intersect in the TopologyBuilder. I've seen some similar questions here but there wasn't enough detail in the answers for me to catch on. An example workflow or screenshot would be great.
Hello all, I am trying to create a report header that is an image (left justified), some text (Centre Justified) and another image (right justified) but can seem to figure it out. The images remain constant but the text will change as I want to create a "map book" series based on an attribute. My guess is that I need to add it as CSS but just need some direction as that is not my forte 🙂 Cheers Dean
I would like to try and create a map series using HTMLReportGenerator that will contain a map and a table where the user can select a feature in the table and the map zooms to the selected feature (or a new map is displayed) with the relevant information. Is this possible?
Hello, I have a satellite raster in GeoTIFF format and am trying to generate a grey8 image for selected RGB colours. Similar to what is in the attached image. Above is the RGB satellite image and below is a grey8 image for the selected RGB values with a "falloff" or "threshold value" similar to the photoshop selection filter. I tried RasterExpressionEvaluator and the examples to give me some ideas but I'm not able to make it do what I want. This video shows the exact output I am trying to achieve - https://www.youtube.com/watch?v=Ha3HdYBzU_Q Ideally, I would like to split an RGB image into "n" most common colours using a "falloff" value, and export them as a greyscale "mask". Then I would import them as a blended texture in unreal engine. Appreciate any help!/Sanjay
Hello,I wonder if anyone has experience in both FME and Pentaho. I have several years experience in FME, but know nothing about Pentaho.Currently our team of Pentaho users considers the switch to FME. I have shown the possibilities and when it comes to functionality, FME seems very promising! However, Pentaho seems to be 6 times faster than FME... This might be a showstopper and we want to know whats is causing this. Does anyone have experience to get better performance writing to (or reading from) Oracle datasets? I never had the experience that FME is slow in reading/writing to Oracle, but when I see the speed of Pentaho, I was surprised of its speed.We did a test of a ETL-script that reads about 912.000 records from an Oracle Database and writes the result directly to another Oracle table. In short: SQLCreator (type Oracle) --> FeatureWriter (type Oracle). Duration in FME: 5 - 6 minutes; duration in Pentaho is about 45 seconds. We were reading and writing to the very same databas
I'm trying to format a human readable date time and I want to include the seconds but nano seconds are a bit much. As far as I can tell there is no date time flag which is just seconds without the fractional seconds so it seems like you need to remove them with a non-datetime tool. Am I missing something? Date times were created using the DateTimeNow function.
Hi, I am using a pythoncaller in FME to convert the KML color from the linestyle (a string, hex ABGR) to a C# Color (ARGB 32 bits integer) (see workbench) KML doc Colorstyle (https://developers.google.com/kml/documentation/kmlreference#colorstyle): For example, if you want to apply a blue color with 50 percent opacity to an overlay, you would specify the following: <color>7fff0000</color>, where alpha=0x7f, blue=0xff, green=0x00, and red=0x00. (ABGR !) With FME Desktop under Windows (2021.2.4), this works well. => 2022-03-29 18:00:28| 0.6| 0.0|INFORM|Attribute(32 bit integer) : `line_color' has value `-16733441' Running this workbench on the Linux FME server (docker install!) gives different results. => 2022-03-29 16:01:14| 0.2| 0.0|INFORM|Attribute(64 bit integer) : `line_color' has value `4278233855' I have some questions here: 1) Why does this happen?2) How do I solve this?3) Is there a more elegant and consistent way to accomplish
fme_dataset and fme_basename attributes are there when read normally, but not when read with a FeatureReader.
I am trying to read metadata in FGDC format from a feature class using a python script and workspace runner to call in a workbench. I want to know how I can set a parameter to call a feature class from a geodatabase.
How can I reference the CSV created from a Writer to upload to AWS S3 using S3Connector? I can successfully use a Reader to reference a file on my computer and upload to AWS S3 using my Web Connection and S3Connector, but I don't know how to reference a newly created file within my worflow. See attached.
Hi,For some time, I used the following approach to open a KML dataset (both in Desktop for development, and in Server for operational use, version 2020.1.0.1, both running on Windows (server) OS): Create a public parameter "INPUT_FOLDER"Create a public parameter "INPUT_FILE"Add a KML Reader for a specific KMl file to the workbench, which defaults to a public parameter "SourceDataset_OGCKML"Make this a private parameter, and change the definition to: "$(INPUT_FOLDER)\$(INPUT_FILE)" I then use either UNC or local paths in the INPUT_FOLDER to point the reader to the correct location. Last week, we started migrating to 2021.2.4, which I installed on my workstation (windows). For the sake of completeness I think I should mention we are targeting an FME server running in a docker container on a linux host. This approach stopped working, with the message :2022-03-19 14:58:52| 0.8| 0.0|INFORM|Loaded module 'OGCKML' from file 'C:\Program Files\FME\2020.1.0.1\plugins/KML21.dll'2022-03-19 14:5
I have a set of points (>100) and I want to calculate a cost raster along a network fpor each point. For 1 point I can do this by:point > netyworkcostcalculator>surfacemodeller. However when I use multiple points the networkcostcalculator only outputs disconnected features (also when using 'group by' point ID). But even if it would have an output, the output does not contain an pointID attribute, so I can not use the group by option in the surface modeller. Is there an easy way to calculate a cost raster for more then 1 point?
Is there a DotNET sample to develop a custom Factory ?