Creating and organizing workspaces. How to use Workbench.
Recently active
What is the transformer that can be used to identify dangling or hanging links in any given dataset?
I am looking for a shortcut (transformer?) that will change attributes' type and width all at once. Holding down shift can select all the rows of attributes, but then the change made is not applied to all the rows selected. For exmaple, in the below picture, I want to change all "char" to "number", and the width from 200 to 20 .
Hi There, I have a road network polyline data with some dangle roads. I need to remove all the dangles using looping in FME. But the master catch comes here...I do not need to give the number of iterations myself. All the roads, having a free node should be looped out of the network spatially giving output of the present loop to the input of the next one regardless of the nnumber of loops. Attached Image can help better to understand more. Please revert if i am not able to communicate properly. Thanks and regards.
Hi, I’m running a workspace runner in server which is queuing a large number of DWG files. For each of the DWG’s, the child workspace is writing a large amount of information to a SQLITE3 file. The write fails about 60% of the time because the SQLITE3 file is locked. If I run this against individual file(s) using the child wokspace the SQLITE3 file is populates as expected. Is it possible that the information is being pushed faster than the SQLITE3 file can write it; I’ve seen this behavior with numerous other writers, (CSV, SPATIALITE, and XLS) as well. I have worked with the Transaction interval param but this has not helped. Is it possible to add a pause at the end of the workspace to give the writer enough time to commit the inserts? I’ve tried SystemCaller using a TIMEOUT or SLEEP command to no avail. I’ve tried SystemCaller calling a BAT file with a DIR command to keep is busy but it appears the SystemCaller is being run before the writer workflow. Any ideas would be app
I am currently working with VPF data (the worldwide Digital Navigation Chart databases from NGA) and I'm having trouble with a few of the 29 databases. I need to convert them to another format, and I'm using the VPF_DB reader to read the DHT file, and then a Feature Reader. Most of the databases go through the workspace with no problem, but three of the databases give the following error: "Missing or badly formatted column value descriptor table name for column 0 of VPF table" Older versions of these three databases (from around 2013) do not give this error, but when patching them up to the newest version, or when I recieved the newest full version directly from NGA, FME does not accept them. The VPF format seems very complex and I don't really have the know-how to dive into the files themselves and understand what's going on. Does anyone have an idea of what could be wrong?
I'm using the socrata writer in FME 2014 to take data from my Oracle data warehouse and post to Socrata open data set. It is a current limitation of my workplace that I cannot use FME 2015 as there is no 2015 Server available (and I don't want to design a solution where I have to run this from my desktop). I currently have a functional workspace, but I seem to be hitting an error based on the volume of data I'm trying to write to socrata. If I upload only 1 year worth of data at a time (about 50k rows), everything works fine. Once I try over 150k, I start running into problems and I have about 1.6 million rows total. I was wondering if there's a way for me to use FME to loop my writer and write only one year at a time. The first year would need to replace the existing dataset, then I would append data for all the remaining years, and publish the dataset with the last pass. I'm very noobish when it comes to FME, and am learning as I go. Does anyone have a d
I have a polygon feature class where each polygon has one of two attributes, "Admin" or "Active". These polygons are related spatially in a daisy-chain manner. That is, any Admin polygon overlapping an Active polygon will be grouped with that Active polygon into a larger "Active" site (ultimately dissolved into individual polygons), and any Admin polygon that then overlaps that newly created larger Active area is then also included in that Active site, until there are no more Admin polygonsoverlapping the large Active area. I am using Neighbor Finder to select the polygon that are overlapping, with the Active polygons as the Candidates and the Admin polygons as the Base. The trick is that once I get the first set of Admin polygons selected, I need to then use those to select more Admin polygons that overlap the Admin polygons selected in the first step. I have done this manually in ArcMap and it should take 5 steps to get all the polygons that are relat
Hello! I'm developing a web application that sends requests to an FME server to run some pre-defined workspaces. I'm passing in some parameters (including geometries as GeoJSON) as published Parameters, and I am using the rest API endpoint /fmerest/v2/transformations/commands/submit/REPOSITORY/WORKSPACE This seems to work fine, I get a job ID back and the logs tells me that the job has run. However, and here lies the problem: As these jobs can be long-running and I don't want the hassle of polling FME server from my web app I would like FME server to send the result as an email to an email-address specified when the job is submitted (IE: not hard-coded in FME server) After some googling and chats with our FME experts it seems like this should be possible using the JobSubmitter service (http://docs.safe.com/fme/2014/html/FME_Server_Documentation/Default.htm#web_services/job_submitter_service.htm) and setting the opt_requesteremail property. However: to my understand
Hi there, I have a REALLY badly formatted CSV file which is generated automatically by the software - the output can't be altered. The data shows calls to a service centre. Unfortunately, instead of adding the call handlers name to a column for their calls, its added as a row before. There's then an emoty row before the details for the next handler. I need to take this call handler name and add it to a column for their data only (ie before the next empty row). Any ideas on how to do this? This is my first step into the world of FME so I'm have in a baptism of fire... Kind Regards, Ned
Hi there, I need some assistance figuring out how to email the results of my workspace which is published to FME Cloud. The workspace runs when a new email is received to a gmail account, from the usgs earthquake feed. The receive_email publication checks the account and when a new email is there, the workspace runs, (this ensures there is data available to download), it downloads earthquake data and overlays with ZIPCodes to produce an excel file saved to FME Cloud resources folder. This all works fine, but I'm having issues with the final part, sending an email with the excel file embedded. I created a SEND_EMAIL topic and a subscription, should I also have an FME Server Email Generator transformer in the workspace or how can I attach the output to the email I want to send? I did the tutorial to send an attachment but it actually sends a link not the file itself.
Wondering if the Linux-version supports parallel processing. I am running some bufferings and dissolves on a national level and there should be room for parallel processing on these jobs. Using htop it seems like the processing is restricted to one core: I have tried setting the dissolvers parallel processing level to extreme, but the job has no signifcant speed increase. I am using Edition: FME Desktop Microsoft SQL Server Edition (floating) Version: FME(R) 2015.1.2.0 (20150911 - Build 15538 - linux-x64)
Hello, This is a simple use of the spatial realtor but I can't figure out how to expose the related attributes. I have a set of overlapping polygons, differentiated by an attribute (Type 1- 5). I have a point file. For each point in the file I want to calculate 5 attributes (Type 1- 5), indicating whether or not that point fell within the polygon type. I thought the spatial relator wiith a groupby "Type" would create a list for each point indicating if it were related to each of the 5 types, accessible through the "_relationship{indexValue}". With the indexvalue being the order of polygon types based on the order the grouby was processed. Can some explain how to properly use this transformer and access the results? Thanks, Desired final product: Point, Type1, Type2, Type3, Type4, Type5 1 , YES , NO , YES , YES , NO etc
Is there a way to specify the sheet name when you open an Excel spreadsheet using the FMEUniversalReader in Python code? I am assuming that there is a parameter that you can add to the open() method, but I have looked at the documentation for the open() method and the parameters are not described. Thanks
Hi, is it possible to create dynamic parameters for a FME reader? I am writing a FME reader and it would be great if you guys can give my some advice implementing the following idea. The reader parameters include some server information. Once the user enters this information, a connection is established to the server (as background job) and a list of layers (of a CityGML scene/file stored on the server) is given back from the server. This list appears in some way in the reader parameter window and the user can select multiple layers. All this should happened before the parameter window is closed. How can I do that? If this is not possible: Can a run a (python) script before the user clicks the parameter button (inside the "Add reader" window)? Then, I could use the script to fetch the layer list from the server (using hard-coded server information) and provide the layer list as static information once the parameter window appears. Again, how can I do that? Thanks for your
Hi, I'm interested if inspector has some impact on conversion time? If I have many inspectors in testing and debugging process, how does this affects time needed for conversion to be done? Thanks!
Is there a way to send multiple emails in the "Email to" box of the subscription? I tried the format that Outlook uses, that is, each email is separated by a semi-colon: email1@email.com;email2@email.com;email3@email.com However, no emails get sent. Thanks
Hi all, I have the data in a table similar to that: I have been asked to create something like the table below: Basically, I am grouping by Site, Name, Feature, Subfeature, then counting Y or N for each group, concatenating the years and summing the count. Does anyone know how to do this? By only using the aggregator I get something like that but it is not exactly but I need: Any ideas how can I get Count_Dead_N and Count_Dead_Y. Thanks!
On FME Server we keep getting this type of warning when the workspace makes a connection tothe DB and looks like right before the select statement happens. Oracle Reader: Column 'DEVICEID' specified on Feature Type but does not exist in table 'S5FFFFF.XXXXXXX_XXXXX_INFO_V' and will be ignored The view is being read and it does this for each column in the view. FME workspace does read the view and processes the data. Any insight on how to make the warning go away would be great.
Hi, I was wondering if there is a way to make FME use more CPU? I have workflow with GML Reader and Multiple SQL Server Non-Spatial Writers. Multiple writers are there because I need to insert into identity columns in four different tables parts of transformed GML data. Here FME is reading GML and writing it into SQL Server by using 10-13% of CPU. How can I make it use e.g. 70-80%? Memory occupied bu FME is also 500-700MB. How does this work?
I have a series of overlapping polygons and overlapping las files. Each las file belongs to a unique region that corresponds with a polygon. I would like to clip each las file to the extents of the associated polygon. The polygons contain a unique ID identifying the region while the las files are organized in individual folders identifying the region. To date I have been running the clipping tranformer on each set of las files belonging to one particular region and manually iterating through all the regions one at a time. How would I go about batching this process? Ideally I would like to read the unique ID in the clipping polygon and use that to point to the associated set of clippee las files in a folder.
I have a network of lines which I want to convert into a polygon region showing the extent of all the lines. Effectively a bounding polygon. Does anyone know if it is possible and if so how? Many thanks Seb
Hello, would anyone have an idea how to reconstruct an original elevation model if only slope-grid and aspect-grid are available? I am looking for a smarter way than this tideous: 1. split the overall aspect to x and y aspect 2. calculate the subsequent x and y slope 3. make an iterative sum over the rows, thus reaching the z values 4. cross-check / average with the same method over the columns 5. calibrate an z-offset at known point 6. make a grid
Hi, I have 15-20 feature types that have values of the same type and they can be repetitive (e.g. FeatureType1: 1, 2, 3, 5, 4; FeatureType2: 1, 6, 8, 3, 5 and so on). These features are tables from SQL Server with relationships (because of that there are repeating values). I need to change all values of certain (different) attributes in all features to some other set (number sequence that starts from specific number). So, all primary and foreign keys from ex tables need to be mapped to some range. Confusing, I know, but I will try with example too. Some example of data: Parcel1: oid=224 Parcel2: oid=266 Parcel3: oid=214 Building1: oid=844, parcel=224 Building2: oid=415, parcel=266 Building3: oid=332, parcel=214 Building4: oid=711, parcel=214 Here I need to get parcel oids (e.g.) 21-23, building oids 24-27 and building parcels 21-23, respective to original attributes. New values could start from any number (set as parameter) and there must not be any skippings. It doesn't need to
Hello everybody ! I think the transformer pointconnector don't work normal. I try to connect point from 2 tables which have the same fid. But the transformer can't accept this and there is no error visible on log. i tried a sorter to classifiy fid in the same order befor transformer but no way. Also i tried to make same type and same encoding (utf-8) of fid in both table but no way too. I checked the correspondance of fid and nothing wrong. Thanks for Help.
Hi, This might be a quite simple querry, but I am sure not sure about the solution. When a Wb is made on v2014, some of the connectors are not visible when we see it in the v2015. This creates a lot of confusions and dilemas when batch or workspace runner is used and we don't need to overview each and every Wb. Is there any possible way by which we can check the version in which the Wb is made. -Shivam