Skip to main content

- - Community Resources
Ideas
Product Updates
Events
Blog

EN

Home
Forums
FME Form
Authoring

Authoring

Creating and organizing workspaces. How to use Workbench.

3,026 Posts
12,531 Replies

When you subscribe we will email you when there is a new topic in this category

3026 Posts

Recently active

Most replies Most views Newest first

asked in Authoring

How to aggregate a matrix of attribute values into a single row

How to aggregate a matrix of attribute values into a single row

asked in Authoring

Dynamic writers - is it possible to use a wildcard in the Attributes to Remove ?

I am using a dynamic reader (WFS) that will have multiple datasets with different attributes going through it. Using a dynamic writer , I want to be able to use a wildcard in Attributes to Remove to remove any attribute that has the suffix : xsi_nil. I have been trying to use variations on ' *xsi_nil ' but it doesn't seem to like wildcards , or have I just not hit on the correct syntax? Thx

asked in Authoring

writing python shutdown script

I am looking to run a python shutdown script and need some help getting started. i am very new to FME and also new to python. My goal is to use database updater tool and then have a email sent out when the database is updated. I wanted the script to first update the database and use the python emailer to email me it is complete. Only issue I found is the databases updater has no out so I cant email once done. So was told about a python shutdown script that could handle that and was curious how to do it. Any help would be great. Thank you.

asked in Authoring

How to use regex to turn a single line text file (with 27,000 bank records) into 27,000 line csv file?

I have a large text file produced on a Unix system containing bank records for around 27,000 entries. The sample file attached shows a small snippet of how the file is structured - which is all on a single line. Each entry contains a 31 digit number. In a text editor I simply do a regex search for [0-9]{31} and replace the matches with the matched text plus a line feed character in front of it. Thus the text file gets restructured as per the screen dump with one record per line. Is there a way of achieving this in FME? The regex stuff seems a bit clunky. I worked out that the stringsearcher transformer will only pick up the first occurrence of a match. A transformer from the Store is available called RegularExpressionMatcher is available which finds all occurrences and sticks them into a list. Where I go from there is what I could do with some help with please. Thanks James

asked in Authoring

I have an Id field in a table & need to add the max id + 1 to a new set of features with the same field name

I have an Id field in a table & need to add the max id + 1 to a new set of features with the same field name

asked in Authoring

Lines and Polygons that cross the International Date Line

Has anyone used a transformer or knows how to split a line that crosses the International Date Line. The problem I have is an area that one point is W179° and the next point is 179°. Anyone know of a solution.

tnarladniEnthusiast

asked in Authoring

Where is the Insert Constant tool?

There used to be a functionality that you could add a constant on the workbench and connect it to a field in the writer and it would be added as a value to that field. Has that been replaced by a transformer? If so, what?

asked in Authoring

Could you please lemme know which transformers come under aggregate tranformers?

Could you please lemme know which transformers come under aggregate tranformers?

asked in Authoring

Hi Looking at the FME online help for lists, I want to create this type of list in PythonCaller and use it in Workbench as a list: somelist{0}.length = 7.3 somelist{0}.kind = ’paved’ somelist{1}.length = 8.4 somelist{1}.kind = ’smooth’ somelist{1}.lanes = 2 somelist{2}.length = 1.1 somelist{2}.kind = ’rough’ I've created a simple list (element with an index) but struggling using fmeobjects and other libraries in the PythonCaller to create and set this complex list. Anyhelp from the Python Jedi out there? Thanks

asked in Authoring

workflow managment

Hi Is it possible to use FME cloud instead of FME server for work flow managment? ie run chained work flows which rely on the output of the previous step/s Many Thanks Lucky

asked in Authoring

Email from FME Desktop 2015

I'm looking for a way to send an email from FME Desktop. I went through this post but I cannot solve the issue: https://knowledge.safe.com/AnswersQuestionDetail?id=906a0000000cqUpAAI I have used "TCLEmailer" and "PythonEmailer" but I got the same error of the above post. ------ Python Exception <SMTPException>: SMTP AUTH extension not supported by server. Error encountered while calling function `email' PythonFactory failed to process feature ------ I disabled the antivirus but without any improvement. I'm using Gmail for the emailing and I'm aware about the Gmail setting: Email server: smtp.gmail.com Gmail SMTP port (TLS): 587 Gmail SMTP port (SSL): 465 Please for your support. I would be glad if anyone have a workspace with data sample or demo for the Email from FME Desktop.

asked in Authoring

Transformer gallery "search unavailable"

I installed FME 2015.1.2.1 on my computer and tried to use the transformer gallery search but it displays "Search is unavailable". Any ideas? Thanks.

asked in Authoring

python workbench runner

Hey FMEpedia, I'm trying to automate the the running of a 2 step process required for multiple admin areas. My current process is: 1. Workbench with workbench runner kicks of step 1 (for multiple admin areas at a time) 2. Once all admin areas have been processed - redirect workbench runner to point to step 2 Ideally I'd like to have a python shutdown script (or something of that ilk) within step 1, which would process step 2. Problem - The documentation for python shutdown scripts states you shouldn't use fmeobjects within a shutdown script...however this example highlights that it can be done. I attempted to follow the example code, but it is dated 2013, so could be redundant to 2015...can anyone assist with: a. Writing a python shutdown script to kick of new workbench, b. Can you use fmeobjects withn a shutdown script? #FME Variables import fme, fmeobjects status = fme.status runner = fmeobjects.FMEWorkspaceRunner() #Path to Workspace current_workspace_dir = fme.macroValues[

asked in Authoring

User Parameter / Process does't work when Optional Reader is empty

My Process has several Reader: DWG-ReaderTAB-ReaderECW(Orthophoto)-Reader optionalPointcloudXYZ(DEM)-Reader optional I want to adjust my FME process so that my colleagues have to make no adjustments on the actual process. They are not familar with FME. The colleagues should only press the "Prompt an Run Workspace"-Button and then select the files which are needed. The ECW and DEM files are not needed every time. At the Parameter (Type: Filename(Multiple)) Published and Optional are activated. The Process only run when i select some ECW and DEM files. When i don´t select i get this error message in the log: INFORM|POINTCLOUDXYZ reader: Directive '_FIELD_NAMES' has the value 'NO' |INFORM|POINTCLOUDXYZ reader: Directive '_FIELD_NAMES_AFTER_HEADER' has the value 'NO' |ERROR |POINTCLOUDXYZ reader: Failed to open file '.' for reading. Please ensure that the file exists and you have sufficient privileges to read it |ERROR |BADNEWS: A fatal error has occurred. Check the logfile above fo

fmelizardContributor

asked in Authoring

Find Coincident points from different geodatabase

Hi I need to find coincident points from different geodatabase database and assign a unique id to those features Facts: I have 2 database (A and B) with same feature classes.Database A is a subset of Database B from a content perspectiveFrom schema perspective Database A and B are sameSo if Featureclass BXX will have 2000 features then Featureclass AXX would probably have 1800 featuresI need to assign all the 1800 features from Featureclass AXX and BXX same incremental idFor e.g first feature for coincident feature in FC AXX and BXX will get id 101. Second coincident feature from both FC will get ID of 102 and so on.For the remaining 200 features from BXX will also get a unique id but there won't be anything assigned in feature class AXX as there are not featuresMost (not all) of the attributes are same on both these feature class.I also have a lat and long field in addition to shape field - they should match as well. The challenge is in finding the coincident features in a fashi

asked in Authoring

Identifying Floating Geometry

What is the transformer that can be used to identify dangling or hanging links in any given dataset?

maktContributor

asked in Authoring

In the writer properties, how can I change the type/width of many attributes all at once?

I am looking for a shortcut (transformer?) that will change attributes' type and width all at once. Holding down shift can select all the rows of attributes, but then the change made is not applied to all the rows selected. For exmaple, in the below picture, I want to change all "char" to "number", and the width from 200 to 20 .

asked in Authoring

Looping According to Spatial Data

Hi There, I have a road network polyline data with some dangle roads. I need to remove all the dangles using looping in FME. But the master catch comes here...I do not need to give the number of iterations myself. All the roads, having a free node should be looped out of the network spatially giving output of the present loop to the input of the next one regardless of the nnumber of loops. Attached Image can help better to understand more. Please revert if i am not able to communicate properly. Thanks and regards.

asked in Authoring

Add pause to a workspace

Hi, I’m running a workspace runner in server which is queuing a large number of DWG files. For each of the DWG’s, the child workspace is writing a large amount of information to a SQLITE3 file. The write fails about 60% of the time because the SQLITE3 file is locked. If I run this against individual file(s) using the child wokspace the SQLITE3 file is populates as expected. Is it possible that the information is being pushed faster than the SQLITE3 file can write it; I’ve seen this behavior with numerous other writers, (CSV, SPATIALITE, and XLS) as well. I have worked with the Transaction interval param but this has not helped. Is it possible to add a pause at the end of the workspace to give the writer enough time to commit the inserts? I’ve tried SystemCaller using a TIMEOUT or SLEEP command to no avail. I’ve tried SystemCaller calling a BAT file with a DIR command to keep is busy but it appears the SystemCaller is being run before the writer workflow. Any ideas would be app

asked in Authoring

Error reading VPF data

I am currently working with VPF data (the worldwide Digital Navigation Chart databases from NGA) and I'm having trouble with a few of the 29 databases. I need to convert them to another format, and I'm using the VPF_DB reader to read the DHT file, and then a Feature Reader. Most of the databases go through the workspace with no problem, but three of the databases give the following error: "Missing or badly formatted column value descriptor table name for column 0 of VPF table" Older versions of these three databases (from around 2013) do not give this error, but when patching them up to the newest version, or when I recieved the newest full version directly from NGA, FME does not accept them. The VPF format seems very complex and I don't really have the know-how to dive into the files themselves and understand what's going on. Does anyone have an idea of what could be wrong?

asked in Authoring

socrata writer - can I write data one year at a time?

I'm using the socrata writer in FME 2014 to take data from my Oracle data warehouse and post to Socrata open data set. It is a current limitation of my workplace that I cannot use FME 2015 as there is no 2015 Server available (and I don't want to design a solution where I have to run this from my desktop). I currently have a functional workspace, but I seem to be hitting an error based on the volume of data I'm trying to write to socrata. If I upload only 1 year worth of data at a time (about 50k rows), everything works fine. Once I try over 150k, I start running into problems and I have about 1.6 million rows total. I was wondering if there's a way for me to use FME to loop my writer and write only one year at a time. The first year would need to replace the existing dataset, then I would append data for all the remaining years, and publish the dataset with the last pass. I'm very noobish when it comes to FME, and am learning as I go. Does anyone have a d

asked in Authoring

Running multiple iterations of Neighbor Finder

I have a polygon feature class where each polygon has one of two attributes, "Admin" or "Active". These polygons are related spatially in a daisy-chain manner. That is, any Admin polygon overlapping an Active polygon will be grouped with that Active polygon into a larger "Active" site (ultimately dissolved into individual polygons), and any Admin polygon that then overlaps that newly created larger Active area is then also included in that Active site, until there are no more Admin polygonsoverlapping the large Active area. I am using Neighbor Finder to select the polygon that are overlapping, with the Active polygons as the Candidates and the Admin polygons as the Base. The trick is that once I get the first set of Admin polygons selected, I need to then use those to select more Admin polygons that overlap the Admin polygons selected in the first step. I have done this manually in ArcMap and it should take 5 steps to get all the polygons that are relat

asked in Authoring

Using REST API submit, how to send email

Hello! I'm developing a web application that sends requests to an FME server to run some pre-defined workspaces. I'm passing in some parameters (including geometries as GeoJSON) as published Parameters, and I am using the rest API endpoint /fmerest/v2/transformations/commands/submit/REPOSITORY/WORKSPACE This seems to work fine, I get a job ID back and the logs tells me that the job has run. However, and here lies the problem: As these jobs can be long-running and I don't want the hassle of polling FME server from my web app I would like FME server to send the result as an email to an email-address specified when the job is submitted (IE: not hard-coded in FME server) After some googling and chats with our FME experts it seems like this should be possible using the JobSubmitter service (http://docs.safe.com/fme/2014/html/FME_Server_Documentation/Default.htm#web_services/job_submitter_service.htm) and setting the opt_requesteremail property. However: to my understand

nedwatermanContributor

asked in Authoring

add value from row to column

Hi there, I have a REALLY badly formatted CSV file which is generated automatically by the software - the output can't be altered. The data shows calls to a service centre. Unfortunately, instead of adding the call handlers name to a column for their calls, its added as a row before. There's then an emoty row before the details for the next handler. I need to take this call handler name and add it to a column for their data only (ie before the next empty row). Any ideas on how to do this? This is my first step into the world of FME so I'm have in a baptism of fire... Kind Regards, Ned

asked in Authoring

Email results of workspace run from FME cloud

Hi there, I need some assistance figuring out how to email the results of my workspace which is published to FME Cloud. The workspace runs when a new email is received to a gmail account, from the usgs earthquake feed. The receive_email publication checks the account and when a new email is there, the workspace runs, (this ensures there is data available to download), it downloads earthquake data and overlays with ZIPCodes to produce an excel file saved to FME Cloud resources folder. This all works fine, but I'm having issues with the final part, sending an email with the excel file embedded. I created a SEND_EMAIL topic and a subscription, should I also have an FME Server Email Generator transformer in the workspace or how can I attach the output to the email I want to send? I did the tutorial to send an attachment but it actually sends a link not the file itself.

1
...
101
102
103
104
105
106
107
...
122

Page 104 / 122

Badge winners

lynnehas earned the badge Student (Grey)
lynnehas earned the badge Teacher (Grey)
blupikahas earned the badge Welcome Back
dubosedfmehas earned the badge Student (Grey)
dubosedfmehas earned the badge Expert (Grey)

Show all badges

30,152: Posts

Powered by Gainsight

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login

Login to the community

An FME Account is required to contribute

Login

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.