Authoring

I am looking to run a python shutdown script and need some help getting started. i am very new to FME and also new to python. My goal is to use database updater tool and then have a email sent out when the database is updated. I wanted the script to first update the database and use the python emailer to email me it is complete. Only issue I found is the databases updater has no out so I cant email once done. So was told about a python shutdown script that could handle that and was curious how to do it. Any help would be great. Thank you.

I have a large text file produced on a Unix system containing bank records for around 27,000 entries. The sample file attached shows a small snippet of how the file is structured - which is all on a single line. Each entry contains a 31 digit number. In a text editor I simply do a regex search for [0-9]{31} and replace the matches with the matched text plus a line feed character in front of it. Thus the text file gets restructured as per the screen dump with one record per line.  Is there a way of achieving this in FME? The regex stuff seems a bit clunky. I worked out that the stringsearcher transformer will only pick up the first occurrence of a match. A transformer from the Store is available called RegularExpressionMatcher is available which finds all occurrences and sticks them into a list. Where I go from there is what I could do with some help with please.   Thanks James

I have an Id field in a table & need to add the max id + 1 to a new set of features with the same field name

Has anyone used a transformer or knows how to split a line that crosses the International Date Line. The problem I have is an area that one point is W179° and the next point is 179°. Anyone know of a solution.

There used to be a functionality that you could add a constant on the workbench and connect it to a field in the writer and it would be added as a value to that field. Has that been replaced by a transformer? If so, what?

Could you please lemme know which transformers come under aggregate tranformers?

Hi Looking at the FME online help for lists, I want to create this type of list in PythonCaller and use it in Workbench as a list:  somelist{0}.length = 7.3 somelist{0}.kind = ’paved’ somelist{1}.length = 8.4 somelist{1}.kind = ’smooth’ somelist{1}.lanes = 2 somelist{2}.length = 1.1 somelist{2}.kind = ’rough’ I've created a simple list (element with an index) but struggling using fmeobjects and other libraries in the PythonCaller to create and set this complex list.  Anyhelp from the Python Jedi out there?  Thanks

Hi Is it possible to use FME cloud instead of FME server for work flow managment?  ie run chained work flows which rely on the output of the previous step/s Many Thanks Lucky

I'm looking for a way to send an email from FME Desktop. I went through this post but I cannot solve the issue: https://knowledge.safe.com/AnswersQuestionDetail?id=906a0000000cqUpAAI  I have used "TCLEmailer" and "PythonEmailer" but I got the same error of the above post. ------ Python Exception <SMTPException>: SMTP AUTH extension not supported by server. Error encountered while calling function `email' PythonFactory failed to process feature ------  I disabled the antivirus but without any improvement.  I'm using Gmail for the emailing and I'm aware about the Gmail setting: Email server: smtp.gmail.com Gmail SMTP port (TLS): 587 Gmail SMTP port (SSL): 465   Please for your support. I would be glad if anyone have a workspace with data sample or demo for the Email from FME Desktop. 

I installed FME 2015.1.2.1 on my computer and tried to use the transformer gallery search but it displays "Search is unavailable".  Any ideas?  Thanks.

Hey FMEpedia,  I'm trying to automate the the running of a 2 step process required for multiple admin areas.  My current process is: 1. Workbench with workbench runner kicks of step 1 (for multiple admin areas at a time) 2. Once all admin areas have been processed - redirect workbench runner to point to step 2  Ideally I'd like to have a python shutdown script (or something of that ilk) within step 1, which would process step 2.   Problem - The documentation for python shutdown scripts states you shouldn't use fmeobjects within a shutdown script...however this example highlights that it can be done.  I attempted to follow the example code, but it is dated 2013, so could be redundant to 2015...can anyone assist with: a. Writing a python shutdown script to kick of new workbench, b. Can you use fmeobjects withn a shutdown script?    #FME Variables import fme, fmeobjects status = fme.status runner = fmeobjects.FMEWorkspaceRunner() #Path to Workspace current_workspace_dir = fme.macroValues[

My Process has several Reader: DWG-ReaderTAB-ReaderECW(Orthophoto)-Reader optionalPointcloudXYZ(DEM)-Reader optional I want to adjust my FME process so that my colleagues have to make no adjustments on the actual process. They are not familar with FME. The colleagues should only press the "Prompt an Run Workspace"-Button and then select the files which are needed.  The ECW and DEM files are not needed every time. At the Parameter (Type: Filename(Multiple)) Published and Optional are activated.  The Process only run when i select some ECW and DEM files. When i don´t select i get this error message in the log:     INFORM|POINTCLOUDXYZ reader: Directive '_FIELD_NAMES' has the value 'NO' |INFORM|POINTCLOUDXYZ reader: Directive '_FIELD_NAMES_AFTER_HEADER' has the value 'NO' |ERROR |POINTCLOUDXYZ reader: Failed to open file '.' for reading.  Please ensure that the file exists and you have sufficient privileges to read it |ERROR |BADNEWS: A fatal error has occurred. Check the logfile above fo

Hi I need to find coincident points from different geodatabase database and assign a unique id to those features  Facts: I have 2 database (A and B) with same feature classes.Database A is a subset of Database B from a content perspectiveFrom schema perspective Database A and B are sameSo if Featureclass BXX will have 2000 features then Featureclass AXX would probably have 1800 featuresI need to assign all the 1800 features from Featureclass AXX and BXX same incremental idFor e.g first feature for coincident feature in FC AXX and BXX will get id 101. Second coincident feature from both FC will get ID of 102 and so on.For the remaining 200 features from BXX will also get a unique id but there won't be anything assigned in feature class AXX as there are not featuresMost (not all) of the attributes are same on both these feature class.I also have a lat and long field in addition to shape field - they should match as well.  The challenge is in finding the coincident features in a fashi

What is the transformer that can be used to identify dangling or hanging links in any given dataset?

I am looking for a shortcut (transformer?) that will change attributes' type and width all at once. Holding down shift  can select all the rows of attributes, but then the change made is not applied to all the rows selected.   For exmaple, in the below picture, I want to change all "char" to "number", and the width from 200 to 20 .

Hi There, I have a road network polyline data with some dangle roads. I need to remove all the dangles using looping in FME. But the master catch comes here...I do not need to give the number of iterations myself. All the roads, having a free node should be looped out of the network spatially giving output of the present loop to the input of the next one regardless of the nnumber of loops. Attached Image can help better to understand more.   Please revert if i am not able to communicate properly. Thanks and regards.  

Hi, I’m running a workspace runner in server which is queuing a large number of DWG files.  For each of the DWG’s, the child workspace is writing a large amount of information to a SQLITE3 file.  The write fails about 60% of the time because the SQLITE3 file is locked.  If I run this against individual file(s) using the child wokspace the SQLITE3 file is populates as expected.  Is it possible that the information is being pushed faster than the SQLITE3 file can write it; I’ve seen this behavior with numerous other writers, (CSV, SPATIALITE, and XLS) as well.  I have worked with the Transaction interval param but this has not helped.  Is it possible to add a pause at the end of the workspace to give the writer enough time to commit the inserts?  I’ve tried SystemCaller using a TIMEOUT or SLEEP command to no avail. I’ve tried SystemCaller calling a BAT file with a DIR command to keep is busy but it appears the SystemCaller is being run before the writer workflow.   Any ideas would be app

I am currently working with VPF data (the worldwide Digital Navigation Chart databases from NGA) and I'm having trouble with a few of the 29 databases. I need to convert them to another format, and I'm using the VPF_DB reader to read the DHT file, and then a Feature Reader. Most of the databases go through the workspace with no problem, but three of the databases give the following error:  "Missing or badly formatted column value descriptor table name for column 0 of VPF table" Older versions of these three databases (from around 2013) do not give this error, but when patching them up to the newest version, or when I recieved the newest full version directly from NGA, FME does not accept them. The VPF format seems very complex and I don't really have the know-how to dive into the files themselves and understand what's going on. Does anyone have an idea of what could be wrong? 

I'm using the socrata writer in FME 2014 to take data from my Oracle data warehouse and post to Socrata open data set.  It is a current limitation of my workplace that I cannot use FME 2015 as there is no 2015 Server available (and I don't want to design a solution where I have to run this from my desktop).  I currently have a functional workspace, but I seem to be hitting an error based on the volume of data I'm trying to write to socrata.  If I upload only 1 year worth of data at a time (about 50k rows), everything works fine.  Once I try over 150k, I start running into problems and I have about 1.6 million rows total.  I was wondering if there's a way for me to use FME to loop my writer and write only one year at a time.  The first year would need to replace the existing dataset, then I would append data for all the remaining years, and publish the dataset with the last pass.    I'm very noobish when it comes to FME, and am learning as I go.  Does anyone have a d

I have a polygon feature class where each polygon has one of two attributes, "Admin" or "Active".  These polygons are related spatially in a daisy-chain manner. That is, any Admin polygon overlapping an Active polygon will be grouped with that Active polygon into a larger "Active" site (ultimately dissolved into individual polygons), and any Admin polygon that then overlaps that newly created larger Active area is then also included in that Active site, until there are no more Admin polygonsoverlapping the large Active area.  I am using Neighbor Finder to select the polygon that are overlapping, with the Active polygons as the Candidates and the Admin polygons as the Base.  The trick is that once I get the first set of Admin polygons selected, I need to then use those to select more Admin polygons that overlap the Admin polygons selected in the first step. I have done this manually in ArcMap and it should take 5 steps to get all the polygons that are relat

Hello!  I'm developing a web application that sends requests to an FME server to run some pre-defined workspaces.   I'm passing in some parameters (including geometries as GeoJSON) as published Parameters, and I am using the rest API endpoint /fmerest/v2/transformations/commands/submit/REPOSITORY/WORKSPACE  This seems to work fine, I get a job ID back and the logs tells me that the job has run.   However, and here lies the problem: As these jobs can be long-running and I don't want the hassle of polling FME server from my web app I would like FME server to send the result as an email to an email-address specified when the job is submitted (IE: not hard-coded in FME server)   After some googling and chats with our FME experts it seems like this should be possible using the JobSubmitter service (http://docs.safe.com/fme/2014/html/FME_Server_Documentation/Default.htm#web_services/job_submitter_service.htm) and setting the opt_requesteremail property.  However: to my understand

Hi there, I have a REALLY badly formatted CSV file which is generated automatically by the software - the output can't be altered.  The data shows calls to a service centre. Unfortunately, instead of adding the call handlers name to a column for their calls, its added as a row before. There's then an emoty row before the details for  the next handler.  I need to take this call handler name and add it to a column for their data only (ie before the next empty row). Any ideas on how to do this? This is my first step into the world of FME so I'm have in a baptism of fire...  Kind Regards, Ned

Hi there,  I need some assistance figuring out how to email the results of my workspace which is published to FME Cloud. The workspace runs when a new email is received to a gmail account, from the usgs earthquake feed. The receive_email publication checks the account and when a new email is there, the workspace runs, (this ensures there is data available to download), it downloads earthquake data and overlays with ZIPCodes to produce an excel file saved to FME Cloud resources folder. This all works fine, but I'm having issues with the final part, sending an email with the excel file embedded. I created a SEND_EMAIL topic and a subscription, should I also have an FME Server Email Generator transformer in the workspace or how can I attach the output to the email I want to send? I did the tutorial to send an attachment but it actually sends a link not the file itself.

Wondering if the Linux-version supports parallel processing. I am running some bufferings and dissolves on a national level and there should be room for parallel processing on these jobs. Using htop it seems like the processing is restricted to one core:    I have tried setting the dissolvers parallel processing level to extreme, but the job has no signifcant speed increase.  I am using Edition: FME Desktop Microsoft SQL Server Edition (floating) Version: FME(R) 2015.1.2.0 (20150911 - Build 15538 - linux-x64)

Hello,  This is a simple use of the spatial realtor but I can't figure out how to expose the related attributes. I have a set of overlapping polygons, differentiated by an attribute (Type 1- 5). I have a point file. For each point in the file I want to calculate 5 attributes (Type 1- 5), indicating whether or not that point fell within the polygon type.  I thought the spatial relator wiith a groupby "Type" would create a list for each point indicating if it were related to each of the 5 types, accessible through the "_relationship{indexValue}". With the indexvalue being the order of polygon types based on the order the grouby was processed. Can some explain how to properly use this transformer and access the results?  Thanks,   Desired final product: Point, Type1, Type2, Type3, Type4, Type5 1      , YES  ,  NO    , YES  , YES  , NO etc