Creating and organizing workspaces. How to use Workbench.
Recently active
Hi Is it possible to use FME cloud instead of FME server for work flow managment? ie run chained work flows which rely on the output of the previous step/s Many Thanks Lucky
I'm looking for a way to send an email from FME Desktop. I went through this post but I cannot solve the issue: https://knowledge.safe.com/AnswersQuestionDetail?id=906a0000000cqUpAAI I have used "TCLEmailer" and "PythonEmailer" but I got the same error of the above post. ------ Python Exception <SMTPException>: SMTP AUTH extension not supported by server. Error encountered while calling function `email' PythonFactory failed to process feature ------ I disabled the antivirus but without any improvement. I'm using Gmail for the emailing and I'm aware about the Gmail setting: Email server: smtp.gmail.com Gmail SMTP port (TLS): 587 Gmail SMTP port (SSL): 465 Please for your support. I would be glad if anyone have a workspace with data sample or demo for the Email from FME Desktop.
I installed FME 2015.1.2.1 on my computer and tried to use the transformer gallery search but it displays "Search is unavailable". Any ideas? Thanks.
Hey FMEpedia, I'm trying to automate the the running of a 2 step process required for multiple admin areas. My current process is: 1. Workbench with workbench runner kicks of step 1 (for multiple admin areas at a time) 2. Once all admin areas have been processed - redirect workbench runner to point to step 2 Ideally I'd like to have a python shutdown script (or something of that ilk) within step 1, which would process step 2. Problem - The documentation for python shutdown scripts states you shouldn't use fmeobjects within a shutdown script...however this example highlights that it can be done. I attempted to follow the example code, but it is dated 2013, so could be redundant to 2015...can anyone assist with: a. Writing a python shutdown script to kick of new workbench, b. Can you use fmeobjects withn a shutdown script? #FME Variables import fme, fmeobjects status = fme.status runner = fmeobjects.FMEWorkspaceRunner() #Path to Workspace current_workspace_dir = fme.macroValues[
My Process has several Reader: DWG-ReaderTAB-ReaderECW(Orthophoto)-Reader optionalPointcloudXYZ(DEM)-Reader optional I want to adjust my FME process so that my colleagues have to make no adjustments on the actual process. They are not familar with FME. The colleagues should only press the "Prompt an Run Workspace"-Button and then select the files which are needed. The ECW and DEM files are not needed every time. At the Parameter (Type: Filename(Multiple)) Published and Optional are activated. The Process only run when i select some ECW and DEM files. When i don´t select i get this error message in the log: INFORM|POINTCLOUDXYZ reader: Directive '_FIELD_NAMES' has the value 'NO' |INFORM|POINTCLOUDXYZ reader: Directive '_FIELD_NAMES_AFTER_HEADER' has the value 'NO' |ERROR |POINTCLOUDXYZ reader: Failed to open file '.' for reading. Please ensure that the file exists and you have sufficient privileges to read it |ERROR |BADNEWS: A fatal error has occurred. Check the logfile above fo
Hi I need to find coincident points from different geodatabase database and assign a unique id to those features Facts: I have 2 database (A and B) with same feature classes.Database A is a subset of Database B from a content perspectiveFrom schema perspective Database A and B are sameSo if Featureclass BXX will have 2000 features then Featureclass AXX would probably have 1800 featuresI need to assign all the 1800 features from Featureclass AXX and BXX same incremental idFor e.g first feature for coincident feature in FC AXX and BXX will get id 101. Second coincident feature from both FC will get ID of 102 and so on.For the remaining 200 features from BXX will also get a unique id but there won't be anything assigned in feature class AXX as there are not featuresMost (not all) of the attributes are same on both these feature class.I also have a lat and long field in addition to shape field - they should match as well. The challenge is in finding the coincident features in a fashi
What is the transformer that can be used to identify dangling or hanging links in any given dataset?
I am looking for a shortcut (transformer?) that will change attributes' type and width all at once. Holding down shift can select all the rows of attributes, but then the change made is not applied to all the rows selected. For exmaple, in the below picture, I want to change all "char" to "number", and the width from 200 to 20 .
Hi There, I have a road network polyline data with some dangle roads. I need to remove all the dangles using looping in FME. But the master catch comes here...I do not need to give the number of iterations myself. All the roads, having a free node should be looped out of the network spatially giving output of the present loop to the input of the next one regardless of the nnumber of loops. Attached Image can help better to understand more. Please revert if i am not able to communicate properly. Thanks and regards.
Hi, I’m running a workspace runner in server which is queuing a large number of DWG files. For each of the DWG’s, the child workspace is writing a large amount of information to a SQLITE3 file. The write fails about 60% of the time because the SQLITE3 file is locked. If I run this against individual file(s) using the child wokspace the SQLITE3 file is populates as expected. Is it possible that the information is being pushed faster than the SQLITE3 file can write it; I’ve seen this behavior with numerous other writers, (CSV, SPATIALITE, and XLS) as well. I have worked with the Transaction interval param but this has not helped. Is it possible to add a pause at the end of the workspace to give the writer enough time to commit the inserts? I’ve tried SystemCaller using a TIMEOUT or SLEEP command to no avail. I’ve tried SystemCaller calling a BAT file with a DIR command to keep is busy but it appears the SystemCaller is being run before the writer workflow. Any ideas would be app
I am currently working with VPF data (the worldwide Digital Navigation Chart databases from NGA) and I'm having trouble with a few of the 29 databases. I need to convert them to another format, and I'm using the VPF_DB reader to read the DHT file, and then a Feature Reader. Most of the databases go through the workspace with no problem, but three of the databases give the following error: "Missing or badly formatted column value descriptor table name for column 0 of VPF table" Older versions of these three databases (from around 2013) do not give this error, but when patching them up to the newest version, or when I recieved the newest full version directly from NGA, FME does not accept them. The VPF format seems very complex and I don't really have the know-how to dive into the files themselves and understand what's going on. Does anyone have an idea of what could be wrong?
I'm using the socrata writer in FME 2014 to take data from my Oracle data warehouse and post to Socrata open data set. It is a current limitation of my workplace that I cannot use FME 2015 as there is no 2015 Server available (and I don't want to design a solution where I have to run this from my desktop). I currently have a functional workspace, but I seem to be hitting an error based on the volume of data I'm trying to write to socrata. If I upload only 1 year worth of data at a time (about 50k rows), everything works fine. Once I try over 150k, I start running into problems and I have about 1.6 million rows total. I was wondering if there's a way for me to use FME to loop my writer and write only one year at a time. The first year would need to replace the existing dataset, then I would append data for all the remaining years, and publish the dataset with the last pass. I'm very noobish when it comes to FME, and am learning as I go. Does anyone have a d
I have a polygon feature class where each polygon has one of two attributes, "Admin" or "Active". These polygons are related spatially in a daisy-chain manner. That is, any Admin polygon overlapping an Active polygon will be grouped with that Active polygon into a larger "Active" site (ultimately dissolved into individual polygons), and any Admin polygon that then overlaps that newly created larger Active area is then also included in that Active site, until there are no more Admin polygonsoverlapping the large Active area. I am using Neighbor Finder to select the polygon that are overlapping, with the Active polygons as the Candidates and the Admin polygons as the Base. The trick is that once I get the first set of Admin polygons selected, I need to then use those to select more Admin polygons that overlap the Admin polygons selected in the first step. I have done this manually in ArcMap and it should take 5 steps to get all the polygons that are relat
Hello! I'm developing a web application that sends requests to an FME server to run some pre-defined workspaces. I'm passing in some parameters (including geometries as GeoJSON) as published Parameters, and I am using the rest API endpoint /fmerest/v2/transformations/commands/submit/REPOSITORY/WORKSPACE This seems to work fine, I get a job ID back and the logs tells me that the job has run. However, and here lies the problem: As these jobs can be long-running and I don't want the hassle of polling FME server from my web app I would like FME server to send the result as an email to an email-address specified when the job is submitted (IE: not hard-coded in FME server) After some googling and chats with our FME experts it seems like this should be possible using the JobSubmitter service (http://docs.safe.com/fme/2014/html/FME_Server_Documentation/Default.htm#web_services/job_submitter_service.htm) and setting the opt_requesteremail property. However: to my understand
Hi there, I have a REALLY badly formatted CSV file which is generated automatically by the software - the output can't be altered. The data shows calls to a service centre. Unfortunately, instead of adding the call handlers name to a column for their calls, its added as a row before. There's then an emoty row before the details for the next handler. I need to take this call handler name and add it to a column for their data only (ie before the next empty row). Any ideas on how to do this? This is my first step into the world of FME so I'm have in a baptism of fire... Kind Regards, Ned
Hi there, I need some assistance figuring out how to email the results of my workspace which is published to FME Cloud. The workspace runs when a new email is received to a gmail account, from the usgs earthquake feed. The receive_email publication checks the account and when a new email is there, the workspace runs, (this ensures there is data available to download), it downloads earthquake data and overlays with ZIPCodes to produce an excel file saved to FME Cloud resources folder. This all works fine, but I'm having issues with the final part, sending an email with the excel file embedded. I created a SEND_EMAIL topic and a subscription, should I also have an FME Server Email Generator transformer in the workspace or how can I attach the output to the email I want to send? I did the tutorial to send an attachment but it actually sends a link not the file itself.
Wondering if the Linux-version supports parallel processing. I am running some bufferings and dissolves on a national level and there should be room for parallel processing on these jobs. Using htop it seems like the processing is restricted to one core: I have tried setting the dissolvers parallel processing level to extreme, but the job has no signifcant speed increase. I am using Edition: FME Desktop Microsoft SQL Server Edition (floating) Version: FME(R) 2015.1.2.0 (20150911 - Build 15538 - linux-x64)
Hello, This is a simple use of the spatial realtor but I can't figure out how to expose the related attributes. I have a set of overlapping polygons, differentiated by an attribute (Type 1- 5). I have a point file. For each point in the file I want to calculate 5 attributes (Type 1- 5), indicating whether or not that point fell within the polygon type. I thought the spatial relator wiith a groupby "Type" would create a list for each point indicating if it were related to each of the 5 types, accessible through the "_relationship{indexValue}". With the indexvalue being the order of polygon types based on the order the grouby was processed. Can some explain how to properly use this transformer and access the results? Thanks, Desired final product: Point, Type1, Type2, Type3, Type4, Type5 1 , YES , NO , YES , YES , NO etc
Is there a way to specify the sheet name when you open an Excel spreadsheet using the FMEUniversalReader in Python code? I am assuming that there is a parameter that you can add to the open() method, but I have looked at the documentation for the open() method and the parameters are not described. Thanks
Hi, is it possible to create dynamic parameters for a FME reader? I am writing a FME reader and it would be great if you guys can give my some advice implementing the following idea. The reader parameters include some server information. Once the user enters this information, a connection is established to the server (as background job) and a list of layers (of a CityGML scene/file stored on the server) is given back from the server. This list appears in some way in the reader parameter window and the user can select multiple layers. All this should happened before the parameter window is closed. How can I do that? If this is not possible: Can a run a (python) script before the user clicks the parameter button (inside the "Add reader" window)? Then, I could use the script to fetch the layer list from the server (using hard-coded server information) and provide the layer list as static information once the parameter window appears. Again, how can I do that? Thanks for your
Hi, I'm interested if inspector has some impact on conversion time? If I have many inspectors in testing and debugging process, how does this affects time needed for conversion to be done? Thanks!
Is there a way to send multiple emails in the "Email to" box of the subscription? I tried the format that Outlook uses, that is, each email is separated by a semi-colon: email1@email.com;email2@email.com;email3@email.com However, no emails get sent. Thanks
Hi all, I have the data in a table similar to that: I have been asked to create something like the table below: Basically, I am grouping by Site, Name, Feature, Subfeature, then counting Y or N for each group, concatenating the years and summing the count. Does anyone know how to do this? By only using the aggregator I get something like that but it is not exactly but I need: Any ideas how can I get Count_Dead_N and Count_Dead_Y. Thanks!
On FME Server we keep getting this type of warning when the workspace makes a connection tothe DB and looks like right before the select statement happens. Oracle Reader: Column 'DEVICEID' specified on Feature Type but does not exist in table 'S5FFFFF.XXXXXXX_XXXXX_INFO_V' and will be ignored The view is being read and it does this for each column in the view. FME workspace does read the view and processes the data. Any insight on how to make the warning go away would be great.
Hi, I was wondering if there is a way to make FME use more CPU? I have workflow with GML Reader and Multiple SQL Server Non-Spatial Writers. Multiple writers are there because I need to insert into identity columns in four different tables parts of transformed GML data. Here FME is reading GML and writing it into SQL Server by using 10-13% of CPU. How can I make it use e.g. 70-80%? Memory occupied bu FME is also 500-700MB. How does this work?