Creating and organizing workspaces. How to use Workbench.
Recently active
I have a simple FME workbench that loads two shape files into an ArcSDE feature class called LEXCO_LEASE_2. The feature class was versioned and the process ran very slow. To speed up the loading, I unregistered the versioning in ArcCatalog for this feature class without keeping any edits and change the workbench SDE Transaction Type to TRANSACTIONS. But the workbench failes to run with this error: An error occurred while attempting to open an insert cursor on the table 'LEXCO_LEASE_2'. The error number from ArcObjects is: '-2147216556'. The error message from ArcObjects is: {Objects in this class cannot be updated outside an edit session [SDE_GOM.LEXCO_LEASE_2]} I then re-register the versioning, then the workbench runs fine (but very slow). Anybody know how to fix the error without re-registering versioning for this feature class? Software Versions: ArcGIS Desktop 10.0 SP3 FME Desktop 2012 ESRI Edition SP2 Allen
Hi,I am trying to take advantage of the Direct URL feature. In my use case, I am including links in messages such as emails, where if the user clicks it, it runs a workspace on FME server with the correct parameters that calls a REST API to create a new project on a particular server. The user gets a summary screen in a web browser that simply reports whether the workspace ran successfully or not, but does not relay any other information. It also asks the user to read the logfile for more info., but there are no logfile links on this page. Here's an example in FME Server 2017.1: In the above case I added a Terminator so that if the feature comes out of the <Rejected> port of the HTTP caller, the workspace stops and results in an error. In this case I tried to create a project that already existed. Now the workspace does have this exact information in the response body from the server that it interacted with, but we have no way to route this information to the resulting summar
I want to dynamically write out new files based on a set of input shapefiles. I want this output to be an exact copy of the input data except in a different format. I know that dynamic mode should work well for this type of workflow but I am getting lots of extra attributes in my output. It also seems like the schema being created contains all the attributes from all of the input shapefiles combined! What am I doing wrong?
I have a copper cable table which has attributes of startjoint and endjoint. I would like to build a cable path from the lead-in cable to the copper pillar. The logic to build the path is based on the startjoint and endjoint. The cable whose endjoint = startjoint of another cable is the upstream cable. By joining them, a complete path can be built. Due to the uncertainty of the numbers of cables between the lead-in to the pillar, I would like to use Loop to achieve this. I have used inlinequerier to join the cables and any result returned will go back to the loop. The loop will stop when there is no feature returned where endjoint = startjoint. However, the iteration only occurs 1 and no feature is returned for iteration even there are 11 features output from the result. Any suggestion what is the best approach to achieve this? Thanks.
Hi,I'm starting to getting know FME, and I have such problem:I need to sum occurrence of values from one table within ranges from another one. Ranges needs to be taken from another table because they're changing sometimes and there is a lot of them. I've created min and max column but I don't know how to deal with searching and counting. I want to know how many records is in every range.EDIT:I've added example of my data and fmw.
Hi all,I have an attribute table in the following format:localitycountmonthbright123janbright456febbright789marmyrtleford987janmyrtleford654febmyrtleford321marI would like to change it to the following format:localityjanfebmarbright123456789myrtleford987654321I have a convoluted process using an attribute filter and a bunch of statistics calculators but it's not very scaleable. I was wondering if anyone can point me in the right direction for an improved solution!Cheers,Barrett
Hi all,At the moment I have the following situation. I have a regular, 6*6 grid, from which the gridsize depends on the outcome of a formula which includes several variables: 1. The volume of the underlying pile of sand 2. The surface area (only in xy-direction) from the pile of sand. In this case, they can be assumed as constants, since the pile of sand stays the same.The model now calculates the maximum grid size based upon those constants, which is projected over the pile of sand, resulting in a 6*6 overlying grid as mentioned.Next step: the calculation of the thickness of the sand at the grid points. This is where drills should be taken, until the surface underneath the pile of sand is reached. This is called drill depth. The sum of the total drill depth should be 100m or above (by law), but as small as possible to reduce labour costs.Problem: when I run the model and the total drill depth is e.g. 96m (as in this example), I want to rerun this whole process with a smaller grid size
Hi everyone,I am trying to create a dynamic Workflow with a SDF3 Reader and Writer. The idea is to reproject sdf-files with different schemas. The problem in that workflow is that the SDF3-Writer expects an identity column, but the ID-column names from my sdf-files are not equal. Because of that I can't use a static attribute. In addition I don't want to create a new attribute as identifier in the output-file.Is there any way to get the name of the ID-column of the sdf-file dynamically?kind regards and best wishes, Marvin
I'm trying to Dynamic writer to a dataset within an arcgis gdb. I set my fme_feature_type to dataset/fuse but it will create a fc at the root directory named dataset_fuse. I then discovered there is a "feature Dataset" field to fill in ...and i did with datasetThen it does create a file named dataset_fuse within the dataset. But it doesn't use my schema. if i alter my fme_feature_type to just fuse then it says it can't find the schema and doesn't write.this is my gdb setup:arcgis.fgdbdatasetfusethank you
I am attempting to modify a workbench that a former co-worker created, and they password protected the workbench. Is there any way at all to decode the password for the workbench? Getting in touch with the co-worker is not an option
Why does the ESRI-JSON reader automatically expose all of the attributes in the fields list but the Feature Reader set to ESRI-JSON require me to interactively set the attributes that are to be exposed? Why can't the Feature Reader work the same way as the Reader?
Hi, I have dataset which consists of about 40 millions parcels. Some of them have the same identifier and I would like to join them into one area (with dissolve lines). I would like to use custom transformer which is very similar to https://knowledge.safe.com/articles/47216/using-arcpy-for-fme-feature-processing.html. I have FeatureWriter, PythonCaller and FeatureReader Transformer and I have a problem with keeping attributes after FeatureWriter transformer because in the PythonCaller Transformer I would like to use Attribute Accumulation (…”AREA SUM; CITY FIRST; POSTCODE FIRST; COUNTRY FIRST”…). I will need these information as a final score. Maybe is here someonebody who could help me?
Hi all,I'd like to know if there is a way to use conditional value mechanism with a group by parameter.Imagine following case:I have a published parameter with values 0 and 1. My features have the attributes A, B, C and D. When I select 0 for the published parameter I'd like to have A and B attributes as Group by attributes, and when 1 is given, C and D shall be set.I know that I could use a tester and route features accordingly to differently set transformers, but I'm using the Group by setting on various locations. To keep the workspace readable this approach would not be applicable.
Hi!I set a variable in the Startup Python Script:import fmefrom datetime import datetimefme.macroValues['workbench_started'] = datetime.now().strftime("%Y%m%d%H%M%S")The first version of the workbench looks like this:This is the result - there is no current-date-time-value in the attribute _value:So, in my opinion the VariableRetriever didn't work correctly.---------------------Alternative solution, use the python caller to retrieve the variable and set attribute:This is the code of the PythonCaller:import fmeimport fmeobjectsdef processFeature(feature): feature.setAttribute("_value", fme.macroValues['workbench_started'])This is the result:It looks like the VariableRetriever isn't working properly.Or did I make something wrong?I have tried it in FME Desktop 2018.0 and FME Desktop 2017.1.2.0.
I seem to be getting the same issue as described here: http://gis.stackexchange.com/questions/22427/fme-error-failed-to-validate-fme-worker-licence-keyAfter the same amount of time I get "Failed to validate FME worker licence key" - after approx processing 1 000 000 objects. I need parallell processing due to the size of the data, I have tried Aggressive only, and also Extreme. Below is a screenshot showing part of the process. The Parallell runs in Parallell (:)).After approx 1hour 20 minutes the logfile fills with "Failed to validate FME worker licence key" and the fmeworker.exe gets stuck with no work done (0.01 percent CPU constantly). I use FME 2016.1 - floating license - Oracle Edition. Also tried on FME 2017 - same issue@Mark2AtSafe
Hi,We currently have a FME Server 2017.1.1 install on our cloud (AWS), we want to install an FME Engine inside a customer network to allow access protected resources like databases, files etc. Reading about we need to connect the remote engine to:1. FME DataBase: We have our FME database on Amazon RDS, so i can give access to the engine to allow connect to the database, this is fine.2. FME Core: To allow connections to the FME Core, FME engine needs access FME Core using the ports 7069-7072 and 7100-7150 and FME Core needs access FME Engine using the ports 7500, I can add the proper permissions on the servcurity group, so this point is ok.3. FME Server System Share: We are using Amazon EFS for FME System Share, external access to EFS is not allowed unless we implement AWS Direct Connect. We do not want to connect our customer's network to our cloud network to connect to FME Server System Share, is this really necessary? we only want to send jobs to a remote engine, basically y th
Hi,We are using pyfme.I'm profiling a workspace using the technique described here: Profiling a workspace.However, my workspace has a lot of python created factories and my results looks like this:If I take the first one "f_151" there is no trace of that name neither in the log or the fmw file.My question: Is there any way to create my python factories (FMEFactoryPileline) to have something more talking than "f_151"?Thanks,Larry
I am having trouble to connect to serveral webservices. - ArcGIS Server REST API - ArcGIS Online REST Service- Geoserver WFS (with login)The error I get each time is: HTTP/FTP transfer error: 'Couldn't connect to server' The connections are working in a browser (Firefox, Chrome). But none is working in FME.I have tried several settings, but I can not get it to work. Do you have any suggestions I can try? I do not know where to search anymore.Thanks,Complete error:HTTPCaller_2(HTTPFactory): HTTP/FTP transfer error: 'Couldn't connect to server'HTTPCaller_2(HTTPFactory): Please ensure that your network connection is properly set upHTTPCaller_2(HTTPFactory): No proxy settings have been entered. If you require a proxy to access external URLs, please ensure the appropriate information has been enteredThe below feature caused the translation to be terminated
Hi,I have a FME 2016.1 workbench that contains a Custom Loop transformer and within that I also have a PythonCaller with some Python Code.The workbench outputs the expected result but it takes over an hour to run. I need it to run ideally in less than 20 minutes.I have attached some screen shots of the main workbench and the custom transformer. Does anyone have ideas on things I could do to speed this up?Thanks,
Hello,I'm trying to use an external python library, Paramiko to perform some SFTP functionality. I am attempting to use a PythonCaller to run some python that I know works outside of FME. I have python 2.7x64bit installed. I'm running FME 2017.1x64 bit. My python interpreter is set as below:Here is the PythonCaller configuration:Here is the python script:And here is the error:I'm sure i'm goofing up something simple. Thank you for your help!
HI i am having trouble with feature reader in 2017 in that the WHERE clause is not interacting well with the spatial filter envelope query. If i run either in isolation then the process works but together the work bench fails to run.feature reader is version 9, fme 2017 version is 2017.1.1.0 (build 17650 - win32)is anyone else have this issue? i cannot run the where clause in a tester after the feature reader due to the amount of data been extracted. we really need to extract to extents and not the entire data base.any suggestions or help is greatly appreciated.
I'm trying to run the 'FME Server Workflow Management' workspaces and running into a couple of issues running 'chain_job.fmw' depending on how I reference the server itself in the Web Connections settings.1. Web Connection configured as same domain I publish against (eg http://site.company.com)running chain_job from desktop and calling the three published workspaces runs fine.running the published chain jobs errors with a web pages content<title>Notification: DNS Failure</title><h1>This Page Cannot Be Displayed</h1>The host name resolution (DNS lookup) for this host name( site.company.com ) has failed. The Internet address may be misspelled or obsolete,the host ( site.company.com ) may be temporarily unavailable,or the DNS server may be unresponsive.Date: Tue, 20 Feb 2018 16:22:11 AEDT<br />Username: <br />Source IP: 99.99.99.99(this was the machines IP)<br />URL: POST http://site.company.com.com/fmerest/transformations/comm
Hi,I've been given a set of 20+ MapInfo tables, of which most have a period (.) in the file names.I need to convert these tables into MS/SQL, but this presents a problem, since periods are no-go in MS/SQL, and I need to control the schema.I'm trying to write using a dynamic writer, but I simply cannot figure out the combination of parameters, that'll allow me to replace the periods with underscores before writing into the database. No matter what I do, I loose the connection to the "schema", and nothing gets converted.Please help me out. This ought to be a no-brainer, but I'm stumped.Cheers.
I need to remove the default folder created by fme when writing in kml does anyone know how to do that I tried multiple thing but cannot find the solution?enclosed the really basic workspace
Hi there,I have a translation between Microstation DGN files and AutoCAD DWG files where there can be as many as 6000 files at a time, but I'm encountering memory resource issues. I want to avoid splitting this translation into a child process with a WorkspaceRunner or JobSubmitter where it will process 1 file at a time.I'm using FeatureReader-DGN and tried with FeatureWriter-DWG / DWG Writer. FME_TEMP points to a 2 TB drive and the translation accumulated 350 GB of temp files like these before crashing with another TB free: FME_OBJC_MultiWriter_1518629821107_13172_1 ... FME_OBJC_MultiWriter_1518629821107_13172_235Virtual memory is set to automatic paging on the same driveI have 16 GB RAMDGN file sizes range from 13 KB to 29 MBFME 2016.1.3.2 #16717 WIN64FME seems to accumulate all the features from all the files before it writes out a single feature to a physical file. Is there a way to maybe (1) batch up the list files so that n-number-of-files are processed at a time, or (2)