Creating and organizing workspaces. How to use Workbench.
Recently active
Hi all,At the moment I have the following situation. I have a regular, 6*6 grid, from which the gridsize depends on the outcome of a formula which includes several variables: 1. The volume of the underlying pile of sand 2. The surface area (only in xy-direction) from the pile of sand. In this case, they can be assumed as constants, since the pile of sand stays the same.The model now calculates the maximum grid size based upon those constants, which is projected over the pile of sand, resulting in a 6*6 overlying grid as mentioned.Next step: the calculation of the thickness of the sand at the grid points. This is where drills should be taken, until the surface underneath the pile of sand is reached. This is called drill depth. The sum of the total drill depth should be 100m or above (by law), but as small as possible to reduce labour costs.Problem: when I run the model and the total drill depth is e.g. 96m (as in this example), I want to rerun this whole process with a smaller grid size
Hi everyone,I am trying to create a dynamic Workflow with a SDF3 Reader and Writer. The idea is to reproject sdf-files with different schemas. The problem in that workflow is that the SDF3-Writer expects an identity column, but the ID-column names from my sdf-files are not equal. Because of that I can't use a static attribute. In addition I don't want to create a new attribute as identifier in the output-file.Is there any way to get the name of the ID-column of the sdf-file dynamically?kind regards and best wishes, Marvin
I'm trying to Dynamic writer to a dataset within an arcgis gdb. I set my fme_feature_type to dataset/fuse but it will create a fc at the root directory named dataset_fuse. I then discovered there is a "feature Dataset" field to fill in ...and i did with datasetThen it does create a file named dataset_fuse within the dataset. But it doesn't use my schema. if i alter my fme_feature_type to just fuse then it says it can't find the schema and doesn't write.this is my gdb setup:arcgis.fgdbdatasetfusethank you
I am attempting to modify a workbench that a former co-worker created, and they password protected the workbench. Is there any way at all to decode the password for the workbench? Getting in touch with the co-worker is not an option
Why does the ESRI-JSON reader automatically expose all of the attributes in the fields list but the Feature Reader set to ESRI-JSON require me to interactively set the attributes that are to be exposed? Why can't the Feature Reader work the same way as the Reader?
Hi, I have dataset which consists of about 40 millions parcels. Some of them have the same identifier and I would like to join them into one area (with dissolve lines). I would like to use custom transformer which is very similar to https://knowledge.safe.com/articles/47216/using-arcpy-for-fme-feature-processing.html. I have FeatureWriter, PythonCaller and FeatureReader Transformer and I have a problem with keeping attributes after FeatureWriter transformer because in the PythonCaller Transformer I would like to use Attribute Accumulation (…”AREA SUM; CITY FIRST; POSTCODE FIRST; COUNTRY FIRST”…). I will need these information as a final score. Maybe is here someonebody who could help me?
Hi all,I'd like to know if there is a way to use conditional value mechanism with a group by parameter.Imagine following case:I have a published parameter with values 0 and 1. My features have the attributes A, B, C and D. When I select 0 for the published parameter I'd like to have A and B attributes as Group by attributes, and when 1 is given, C and D shall be set.I know that I could use a tester and route features accordingly to differently set transformers, but I'm using the Group by setting on various locations. To keep the workspace readable this approach would not be applicable.
Hi!I set a variable in the Startup Python Script:import fmefrom datetime import datetimefme.macroValues['workbench_started'] = datetime.now().strftime("%Y%m%d%H%M%S")The first version of the workbench looks like this:This is the result - there is no current-date-time-value in the attribute _value:So, in my opinion the VariableRetriever didn't work correctly.---------------------Alternative solution, use the python caller to retrieve the variable and set attribute:This is the code of the PythonCaller:import fmeimport fmeobjectsdef processFeature(feature): feature.setAttribute("_value", fme.macroValues['workbench_started'])This is the result:It looks like the VariableRetriever isn't working properly.Or did I make something wrong?I have tried it in FME Desktop 2018.0 and FME Desktop 2017.1.2.0.
I seem to be getting the same issue as described here: http://gis.stackexchange.com/questions/22427/fme-error-failed-to-validate-fme-worker-licence-keyAfter the same amount of time I get "Failed to validate FME worker licence key" - after approx processing 1 000 000 objects. I need parallell processing due to the size of the data, I have tried Aggressive only, and also Extreme. Below is a screenshot showing part of the process. The Parallell runs in Parallell (:)).After approx 1hour 20 minutes the logfile fills with "Failed to validate FME worker licence key" and the fmeworker.exe gets stuck with no work done (0.01 percent CPU constantly). I use FME 2016.1 - floating license - Oracle Edition. Also tried on FME 2017 - same issue@Mark2AtSafe
Hi,We currently have a FME Server 2017.1.1 install on our cloud (AWS), we want to install an FME Engine inside a customer network to allow access protected resources like databases, files etc. Reading about we need to connect the remote engine to:1. FME DataBase: We have our FME database on Amazon RDS, so i can give access to the engine to allow connect to the database, this is fine.2. FME Core: To allow connections to the FME Core, FME engine needs access FME Core using the ports 7069-7072 and 7100-7150 and FME Core needs access FME Engine using the ports 7500, I can add the proper permissions on the servcurity group, so this point is ok.3. FME Server System Share: We are using Amazon EFS for FME System Share, external access to EFS is not allowed unless we implement AWS Direct Connect. We do not want to connect our customer's network to our cloud network to connect to FME Server System Share, is this really necessary? we only want to send jobs to a remote engine, basically y th
Hi,We are using pyfme.I'm profiling a workspace using the technique described here: Profiling a workspace.However, my workspace has a lot of python created factories and my results looks like this:If I take the first one "f_151" there is no trace of that name neither in the log or the fmw file.My question: Is there any way to create my python factories (FMEFactoryPileline) to have something more talking than "f_151"?Thanks,Larry
I am having trouble to connect to serveral webservices. - ArcGIS Server REST API - ArcGIS Online REST Service- Geoserver WFS (with login)The error I get each time is: HTTP/FTP transfer error: 'Couldn't connect to server' The connections are working in a browser (Firefox, Chrome). But none is working in FME.I have tried several settings, but I can not get it to work. Do you have any suggestions I can try? I do not know where to search anymore.Thanks,Complete error:HTTPCaller_2(HTTPFactory): HTTP/FTP transfer error: 'Couldn't connect to server'HTTPCaller_2(HTTPFactory): Please ensure that your network connection is properly set upHTTPCaller_2(HTTPFactory): No proxy settings have been entered. If you require a proxy to access external URLs, please ensure the appropriate information has been enteredThe below feature caused the translation to be terminated
Hi,I have a FME 2016.1 workbench that contains a Custom Loop transformer and within that I also have a PythonCaller with some Python Code.The workbench outputs the expected result but it takes over an hour to run. I need it to run ideally in less than 20 minutes.I have attached some screen shots of the main workbench and the custom transformer. Does anyone have ideas on things I could do to speed this up?Thanks,
Hello,I'm trying to use an external python library, Paramiko to perform some SFTP functionality. I am attempting to use a PythonCaller to run some python that I know works outside of FME. I have python 2.7x64bit installed. I'm running FME 2017.1x64 bit. My python interpreter is set as below:Here is the PythonCaller configuration:Here is the python script:And here is the error:I'm sure i'm goofing up something simple. Thank you for your help!
HI i am having trouble with feature reader in 2017 in that the WHERE clause is not interacting well with the spatial filter envelope query. If i run either in isolation then the process works but together the work bench fails to run.feature reader is version 9, fme 2017 version is 2017.1.1.0 (build 17650 - win32)is anyone else have this issue? i cannot run the where clause in a tester after the feature reader due to the amount of data been extracted. we really need to extract to extents and not the entire data base.any suggestions or help is greatly appreciated.
I'm trying to run the 'FME Server Workflow Management' workspaces and running into a couple of issues running 'chain_job.fmw' depending on how I reference the server itself in the Web Connections settings.1. Web Connection configured as same domain I publish against (eg http://site.company.com)running chain_job from desktop and calling the three published workspaces runs fine.running the published chain jobs errors with a web pages content<title>Notification: DNS Failure</title><h1>This Page Cannot Be Displayed</h1>The host name resolution (DNS lookup) for this host name( site.company.com ) has failed. The Internet address may be misspelled or obsolete,the host ( site.company.com ) may be temporarily unavailable,or the DNS server may be unresponsive.Date: Tue, 20 Feb 2018 16:22:11 AEDT<br />Username: <br />Source IP: 99.99.99.99(this was the machines IP)<br />URL: POST http://site.company.com.com/fmerest/transformations/comm
Hi,I've been given a set of 20+ MapInfo tables, of which most have a period (.) in the file names.I need to convert these tables into MS/SQL, but this presents a problem, since periods are no-go in MS/SQL, and I need to control the schema.I'm trying to write using a dynamic writer, but I simply cannot figure out the combination of parameters, that'll allow me to replace the periods with underscores before writing into the database. No matter what I do, I loose the connection to the "schema", and nothing gets converted.Please help me out. This ought to be a no-brainer, but I'm stumped.Cheers.
I need to remove the default folder created by fme when writing in kml does anyone know how to do that I tried multiple thing but cannot find the solution?enclosed the really basic workspace
Hi there,I have a translation between Microstation DGN files and AutoCAD DWG files where there can be as many as 6000 files at a time, but I'm encountering memory resource issues. I want to avoid splitting this translation into a child process with a WorkspaceRunner or JobSubmitter where it will process 1 file at a time.I'm using FeatureReader-DGN and tried with FeatureWriter-DWG / DWG Writer. FME_TEMP points to a 2 TB drive and the translation accumulated 350 GB of temp files like these before crashing with another TB free: FME_OBJC_MultiWriter_1518629821107_13172_1 ... FME_OBJC_MultiWriter_1518629821107_13172_235Virtual memory is set to automatic paging on the same driveI have 16 GB RAMDGN file sizes range from 13 KB to 29 MBFME 2016.1.3.2 #16717 WIN64FME seems to accumulate all the features from all the files before it writes out a single feature to a physical file. Is there a way to maybe (1) batch up the list files so that n-number-of-files are processed at a time, or (2)
I have a workspace with a FileGDB where I'm removing and adding attribute indexes with the help of arcpy. I also use FMELogFile for logging. FME Desktop does not have a problem with the translation, but the warning messages and job failure occur once I publish to FME Server. I'm having an issue with aworkspace with the following log messages:WARN|Warning: not all FMESessions that were created were destroyed before shutdown. This may cause instabilityWARN|Warning: not all Stashed Objects that were registered were dropped beforeshutdown. This may cause instabilityand maybe this one is related:INFORM|Optional `close' method not present; not calledPlease see:cadastral_to_gdb_update.fmwcadastral_to_gdb_update.log - Desktopcadastral_to_gdb_update_job_11563.log - ServerALTTRANS01_fmeserver_2018-01-22_job11563.log - Server EngineI have a simplified test workspace that uses arcpy to run Exists() and a logger. This one runs just fine on FME Server. Please see:check_arcpy.fmwcheck_arcpy.log - Des
My .fsconfig file is relatively large - around 3GB - and whenever I try to restore this to my new installation of FME Server, the process fails with an error.The FME Server Web UI reports:Error uploading "fmeserver_backup.fsconfig". Reason: Could not write FME Server request message. Connection may have been lost. An existing connection was forcibly closed by the remote hostAnd in the fmeconfiguration.log file, the following errors appear:Thu-20-Oct-2016 07:16:57 PM ERROR RequestHandler-Thread Could not read FME Server response message. Connection may have been lost.There is not enough space on the diskThu-20-Oct-2016 07:16:57 PM ERROR RequestHandler-Thread 401835 : IOException reading client request. Connection may have been closed. Request read so far:
Hello all, I have a pythonCaller in my script where I am populating an array with all the attribute names from the feature test_fields = feature.getAllAttributeNames()how do I go about excluding any fme generated features (example: fme_feature_type). I can't quite work out the syntax. Any help will be appreciated. Thanks
We have a nightly (in theory) workbench that is transferring data from a SQL Spatial Server into multiple shapefiles (~150). I would say 1 out of 3 times it runs it will reach a certain point (it seems to be random, not any specific place in the workbench) and it will crash. It is always pointing to "ucrtbase.dll" though. I have investigated it fairly thoroughly and I can't pinpoint a reason it is happening. Nothing is showing in the workbench logs indicating the error.Is there a known issue with ucrtbase.dll?I do notice that this workbench uses a lot of memory, but why would it work sometimes and not others?We are using FME Desktop version 2017 on Windows 7, but it was happening in previous versions also.Crash report- <Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">- <System> <Provider Name="Application Error" /> <EventID Qualifiers="0">1000</EventID> <Level>2</Level> <Task>100</Task> <Keywords>0
I am using feature readers to dynamically read features from a schema. The features are passed in to the FMW script in FME Server from a web interface so the feature readers don't know at design time what the features are. To write the features I'm using generic writers. The feature readers pass the schemas to the writer, which then know which attributes to write and also knows which format to write (this is passed in from the web inteface too). The name of the output feature comes from the fme_feature_type attribute.This works well for shapefile outputs, but for file base outputs like DWG and KML, the writer makes the name of the file the same name as the output folder. I am writing five features, so my output folder names are "one", "two", "three", "four", "five". When I write to shape output the file name becomes "PARCEL.shp", that is, whatever the FeatureReader reads. But for DWG and KMO the filename becomes &quo
All: Can someone give me a push? I have a webservice with a .pb extension that I need to read. I've tried the things I thought I knew to do to read it HTTPCaller but to no avail. Any help will be greatly appreciated. http://developer.go-metro.com/TMGTFSRealTimeWebService/vehicle/VehiclePositions.pb