Creating and organizing workspaces. How to use Workbench.
Recently active
We are deploying two FME servers, one for production, and one for testing (staging).The workflow I've built (7-8 separate workspaces) all refer to one MS/SQL database and one external HTTP service endpoint. There's one "connection set" for production, and another for testing.Using the same set of workspaces, what is the best practice to maintain identical workflows on the two servers, each with its own "connection set".I've streamlined all database connections to a single linked database connection, and know that it can be replaced quite easily in Workbench. But this will require me to publish twice every time, which is not optimal.And what about the HTTP endpoints, is there a way to store these on each separate FME server, so they automagically work ?Any ideas and insights on making the maintenance as simple as possible ?CheersLars I
I have three database tables that I joined using the FeatureJoiner tool. I was able to use the CSV writer to produce a file on my desktop. However, when I use the Socrata writer to write to my Socrata platform. I am getting the following error message: Socrata Writer: HTTP 503 (None): Auth succeeded but view lookup failed -- https://domain.com/api/publishing/v1/revisionSAFE.SOCRATA.SOCRATA2 writer: A fatal error has occurred. Check the logfile above for details... Last line repeated 2 times ...Translation FAILED with 4 error(s) I am not sure why I am getting this error message. I used the Socrata writer last week. It worked fine. Credentials are saved. Since this a new dataset. I doubled check that the Socrata Writer has the appropriate fields selected: Feature Operation: Updated Dataset Handling: Create If needed. Any reason as to why I am getting this error message? Thank you
I have a column (route_num) with a list of route numbers. How can I extract each route number as it's own feature and all other attributes as copies. See belowFrom: To:
I'd like to get more information on when the SQL Creator can be used.
This universal multi-source reading and writing workspace, how to make color parameters adjustable when selecting output kml.How FME server can identify the coordinate definition and geographic parameters of ESRI Reprojector
Hi All, Is there a way to allow the jobsubmitter workspace to be partial populated by some means from user clicking a prebuilt URL? (Or other method) I have a ESRI webmap that contains a feature service with Asset locations. These assets contain a unique identifier attribute I wish to pass into the workspace so the user doesn't have to type it, or select it from a drop down.The workspaceI have a workspace that requires the unique identifier to maintain a relationship with other data, however the user needs to load in a CSV and add other parameter details before executing the workspace. Currently I have set it up so the user types this ID, but this is fraught with danger of the relationship being lost due to typos. My research so far....I have found that I can either build a URL from the attributes in my ESRI web map as a popup to either 1. Open the job submitter with blank parameters (Shareable URL); OR 2. supply all parameters filled in and the job goes straight into execution
In FME 2019, I can pass feature class names to a workspace without error. Now, using FME2020, I'm getting warnings from the workspace that didn't run properly reporting the following:The table name '@Value(fme_feature_type_poly)' could not be found in the Geodatabase as either a feature class or a tableAll other parameters pass fine (postgis where clauses, etc.) The only hiccup is with file geodatabase feature class specification, which is correct within the workspacerunner fmw.There is no error reported by the workspacerunner fmw, just in the target workspace.I've checked over and over and the problem keeps manifesting. However, when using FME2019, everything is smooth-sailing. Anybody else run into this phenomenon or have a known fix? Is there another way that the user parameter needs to be formatted/Thanks,Pete
Hello people, I am new to FME (about 3 months) and this is my first post on this community. So, please be patient, if this question sounds ridiculous to you ;-)The background of my question is as follows: I have a big major workspace and want to split this into a few smaller, less complex, workspaces. In addition, I would like to re-use some of these new small workspaces in another context. Therefore, my idea was to build a few FME-workspaces as modules and use these modules to build bigger major workspaces.I understand that I can use custom-transformers and/or workspace-runner for this, but both do have some disadvantages on its own.Workspace-runner on the one hand, can just run another workspace (as the name says) and it can transfer data from the parent-workspace to the child-workspace via published parameter. However, the workspace-runner cannot give you an output from the child-workspace back to the parent-workspace (if I am right here?). So the workspace-runner is limited in its
I have an FME script which takes specific headers of a source spreadsheet and copies the them and the field values to two new fields (Substrate Size Distribution & Substrate Size Distribution Value). There are transformers which replace alphanumeric characters from the original header string, sorts the numbers that are left, and concatenates the alphanumeric characters back to the sorted values. This works great. But, the script is coping a header from a field called "Visit_Year" to Substrate Size Distribution field and its value, "1989", to Substrate Size Distribution Value, where values are null in the specific headers I am trying to reformat. This is not what I want. See attachment. I want Substrate Size Distribution and Substrate Size Distribution Value fields to contain only the headers and their values, not the header text Visit_Year. Thoughts as to what is going on?
i want to know how u are converting 3d files format to json
I have spreadsheets with Date and Time fields. I assign them to a Reader in FME 2018 and funnel them through AttributeManager. When I check the output that comes out of the Writer, I see that the Date and Time fields have been modified. I have tried to find a setting in the Reader and transformer which would prevent these fields from changing so I don't have to use the DateTimeConverter. Does anyone have suggestions? The only solution I have found is to change the field in Excel to concatenate Date and Time. Then this field stays the same after the AttributeManager transformer. However, some of my spreadsheets don't have a time metric, just date. Thoughts?
Hi list.I have next to no knowledge of what OAuth2 entails, other than it being a security protocol.A customer wants to use OAuth2 when exposing a WFS and/or an Esri Feature Service to us, and we want to use FME (Server) to fetch the data.Both desktop and server have a facility for custom "web connections", and here you can create both "Esri ArcGIS Portal" (w/OAuth2) and a straight up "OAuth2 Service" connections, but how do I utilize them when reading data ?Are there any in-depth resources available that covers this area ?CheersLars I
I have got an environment with a set of Named Connections however I would like to test them without pushing up a workbench. Is this possible?
In MS/SQL I have a table with multiple geometry fields. When using a FeatureReader, how can I designate which geometry column to read ?
I have a dataset with values of D15 (mm), D35 (mm), D50 (mm), D84 (mm), D95 (mm), & D100 (mm). I want to use stringreplacer to remove the letter "D" and "(mm)". Syntax to remove?
Hi @GerhardAtSafe , Thanks for developing the new SharePoint Package, I am very excited about its functionality, but have unfortunately already run into an issue when trying to install it. Please see the log below. It may have to do with my version of python.I am using FME 2020.1.0.1 Build 20596. Apologies if this is something I would rather need to pick up with my IT department. Log when trying to install the package:An error occurred while installing package 'C:\Users\Srautenberg\AppData\Roaming\Safe Software\FME\Packages\20596-win64\PackageFiles\safe.microsoft-sharepoint': An error occurred while installing Python package with 'pip install --force-reinstall --no-deps --no-index --find-links C:\Users\Srautenberg\AppData\Roaming\Safe Software\FME\Packages\20596-win64\PackageFiles\safe.microsoft-sharepoint\python --target C:\Users\Srautenberg\AppData\Roaming\Safe Software\FME\Packages\20596-win64\python\safe.microsoft-sharepoint --upgrade --no-compile fme-microsoft-sharepoint oauthlib
The circled number is exactly 2x the number of records in that input - an sde point file. This happens no matter which file is "on top." In the translation log, the Total Features Read is exactly the right number.Total Features Written is too high by exactly the number of records in the first input. All other inputs are appended correctly. Does anyone know why this is happening?Thank you,Randy McGregor
Forgive me if this is a stupid question, but I haven't found this process to be very intuitive and I haven't found a solution in the documentation. Let's say I have a database with 10 different tables. There are some common columns in each of these tables, but they also all have unique columns. I want to create a dynamic workspace so that a user can open it, run it, and specify the name of the table they're interested in to send only the features from that one table on to the writer. So I create a reader, I select "single merged feature type", I specify the names of all the tables in the Table Names box in the reader parameters, create it and add it to the workspace. I create a writer (let's say it's an ESRI shapefile), I set the User Attributes to Dynamic, and I connect the two. I run the workspace and in the "Feature Types to Read" parameter I provide the name of just one of the tables. I look at the output and it looks okay at first; this
I have a list attribute that I'd like to use in a JSONTemplator. I am able to get the list into an array no issues, however, I want the result to be an array of integers/numbers rather than a string. If it was not a list I can use the xs:integer to try to force it to be an integer, however, I'm not quite sure how I should do this for values in a list. Any ideas on this?
Hello FME-specialists, I use FME(R) 2020.0.2.1 (20200511 - Build 20238 - WIN64)I made a succesfull webconnection with SharePoint.I tried to read the database of MSPROJECTS. According the manager of MSPROJECTS my credentials has all the rights needed to access the msproject database (user and password are correct and user has sufficient rights). The HTTPCALLER unfortunately gives errors: 'HTTP/1.1 403 Forbidden' from ...' (see attatchment)QUESTIONSWhat goes wrong and how can I connect properly to MSPROJECTS with FME?(I also tried to fill the clientID and the client-secret in my web connection but it resulted in no connection with sharepoint)2 . Does FME V2020 HTTPCaller support SAML (SharePoint Online) authentication?3. Do you have a working example HTTPCALLER with SharePoint? =======================================================================WEB_CONNNECTION Misrosoft Sharepoint OnlineI have made a web-connection with sharepoint.URL: https://barorganisatie.sharepoint.com
After creating an FME Server Resource Connection, how can I work with this to author my workspaces? When I view the Folder properties in FME Server I can see the System path references an FME Server macro $(), however when I specify this path within my workspace it shows red because FME Desktop does not recognise this as an existing parameter.
Hello there! I have a problem with the definition of Published Parameters. Using Customized Transformers when I define a Published Parameter to the type "Attribute name", creating a new attribute and having that as output, I have the Attribute name as output and not the Attribute Value. I would like the Attribute Value as output. When I change the definition of the Published Parameter to the type "Text" and fill in the textstring "@Value(name_of_the_attribute)" I do receive the Attribute Value as output. In the attachment you find two files. In one you can see the results of the settings from the configuration menu. Please take into account only "Foutmelding" and "Fouttype". "Foutmelding" makes use of the above described textstring while "Fouttype" makes use of the type attribute name-setting.In the other you can see the output seen from the FME Data Inspector. As can be seen the attribute "Foutmelding"
I've got a big workspace (running on desktop 2019.1.1.0) that uses a few embedded custom transformers to perform some fairly complex calcs. I actually call one custom transformer a lot of times. This worked OK when I had about 75 of the transformers in the workspace, but now that I have about 90 it is returning the error "Too many recursive macro substitutions..."I think there is probably a way I can use looping to physically reduce the number of transformers in the workspace, but this will be a very big effort and I'm not sure there is any guarantee it will actually fix the problem.Has anyone seen this before and know what the issue is?I have found a couple of unanswered questions about this when searching in the previous questions. thanksKeith
Let's say I have 10000 features going thorugh my workflow and 7000 do not pass a test. I want to send a single message (to whatever) and not a message for each feature.I know there's many ways of doing this but I'm looking for the most efficient one. Maybe my approach is wrong, but I've considered any transformer that lets me get a single feature and then I build the message with an AttributeManger or an AttributeCreator:Sampler: 9999 features would go through the NotSampled portStatisticsCalculator: I actually have no statistics to calculateAggregator: may be the best optionAny other?
Hi, I could probably work this out over days (weeks!) but I figured asking the question here may be a quicker method to the end goal!As a first line, I am working in FME(R) 2018.1.0.0 (20180717 - Build 18520 - WIN32) which is unchangeable due to it being what is installed/available at my place of work. Just in case this affects a solution.Also, this is my first time posting here, so apologies if this is vague/long winded/wrong format etc.I have a spreadsheet with each row being a project and multiple columns showing the names and addresses of people involved in the project. I have successfully run this through FME to amend the various raw details into the format required to distribute as I require.However, I now need to generate a duplicate free list of all the 'contact name'/'company name'/'postcode' which I will then be able to reference back to the original format of the spreadsheet (i.e. a row per project with multiple 'contact name'/'company nam