Skip to main content
Archived

Emulation of interactive workspace running with named run instances

Related products:FME Form
  • May 15, 2019
  • 1 reply
  • 3 views

stevenjh
Contributor

Since the introduction of caching and the tools on bookmarks to "Run Just Contained" and "Between Selected" I find myself almost writing 'multiple workbenches in one' and only working with them interactively.

Which has made me think it would be neat to have a way to actually Run them in a traditional FME sense.

Original Idea

I've only thought about this a little bit, but maybe it's a mix of:

  • a property that we can set on the bookmark to state its 'Run-able'
  • a section in bookmarks where we can order run-able bookmarks
    • Show a hierarchy of linked bookmarks that would run after one another
    • Include an option to set bookmarks to run between to handle forking in a data flow.
    • A step that allows disabling bookmarks to prevent running un-wanted upstream sections when running between
  • From the traditional Run prompt, add an option that allows you to set specific bookmark(s?) to run or 'All'

Example

  1. "Bookmark One" runs some transformers to generate an AOI to a database
  2. "Bookmark Two" reads this AOI to download and generate more data saved locally
    1. linked "Bookmark Processing" runs some initial processing that generates results and errors that require manual tweaks on the downloaded data
  3. "Bookmark Three" reads the downloaded in "Bookmark Two"
    1. Linked "bookmark Processing" runs again against the corrected data, generates results and errors ...

Evolved idea

As I've typed this out I'm thinking maybe rather than run-able bookmarks we create "named run-instances", which has a similar concept where bookmarks are ordered within each instance but de-couples the bookmarks themselves.

Now you could create a separate tab view for each named instance which shows just that data flow and links between bookmarks that don't have feature-flows connecting them etc..

'Named run-instances" is a much better idea and I've changed my draft title from "Run a workspace by bookmark"


ps I've now ended up thinking about this more than just a little and I left this as a stream of conscious because I think there's value in understanding how people get to ideas (and I didn't want to rewrite everything!)


This post is closed to further activity.
It may be a question with a best answer, an implemented idea, or just a post needing no comment.
If you have a follow-up or related question, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

1 reply

mark2atsafe
Safer
Forum|alt.badge.img+44

I think this is already being implemented to an extent, and that is in the new Automations part of FME Server. It lets you chain workspaces together and choose which parts to run and what actions to take in response to errors (and yesterday I caught a glimpse of future plans for automation, and it is really heading in this direction).

I think it would be on Server especially, for two reasons. Firstly a workspace defined in Workbench has to run on Server, whatever the case, and it would be very difficult to have Server run a workspace, picking out specific bookmarks to run. i.e. whatever we implement on Desktop we have to allow on Server, and this would be difficult to pull off.

The second reason is that it would be best to be able to run some of these instances in parallel, and that's where Server excels. I don't see us setting up parallel processing on Desktop beyond what's already possible with custom transformers.

But what I really like is the idea of opening multiple workspaces simultaneously in Workbench, with a separate view tab for each. Then you could copy items between them, and see how the output of one interacts with another. Then you upload them to Server and define an automation to join them together. It would really complement the Server automations and I hope we'll take note of this idea and implement that. I'm going to definitely make the suggestion.

In short, yes this is definitely on our agenda, but it's as workspaces (not bookmarks) and the flow is defined on Server (not Desktop).

These are great thoughts, and definitely help steer our development, so thanks for posting them and keep 'em coming!


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings