Skip to main content
Question

Run only one Workspace Runner using Batch Processing

  • January 18, 2016
  • 5 replies
  • 38 views

Forum|alt.badge.img

Hi,

I am not sure if its possible but yeah. I have a workbench with only 2 WorkspaceRunner transformers where both the workbenches uses HTTPCaller and fetch the data from web.

The input which the first workbench takes is using the different URL all the time and every URL gives a different output (I have a list of URLs). The second workbench runs normal using 'wait for job to complete'.

Can I use the batch processing mode on one transformer only or is there any other solution for that.

This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.

5 replies

erik_jan
Contributor
Forum|alt.badge.img+26
  • Contributor
  • January 18, 2016

I think you want to publish the URL parameter and feed the wanted URL from outside the WorkSpaceRunner using for example a TXT file and reader.

That way the first WorkSpaceRunner will be executed for each URL.


Forum|alt.badge.img
  • Author
  • January 19, 2016

Hi Erik!! Thanks for your reply. Yes, you are correct. but the whole point is can I do that using WB and not cmd prompt?

I have attached below the img file for my wb.

So I have workspacerunner 1 and 2. I have no issues with WS2 (just that 'wait for jobto complete').

For WS1, I have a URL (as shown) and I want to loop it until all the codes are finished one by one in place of %1 as depicted in the img.


redgeographics
Celebrity
Forum|alt.badge.img+62

Not wanting to steal Erik Jan's thunder here, but yes, you can certainly do this from WB too. As he says: if you have the codes in a simple text file, one code per line, you can read that in using the TEXTLINE reader and then pass it through to the WorkspaceRunner. In the workspace that is being called by the WorkspaceRunner you need to have a published parameter set up to take that code.

In this example that published parameter is called Number and I'm feeding the value from text_line_data into it.

Hope this helps.


Forum|alt.badge.img
  • Author
  • January 19, 2016

Hi. Thanks for your efforts. Have seen this working at your end because One parameter in the workspace runner should be a url only, because I am using HTTCaller and if I put text reader as an input, I would not be able to get the data from the net.


redgeographics
Celebrity
Forum|alt.badge.img+62

You can pass a URL as a text parameter too, or just the part that's dynamic and then construct the full URL in the HTTPCaller in the 2nd workspace.